May 28 18:23:33.328508 ip-10-0-137-19 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 18:23:33.328522 ip-10-0-137-19 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 18:23:33.328530 ip-10-0-137-19 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 18:23:33.328875 ip-10-0-137-19 systemd[1]: Failed to start Kubernetes Kubelet. May 28 18:23:43.376637 ip-10-0-137-19 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 18:23:43.376654 ip-10-0-137-19 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0f13e269a18a4e59aed756d602f09e95 -- May 28 18:26:08.742428 ip-10-0-137-19 systemd[1]: Starting Kubernetes Kubelet... May 28 18:26:09.235068 ip-10-0-137-19 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:09.235068 ip-10-0-137-19 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 18:26:09.235068 ip-10-0-137-19 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:09.235068 ip-10-0-137-19 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 18:26:09.235068 ip-10-0-137-19 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:09.238035 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.237947 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 18:26:09.242172 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242156 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:09.242172 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242171 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242175 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242178 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242182 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242185 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242188 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242191 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242194 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242197 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242200 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242203 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242211 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242214 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242216 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242219 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242222 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242225 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242228 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242230 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242233 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:09.242238 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242235 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242238 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242240 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242243 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242246 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242249 2568 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242252 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242254 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242257 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242259 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242262 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242264 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242267 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242269 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242272 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242275 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242277 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242280 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242282 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:09.242704 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242284 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242288 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242290 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242292 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242295 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242297 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242299 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242302 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242304 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242307 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242309 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242312 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242314 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242317 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242319 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242322 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242327 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242332 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242336 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:09.243169 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242339 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242342 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242346 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242349 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242352 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242356 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242359 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242365 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242367 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242370 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242373 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242375 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242378 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242380 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242383 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242385 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242388 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242390 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242393 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242395 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:09.243630 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242398 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242400 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242403 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242405 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242408 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242411 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:09.244099 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.242413 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:09.244316 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244305 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:09.244316 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244315 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244318 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244321 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244324 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244327 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244329 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244332 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244334 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244337 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244339 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244341 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244344 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244347 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244350 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244352 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244354 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244358 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244362 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244364 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:09.244373 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244367 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244370 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244373 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244375 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244378 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244381 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244384 2568 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244387 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244389 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244391 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244394 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244396 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244399 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244401 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244404 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244406 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244408 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244411 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244414 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244417 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:09.244834 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244419 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244422 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244424 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244427 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244429 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244432 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244434 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244436 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244439 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244441 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244443 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244446 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244448 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244451 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244455 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244457 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244459 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244462 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244464 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244466 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:09.245339 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244469 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244471 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244474 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244476 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244479 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244481 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244484 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244486 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244488 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244491 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244493 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244497 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244501 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244504 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244507 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244509 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244512 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244514 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244517 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244519 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:09.245826 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244521 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244524 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244526 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244528 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244531 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.244533 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244603 2568 flags.go:64] FLAG: --address="0.0.0.0" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244610 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244616 2568 flags.go:64] FLAG: --anonymous-auth="true" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244621 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244625 2568 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244628 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244640 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244645 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244648 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244651 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244654 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244658 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244661 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244664 2568 flags.go:64] FLAG: --cgroup-root="" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244666 2568 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244670 2568 flags.go:64] FLAG: --client-ca-file="" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244672 2568 flags.go:64] FLAG: --cloud-config="" May 28 18:26:09.246324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244675 2568 flags.go:64] FLAG: --cloud-provider="external" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244678 2568 flags.go:64] FLAG: --cluster-dns="[]" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244683 2568 flags.go:64] FLAG: --cluster-domain="" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244686 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244689 2568 flags.go:64] FLAG: --config-dir="" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244691 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244694 2568 flags.go:64] FLAG: --container-log-max-files="5" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244698 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244701 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244704 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244708 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244710 2568 flags.go:64] FLAG: --contention-profiling="false" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244713 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244716 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244719 2568 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244722 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244726 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244729 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244732 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244735 2568 flags.go:64] FLAG: --enable-load-reader="false" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244738 2568 flags.go:64] FLAG: --enable-server="true" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244741 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244745 2568 flags.go:64] FLAG: --event-burst="100" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244748 2568 flags.go:64] FLAG: --event-qps="50" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244752 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 18:26:09.246990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244755 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244758 2568 flags.go:64] FLAG: --eviction-hard="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244762 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244765 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244768 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244771 2568 flags.go:64] FLAG: --eviction-soft="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244774 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244776 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244779 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244782 2568 flags.go:64] FLAG: --experimental-mounter-path="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244785 2568 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244788 2568 flags.go:64] FLAG: --fail-swap-on="true" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244790 2568 flags.go:64] FLAG: --feature-gates="" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244794 2568 flags.go:64] FLAG: --file-check-frequency="20s" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244797 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244800 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244803 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244806 2568 flags.go:64] FLAG: --healthz-port="10248" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244809 2568 flags.go:64] FLAG: --help="false" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244812 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-19.ec2.internal" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244815 2568 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244818 2568 flags.go:64] FLAG: --http-check-frequency="20s" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244821 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244825 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 18:26:09.247633 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244828 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244831 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244834 2568 flags.go:64] FLAG: --image-service-endpoint="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244836 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244839 2568 flags.go:64] FLAG: --kube-api-burst="100" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244842 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244845 2568 flags.go:64] FLAG: --kube-api-qps="50" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244848 2568 flags.go:64] FLAG: --kube-reserved="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244851 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244854 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244857 2568 flags.go:64] FLAG: --kubelet-cgroups="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244860 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244862 2568 flags.go:64] FLAG: --lock-file="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244865 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244868 2568 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244871 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244876 2568 flags.go:64] FLAG: --log-json-split-stream="false" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244879 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244882 2568 flags.go:64] FLAG: --log-text-split-stream="false" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244884 2568 flags.go:64] FLAG: --logging-format="text" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244887 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244890 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244893 2568 flags.go:64] FLAG: --manifest-url="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244896 2568 flags.go:64] FLAG: --manifest-url-header="" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244900 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 18:26:09.248207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244903 2568 flags.go:64] FLAG: --max-open-files="1000000" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244907 2568 flags.go:64] FLAG: --max-pods="110" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244910 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244913 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244916 2568 flags.go:64] FLAG: --memory-manager-policy="None" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244919 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244922 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244925 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244928 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244935 2568 flags.go:64] FLAG: --node-status-max-images="50" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244938 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244941 2568 flags.go:64] FLAG: --oom-score-adj="-999" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244944 2568 flags.go:64] FLAG: --pod-cidr="" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244946 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244952 2568 flags.go:64] FLAG: --pod-manifest-path="" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244955 2568 flags.go:64] FLAG: --pod-max-pids="-1" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244958 2568 flags.go:64] FLAG: --pods-per-core="0" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244961 2568 flags.go:64] FLAG: --port="10250" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244964 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244966 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085f428e3206dea81" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244969 2568 flags.go:64] FLAG: --qos-reserved="" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244972 2568 flags.go:64] FLAG: --read-only-port="10255" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244975 2568 flags.go:64] FLAG: --register-node="true" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244978 2568 flags.go:64] FLAG: --register-schedulable="true" May 28 18:26:09.248834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244980 2568 flags.go:64] FLAG: --register-with-taints="" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244984 2568 flags.go:64] FLAG: --registry-burst="10" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244986 2568 flags.go:64] FLAG: --registry-qps="5" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244989 2568 flags.go:64] FLAG: --reserved-cpus="" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244992 2568 flags.go:64] FLAG: --reserved-memory="" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244996 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.244998 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245001 2568 flags.go:64] FLAG: --rotate-certificates="false" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245004 2568 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245008 2568 flags.go:64] FLAG: --runonce="false" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245011 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245014 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245017 2568 flags.go:64] FLAG: --seccomp-default="false" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245023 2568 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245026 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245029 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245032 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245035 2568 flags.go:64] FLAG: --storage-driver-password="root" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245038 2568 flags.go:64] FLAG: --storage-driver-secure="false" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245041 2568 flags.go:64] FLAG: --storage-driver-table="stats" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245044 2568 flags.go:64] FLAG: --storage-driver-user="root" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245047 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245050 2568 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245052 2568 flags.go:64] FLAG: --system-cgroups="" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245055 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 18:26:09.249437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245060 2568 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245063 2568 flags.go:64] FLAG: --tls-cert-file="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245066 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245070 2568 flags.go:64] FLAG: --tls-min-version="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245073 2568 flags.go:64] FLAG: --tls-private-key-file="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245076 2568 flags.go:64] FLAG: --topology-manager-policy="none" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245081 2568 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245083 2568 flags.go:64] FLAG: --topology-manager-scope="container" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245086 2568 flags.go:64] FLAG: --v="2" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245091 2568 flags.go:64] FLAG: --version="false" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245094 2568 flags.go:64] FLAG: --vmodule="" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245099 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.245102 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245228 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245233 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245236 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245239 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245242 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245245 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245247 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245251 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245255 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:09.250028 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245258 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245261 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245264 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245266 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245269 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245271 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245275 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245278 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245281 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245284 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245287 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245290 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245292 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245295 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245297 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245300 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245303 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245306 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245308 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:09.250619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245311 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245313 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245316 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245318 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245320 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245323 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245325 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245328 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245330 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245334 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245337 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245341 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245343 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245346 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245348 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245351 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245353 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245356 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245358 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245361 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:09.251093 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245363 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245366 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245368 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245371 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245373 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245375 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245378 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245380 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245383 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245386 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245389 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245391 2568 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245394 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245397 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245399 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245401 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245404 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245406 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245409 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245411 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:09.251595 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245413 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245416 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245419 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245422 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245425 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245427 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245429 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245432 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245434 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245437 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245439 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245442 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245444 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245446 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245449 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245451 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245454 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:09.252098 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.245456 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:09.252528 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.246191 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:09.254432 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.254415 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 18:26:09.254472 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.254434 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 18:26:09.254500 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254488 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:09.254500 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254493 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:09.254500 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254496 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:09.254500 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254499 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254503 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254505 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254508 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254511 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254513 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254515 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254518 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254520 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254523 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254529 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254532 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254535 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254537 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254540 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254542 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254544 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254547 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254550 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254552 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:09.254603 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254555 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254557 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254560 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254562 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254565 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254567 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254570 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254572 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254574 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254583 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254585 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254588 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254590 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254592 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254595 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254598 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254600 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254603 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254607 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:09.255100 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254611 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254614 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254616 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254619 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254627 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254630 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254632 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254634 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254638 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254642 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254645 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254648 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254650 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254653 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254656 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254659 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254661 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254663 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254666 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254668 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:09.255579 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254671 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254673 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254675 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254678 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254680 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254682 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254685 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254688 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254691 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254693 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254696 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254699 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254701 2568 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254704 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254706 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254709 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254711 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254723 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254725 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254728 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:09.256056 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254730 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254732 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254735 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254737 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.254742 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254872 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254877 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254880 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254882 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254885 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254888 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254890 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254893 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254895 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254898 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254901 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:09.256619 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254903 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254905 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254908 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254911 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254915 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254917 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254920 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254922 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254924 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254927 2568 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254929 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254932 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254934 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254938 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254947 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254950 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254952 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254955 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254957 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:09.257073 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254960 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254962 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254964 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254967 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254969 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254971 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254974 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254976 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254979 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254981 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254983 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254986 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254988 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254990 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254993 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254995 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.254998 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255000 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255003 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255005 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:09.257669 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255008 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255010 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255013 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255015 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255018 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255021 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255023 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255026 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255033 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255036 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255038 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255041 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255043 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255045 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255048 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255050 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255052 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255055 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255057 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255059 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:09.258415 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255062 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255064 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255068 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255071 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255073 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255076 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255078 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255081 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255083 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255086 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255088 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255091 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255093 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255096 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255098 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:09.258901 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:09.255101 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:09.259313 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.255106 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:09.259313 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.256043 2568 server.go:962] "Client rotation is on, will bootstrap in background" May 28 18:26:09.260074 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.260057 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 18:26:09.261233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.261221 2568 server.go:1019] "Starting client certificate rotation" May 28 18:26:09.261343 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.261326 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 18:26:09.262174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.262163 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 18:26:09.288816 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.288791 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 18:26:09.291038 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.291024 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 18:26:09.310437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.310416 2568 log.go:25] "Validated CRI v1 runtime API" May 28 18:26:09.316917 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.316896 2568 log.go:25] "Validated CRI v1 image API" May 28 18:26:09.318472 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.318455 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 18:26:09.319662 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.319642 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 18:26:09.323744 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.323594 2568 fs.go:135] Filesystem UUIDs: map[5097e1d7-b977-44bc-8bb8-69c19dcef261:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c1a51b22-0e4f-4f65-8f15-536aeeb66a1b:/dev/nvme0n1p3] May 28 18:26:09.323804 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.323744 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 18:26:09.329199 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.329069 2568 manager.go:217] Machine: {Timestamp:2026-05-28 18:26:09.328549498 +0000 UTC m=+0.453898582 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106158 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a801b25cbd42b9dd556ff934889b9 SystemUUID:ec2a801b-25cb-d42b-9dd5-56ff934889b9 BootID:0f13e269-a18a-4e59-aed7-56d602f09e95 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:cb:1c:64:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:cb:1c:64:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:d3:63:cd:8b:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 18:26:09.329199 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.329193 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 18:26:09.329325 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.329313 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 18:26:09.331551 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331526 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 18:26:09.331689 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331554 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 18:26:09.331735 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331699 2568 topology_manager.go:138] "Creating topology manager with none policy" May 28 18:26:09.331735 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331707 2568 container_manager_linux.go:306] "Creating device plugin manager" May 28 18:26:09.331735 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331714 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 18:26:09.331735 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.331730 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 18:26:09.334400 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.334388 2568 state_mem.go:36] "Initialized new in-memory state store" May 28 18:26:09.334512 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.334503 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 18:26:09.337196 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.337186 2568 kubelet.go:491] "Attempting to sync node with API server" May 28 18:26:09.337240 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.337200 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 18:26:09.337984 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.337974 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 18:26:09.338017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.337989 2568 kubelet.go:397] "Adding apiserver pod source" May 28 18:26:09.338017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.337999 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 18:26:09.339216 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.339204 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 18:26:09.339272 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.339225 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 18:26:09.341972 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.341954 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hw25c" May 28 18:26:09.343583 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.343568 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 18:26:09.345993 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.345971 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 18:26:09.347013 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347001 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 18:26:09.347054 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347019 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 18:26:09.347054 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347025 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 18:26:09.347054 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347031 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 18:26:09.347054 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347047 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 18:26:09.347054 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347053 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 18:26:09.347220 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347058 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 18:26:09.347220 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347064 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 18:26:09.347220 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347071 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 18:26:09.347220 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347077 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 18:26:09.347220 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347088 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 18:26:09.347490 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.347480 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 18:26:09.348074 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.348055 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hw25c" May 28 18:26:09.349479 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.349465 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 18:26:09.349550 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.349482 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 18:26:09.349769 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.349744 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 18:26:09.349836 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.349817 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 18:26:09.352679 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.352664 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 18:26:09.352733 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.352706 2568 server.go:1295] "Started kubelet" May 28 18:26:09.352826 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.352789 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 18:26:09.352885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.352795 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 18:26:09.352885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.352847 2568 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 18:26:09.353418 ip-10-0-137-19 systemd[1]: Started Kubernetes Kubelet. May 28 18:26:09.355038 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.355019 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 18:26:09.355860 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.355842 2568 server.go:317] "Adding debug handlers to kubelet server" May 28 18:26:09.362089 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.362070 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 18:26:09.362726 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.362711 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 18:26:09.363345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.363323 2568 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 18:26:09.363345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.363338 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 18:26:09.363539 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.363374 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 18:26:09.363539 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.363477 2568 reconstruct.go:97] "Volume reconstruction finished" May 28 18:26:09.363539 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.363485 2568 reconciler.go:26] "Reconciler: start to sync state" May 28 18:26:09.363689 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.363662 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.364103 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.364080 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 18:26:09.364217 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364201 2568 factory.go:55] Registering systemd factory May 28 18:26:09.364258 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364223 2568 factory.go:223] Registration of the systemd container factory successfully May 28 18:26:09.364467 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364454 2568 factory.go:153] Registering CRI-O factory May 28 18:26:09.364516 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364472 2568 factory.go:223] Registration of the crio container factory successfully May 28 18:26:09.364545 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364536 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 18:26:09.364574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364555 2568 factory.go:103] Registering Raw factory May 28 18:26:09.364574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364567 2568 manager.go:1196] Started watching for new ooms in manager May 28 18:26:09.364945 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.364932 2568 manager.go:319] Starting recovery of all containers May 28 18:26:09.370701 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.370683 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:09.371045 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.371014 2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-19.ec2.internal" not found May 28 18:26:09.371158 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.371074 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-19.ec2.internal\" not found" node="ip-10-0-137-19.ec2.internal" May 28 18:26:09.379444 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.379426 2568 manager.go:324] Recovery completed May 28 18:26:09.383562 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.383547 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.385587 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.385570 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.385709 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.385597 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.385709 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.385607 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.386056 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.386041 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 18:26:09.386056 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.386052 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 18:26:09.386185 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.386068 2568 state_mem.go:36] "Initialized new in-memory state store" May 28 18:26:09.387066 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.387054 2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-19.ec2.internal" not found May 28 18:26:09.390187 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.390173 2568 policy_none.go:49] "None policy: Start" May 28 18:26:09.390256 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.390190 2568 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 18:26:09.390256 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.390200 2568 state_mem.go:35] "Initializing new in-memory state store" May 28 18:26:09.426756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.426736 2568 manager.go:341] "Starting Device Plugin manager" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.426778 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.426791 2568 server.go:85] "Starting device plugin registration server" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.427089 2568 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.427104 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.427206 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.427275 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.427281 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.428279 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.428325 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.445541 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.445273 2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-19.ec2.internal" not found May 28 18:26:09.501384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.501296 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 18:26:09.502617 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.502592 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 18:26:09.502710 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.502626 2568 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 18:26:09.502710 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.502652 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 18:26:09.502710 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.502661 2568 kubelet.go:2451] "Starting kubelet main sync loop" May 28 18:26:09.502838 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.502770 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 18:26:09.509074 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.509054 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:09.527429 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.527414 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.533501 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.533482 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.533597 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.533513 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.533597 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.533524 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.533597 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.533554 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-19.ec2.internal" May 28 18:26:09.543614 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.543595 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-19.ec2.internal" May 28 18:26:09.543670 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.543619 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-19.ec2.internal\": node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.561679 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.561651 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.603065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.603030 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal"] May 28 18:26:09.603185 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.603111 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.604772 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.604753 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.604849 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.604785 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.604849 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.604802 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.606001 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.605987 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.606129 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606115 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.606189 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606161 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.606741 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606722 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.606741 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606733 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.606741 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606747 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.606926 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606758 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.606926 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606758 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.606926 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.606904 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.607719 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.607705 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:09.607784 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.607729 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:09.608361 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.608347 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:09.608445 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.608371 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:09.608445 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.608380 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:09.628774 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.628752 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-19.ec2.internal\" not found" node="ip-10-0-137-19.ec2.internal" May 28 18:26:09.632753 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.632737 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-19.ec2.internal\" not found" node="ip-10-0-137-19.ec2.internal" May 28 18:26:09.661756 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.661721 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.665027 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.665011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.665085 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.665035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.665085 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.665056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4351858acffee685f753b0f84f44bc3a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-19.ec2.internal\" (UID: \"4351858acffee685f753b0f84f44bc3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:09.762505 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.762426 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.765740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765715 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4351858acffee685f753b0f84f44bc3a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-19.ec2.internal\" (UID: \"4351858acffee685f753b0f84f44bc3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:09.765825 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765764 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.765825 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765790 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.765825 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765789 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4351858acffee685f753b0f84f44bc3a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-19.ec2.internal\" (UID: \"4351858acffee685f753b0f84f44bc3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:09.765825 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765814 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.765955 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.765858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfa4899af10c54e176fd5aa0f7946588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal\" (UID: \"dfa4899af10c54e176fd5aa0f7946588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.863543 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.863504 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:09.931879 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.931841 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:09.935670 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:09.935655 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:09.963606 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:09.963568 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.064021 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.063927 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.164386 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.164353 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.260843 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.260812 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 18:26:10.261496 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.260987 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 18:26:10.261496 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.260995 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 18:26:10.265054 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.265033 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.350851 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.350791 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:21:09 +0000 UTC" deadline="2028-02-23 20:51:48.37205102 +0000 UTC" May 28 18:26:10.350851 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.350849 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15266h25m38.021206761s" May 28 18:26:10.362994 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.362966 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 18:26:10.366021 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.365993 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.400770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.400742 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 18:26:10.426362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.426336 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thbsw" May 28 18:26:10.432469 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.432452 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thbsw" May 28 18:26:10.466101 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.466067 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.468806 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:10.468761 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa4899af10c54e176fd5aa0f7946588.slice/crio-98b706ae99b38997af6d2f17243458ef4516af0963d4c1ea8d37bec4dc0133de WatchSource:0}: Error finding container 98b706ae99b38997af6d2f17243458ef4516af0963d4c1ea8d37bec4dc0133de: Status 404 returned error can't find the container with id 98b706ae99b38997af6d2f17243458ef4516af0963d4c1ea8d37bec4dc0133de May 28 18:26:10.470165 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:10.469720 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4351858acffee685f753b0f84f44bc3a.slice/crio-79dec793da9d101349a3f35c3e7cf0edbd3c9fb8b9363684d3ee43d621368d8d WatchSource:0}: Error finding container 79dec793da9d101349a3f35c3e7cf0edbd3c9fb8b9363684d3ee43d621368d8d: Status 404 returned error can't find the container with id 79dec793da9d101349a3f35c3e7cf0edbd3c9fb8b9363684d3ee43d621368d8d May 28 18:26:10.474709 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.474690 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:26:10.506299 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.506241 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" event={"ID":"dfa4899af10c54e176fd5aa0f7946588","Type":"ContainerStarted","Data":"98b706ae99b38997af6d2f17243458ef4516af0963d4c1ea8d37bec4dc0133de"} May 28 18:26:10.507168 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.507122 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" event={"ID":"4351858acffee685f753b0f84f44bc3a","Type":"ContainerStarted","Data":"79dec793da9d101349a3f35c3e7cf0edbd3c9fb8b9363684d3ee43d621368d8d"} May 28 18:26:10.566604 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.566574 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.635266 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.635186 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:10.667580 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.667546 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.768110 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.768069 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.868847 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:10.868813 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-19.ec2.internal\" not found" May 28 18:26:10.919878 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.919792 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:10.964096 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.964059 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" May 28 18:26:10.976272 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.976203 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 18:26:10.977445 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.977420 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" May 28 18:26:10.984361 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:10.984339 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 18:26:11.106817 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.106786 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:11.339034 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.338967 2568 apiserver.go:52] "Watching apiserver" May 28 18:26:11.347295 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.347267 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 18:26:11.348733 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.348711 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jfpqj","openshift-multus/multus-4dl65","openshift-multus/multus-additional-cni-plugins-k96j5","openshift-network-diagnostics/network-check-target-4p7pj","openshift-network-operator/iptables-alerter-h9f8t","kube-system/konnectivity-agent-czpgk","openshift-cluster-node-tuning-operator/tuned-vx2cp","openshift-image-registry/node-ca-8nxk8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal","openshift-multus/network-metrics-daemon-xvgkq","openshift-ovn-kubernetes/ovnkube-node-dm6ld","kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9"] May 28 18:26:11.354186 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.354159 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.356324 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.356303 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dl65" May 28 18:26:11.356952 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.356931 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 18:26:11.356952 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.356949 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cmspv\"" May 28 18:26:11.357093 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.356983 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 18:26:11.358396 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.358370 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.358733 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.358708 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 18:26:11.359022 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.358953 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 18:26:11.359022 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.358990 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ksrm9\"" May 28 18:26:11.359407 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.359093 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 18:26:11.359407 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.359095 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 18:26:11.360740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.360455 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:11.360740 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.360537 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:11.360740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.360620 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.360740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.360685 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 18:26:11.360961 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.360769 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4z5p\"" May 28 18:26:11.361252 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.361174 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 18:26:11.363441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.362745 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.363441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.362809 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 18:26:11.363441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.363326 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpjtk\"" May 28 18:26:11.363441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.363347 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 18:26:11.363441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.363381 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 18:26:11.365181 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.365166 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 18:26:11.365270 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.365242 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kktnp\"" May 28 18:26:11.365326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.365242 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 18:26:11.367058 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.367038 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.369153 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.369119 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.369263 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.369246 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.369332 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.369298 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 18:26:11.369332 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.369310 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:11.369430 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.369379 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 18:26:11.369481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.369447 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk2td\"" May 28 18:26:11.371876 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.371854 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 18:26:11.372664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.372269 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 18:26:11.372664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.372364 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 18:26:11.372664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.372386 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-42m8h\"" May 28 18:26:11.374056 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.374039 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.375349 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.374954 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.375923 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.375882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.376008 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.375940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-cnibin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376008 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.375966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-socket-dir-parent\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376008 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.375993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93234e37-fe33-4c85-903e-9f4806f8cb88-agent-certs\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10fa77b5-edb8-44ff-b606-a49a74ca5ece-tmp-dir\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376039 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9bx\" (UniqueName: \"kubernetes.io/projected/10fa77b5-edb8-44ff-b606-a49a74ca5ece-kube-api-access-nt9bx\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-modprobe-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-lib-modules\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-system-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376176 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-netns\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-conf-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csch\" (UniqueName: \"kubernetes.io/projected/0614382a-1dd6-4867-a4b0-79639c6a37d7-kube-api-access-7csch\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-conf\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdddr\" (UniqueName: \"kubernetes.io/projected/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-kube-api-access-wdddr\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-cni-binary-copy\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysconfig\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-tuned\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376498 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-bin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.376561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376554 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2ltts\"" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-kubelet\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-hostroot\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8942\" (UniqueName: \"kubernetes.io/projected/0af33076-deca-4f21-b0d9-50d8c1b1e792-kube-api-access-l8942\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93234e37-fe33-4c85-903e-9f4806f8cb88-konnectivity-ca\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10fa77b5-edb8-44ff-b606-a49a74ca5ece-hosts-file\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-var-lib-kubelet\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-k8s-cni-cncf-io\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-multus\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376778 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-daemon-config\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-multus-certs\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-host-slash\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-etc-kubernetes\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-systemd\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377086 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-run\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-sys\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.376991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-tmp\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbrw\" (UniqueName: \"kubernetes.io/projected/98344b08-0e45-4b07-bc13-71b57d4bbe4d-kube-api-access-7sbrw\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-os-release\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-os-release\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-system-cni-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-cnibin\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-kubernetes\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-host\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-iptables-alerter-script\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.377895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377824 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 18:26:11.378326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.377992 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 18:26:11.378326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378031 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 18:26:11.378326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378154 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 18:26:11.378326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378268 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 18:26:11.378436 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378328 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snlb2\"" May 28 18:26:11.378634 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378536 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 18:26:11.378634 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378531 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 18:26:11.378739 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.378662 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 18:26:11.380060 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.380039 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 18:26:11.433231 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.433197 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:10 +0000 UTC" deadline="2028-02-24 03:21:39.475196634 +0000 UTC" May 28 18:26:11.433231 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.433220 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15272h55m28.041978175s" May 28 18:26:11.464375 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.464350 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 18:26:11.478319 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-socket-dir-parent\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.478487 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478329 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9bx\" (UniqueName: \"kubernetes.io/projected/10fa77b5-edb8-44ff-b606-a49a74ca5ece-kube-api-access-nt9bx\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.478487 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478359 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-modprobe-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.478487 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478384 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-lib-modules\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.478487 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-socket-dir-parent\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.478487 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-var-lib-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.478737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478501 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.478737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-modprobe-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.478737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478670 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.478737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478695 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-netns\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.478737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478720 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7csch\" (UniqueName: \"kubernetes.io/projected/0614382a-1dd6-4867-a4b0-79639c6a37d7-kube-api-access-7csch\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-netd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478871 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-cni-binary-copy\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478897 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysconfig\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.478964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478901 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-lib-modules\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.478982 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-log-socket\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479098 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-kubelet\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479152 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93234e37-fe33-4c85-903e-9f4806f8cb88-konnectivity-ca\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479178 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10fa77b5-edb8-44ff-b606-a49a74ca5ece-hosts-file\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479198 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-var-lib-kubelet\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.479275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-ovn\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-systemd-units\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-slash\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-netns\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479404 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-netns\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479423 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-k8s-cni-cncf-io\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479442 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-multus\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479464 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-cni-binary-copy\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysconfig\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479478 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-daemon-config\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479534 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-host-slash\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479604 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-systemd\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-host-slash\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479626 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-run\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-node-log\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.479677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-run\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-socket-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-systemd\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dzpq\" (UniqueName: \"kubernetes.io/projected/9d44eb9c-d8bc-4686-979b-032afd106b59-kube-api-access-9dzpq\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qccw\" (UniqueName: \"kubernetes.io/projected/4a0672d5-f228-474e-8018-2e7cd8a9453b-kube-api-access-9qccw\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479789 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-cnibin\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-multus\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479824 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-iptables-alerter-script\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479841 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-cnibin\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.479853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480114 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93234e37-fe33-4c85-903e-9f4806f8cb88-agent-certs\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480162 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10fa77b5-edb8-44ff-b606-a49a74ca5ece-tmp-dir\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-etc-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-registration-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480262 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-system-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480281 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-conf-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480303 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-conf\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.480355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-daemon-config\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-k8s-cni-cncf-io\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480333 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdddr\" (UniqueName: \"kubernetes.io/projected/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-kube-api-access-wdddr\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480389 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-kubelet\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480401 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480447 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-tuned\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480472 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-kubelet\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-systemd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480612 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-bin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480645 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-hostroot\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480671 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8942\" (UniqueName: \"kubernetes.io/projected/0af33076-deca-4f21-b0d9-50d8c1b1e792-kube-api-access-l8942\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tww\" (UniqueName: \"kubernetes.io/projected/f3ba8c98-0c00-437e-a193-4b9632e8933f-kube-api-access-w8tww\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480729 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-multus-certs\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480756 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p472l\" (UniqueName: \"kubernetes.io/projected/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-kube-api-access-p472l\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-device-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ba8c98-0c00-437e-a193-4b9632e8933f-host\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480857 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-etc-kubernetes\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480916 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93234e37-fe33-4c85-903e-9f4806f8cb88-konnectivity-ca\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480932 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-sys\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480960 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-tmp\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10fa77b5-edb8-44ff-b606-a49a74ca5ece-hosts-file\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.480978 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbrw\" (UniqueName: \"kubernetes.io/projected/98344b08-0e45-4b07-bc13-71b57d4bbe4d-kube-api-access-7sbrw\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-bin\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-env-overrides\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-script-lib\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481073 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-os-release\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-sys-fs\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ba8c98-0c00-437e-a193-4b9632e8933f-serviceca\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481131 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-os-release\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481176 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-system-cni-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.481635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481200 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-kubernetes\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481225 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-host\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481242 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-config\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481283 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481300 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-cnibin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-var-lib-kubelet\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481399 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-iptables-alerter-script\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-etc-kubernetes\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-cnibin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481519 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-sys\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481846 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-var-lib-cni-bin\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-host\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-hostroot\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481921 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-multus-conf-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-os-release\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.482493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.481984 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-os-release\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482050 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0614382a-1dd6-4867-a4b0-79639c6a37d7-system-cni-dir\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-host-run-multus-certs\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482127 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-kubernetes\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482275 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-conf\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10fa77b5-edb8-44ff-b606-a49a74ca5ece-tmp-dir\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-sysctl-d\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0614382a-1dd6-4867-a4b0-79639c6a37d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.483533 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.482796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af33076-deca-4f21-b0d9-50d8c1b1e792-system-cni-dir\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.484696 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.484671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-etc-tuned\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.484813 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.484751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98344b08-0e45-4b07-bc13-71b57d4bbe4d-tmp\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.485168 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.485130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93234e37-fe33-4c85-903e-9f4806f8cb88-agent-certs\") pod \"konnectivity-agent-czpgk\" (UID: \"93234e37-fe33-4c85-903e-9f4806f8cb88\") " pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.493687 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.493657 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:11.493795 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.493696 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:11.493795 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.493711 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:11.493895 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.493835 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.993783645 +0000 UTC m=+3.119132730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:11.494893 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.494869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9bx\" (UniqueName: \"kubernetes.io/projected/10fa77b5-edb8-44ff-b606-a49a74ca5ece-kube-api-access-nt9bx\") pod \"node-resolver-jfpqj\" (UID: \"10fa77b5-edb8-44ff-b606-a49a74ca5ece\") " pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.495210 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.495189 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csch\" (UniqueName: \"kubernetes.io/projected/0614382a-1dd6-4867-a4b0-79639c6a37d7-kube-api-access-7csch\") pod \"multus-additional-cni-plugins-k96j5\" (UID: \"0614382a-1dd6-4867-a4b0-79639c6a37d7\") " pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.499560 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.499531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbrw\" (UniqueName: \"kubernetes.io/projected/98344b08-0e45-4b07-bc13-71b57d4bbe4d-kube-api-access-7sbrw\") pod \"tuned-vx2cp\" (UID: \"98344b08-0e45-4b07-bc13-71b57d4bbe4d\") " pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.502059 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.502034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8942\" (UniqueName: \"kubernetes.io/projected/0af33076-deca-4f21-b0d9-50d8c1b1e792-kube-api-access-l8942\") pod \"multus-4dl65\" (UID: \"0af33076-deca-4f21-b0d9-50d8c1b1e792\") " pod="openshift-multus/multus-4dl65" May 28 18:26:11.502171 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.502131 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdddr\" (UniqueName: \"kubernetes.io/projected/96da76a8-d3b0-49c1-b94e-a94d5e7b51ca-kube-api-access-wdddr\") pod \"iptables-alerter-h9f8t\" (UID: \"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca\") " pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.581814 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581776 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-kubelet\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.581814 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581817 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-systemd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-systemd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581876 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-kubelet\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581920 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tww\" (UniqueName: \"kubernetes.io/projected/f3ba8c98-0c00-437e-a193-4b9632e8933f-kube-api-access-w8tww\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581959 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p472l\" (UniqueName: \"kubernetes.io/projected/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-kube-api-access-p472l\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.581986 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-device-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582010 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ba8c98-0c00-437e-a193-4b9632e8933f-host\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.582048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582040 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-bin\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582063 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-env-overrides\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582096 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-device-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582107 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-script-lib\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582116 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3ba8c98-0c00-437e-a193-4b9632e8933f-host\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582130 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-sys-fs\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582175 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ba8c98-0c00-437e-a193-4b9632e8933f-serviceca\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582179 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-bin\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582204 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582227 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-config\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582257 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-var-lib-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-sys-fs\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582292 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582345 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-netd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582362 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.582384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582386 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-cni-netd\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582442 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-log-socket\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-var-lib-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582413 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-log-socket\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582490 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-env-overrides\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582486 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582521 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.582527 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582531 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582552 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-ovn\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:11.582576 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:12.082564129 +0000 UTC m=+3.207913212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582591 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-systemd-units\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582598 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-run-ovn\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582627 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-systemd-units\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-script-lib\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582674 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-slash\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582690 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-netns\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582709 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-node-log\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582717 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-slash\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582725 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-socket-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582742 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dzpq\" (UniqueName: \"kubernetes.io/projected/9d44eb9c-d8bc-4686-979b-032afd106b59-kube-api-access-9dzpq\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-host-run-netns\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582758 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qccw\" (UniqueName: \"kubernetes.io/projected/4a0672d5-f228-474e-8018-2e7cd8a9453b-kube-api-access-9qccw\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovnkube-config\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582775 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-node-log\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582791 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-etc-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582807 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-registration-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582827 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-socket-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582860 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582861 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a0672d5-f228-474e-8018-2e7cd8a9453b-registration-dir\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.583766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.582886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-etc-openvswitch\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.584484 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.583116 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3ba8c98-0c00-437e-a193-4b9632e8933f-serviceca\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.585343 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.585317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.594685 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.594627 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dzpq\" (UniqueName: \"kubernetes.io/projected/9d44eb9c-d8bc-4686-979b-032afd106b59-kube-api-access-9dzpq\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:11.594685 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.594625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p472l\" (UniqueName: \"kubernetes.io/projected/a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612-kube-api-access-p472l\") pod \"ovnkube-node-dm6ld\" (UID: \"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.594856 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.594750 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tww\" (UniqueName: \"kubernetes.io/projected/f3ba8c98-0c00-437e-a193-4b9632e8933f-kube-api-access-w8tww\") pod \"node-ca-8nxk8\" (UID: \"f3ba8c98-0c00-437e-a193-4b9632e8933f\") " pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.594856 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.594750 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qccw\" (UniqueName: \"kubernetes.io/projected/4a0672d5-f228-474e-8018-2e7cd8a9453b-kube-api-access-9qccw\") pod \"aws-ebs-csi-driver-node-pf7l9\" (UID: \"4a0672d5-f228-474e-8018-2e7cd8a9453b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.665757 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.665720 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" May 28 18:26:11.674524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.674501 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4dl65" May 28 18:26:11.684239 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.684210 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k96j5" May 28 18:26:11.690861 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.690838 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9f8t" May 28 18:26:11.697494 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.697464 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:11.704053 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.704031 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfpqj" May 28 18:26:11.709598 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.709580 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8nxk8" May 28 18:26:11.716233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.716213 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:11.720889 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.720869 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" May 28 18:26:11.802299 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:11.802271 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:12.086328 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.086233 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:12.086328 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.086307 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:12.086496 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086420 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:12.086496 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086441 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:12.086496 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086458 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:12.086496 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086472 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:12.086496 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086488 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:13.086473314 +0000 UTC m=+4.211822385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:12.086661 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:12.086522 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:13.086506015 +0000 UTC m=+4.211855085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:12.100592 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.100570 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93234e37_fe33_4c85_903e_9f4806f8cb88.slice/crio-2676809c566cd85fef575c4a3b67798d1da69ebf2ad1cfd9ec69149fd0747b80 WatchSource:0}: Error finding container 2676809c566cd85fef575c4a3b67798d1da69ebf2ad1cfd9ec69149fd0747b80: Status 404 returned error can't find the container with id 2676809c566cd85fef575c4a3b67798d1da69ebf2ad1cfd9ec69149fd0747b80 May 28 18:26:12.101870 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.101835 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda784bc4b_ef4b_48f3_9c1d_74f7d9c1c612.slice/crio-7a9997eb4045670d0a51b8a4fded4ccf333ead6faac732ca61b935235e47617a WatchSource:0}: Error finding container 7a9997eb4045670d0a51b8a4fded4ccf333ead6faac732ca61b935235e47617a: Status 404 returned error can't find the container with id 7a9997eb4045670d0a51b8a4fded4ccf333ead6faac732ca61b935235e47617a May 28 18:26:12.104895 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.104791 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98344b08_0e45_4b07_bc13_71b57d4bbe4d.slice/crio-811f1995ea33e6b4c802c9bd7d66c7edd044a5058f0b02e70aa315d4a48cf47c WatchSource:0}: Error finding container 811f1995ea33e6b4c802c9bd7d66c7edd044a5058f0b02e70aa315d4a48cf47c: Status 404 returned error can't find the container with id 811f1995ea33e6b4c802c9bd7d66c7edd044a5058f0b02e70aa315d4a48cf47c May 28 18:26:12.105897 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.105867 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0614382a_1dd6_4867_a4b0_79639c6a37d7.slice/crio-1f5593832d67ad0341f5fa7644af78d1d18870be1d56311ad778443faa8b8129 WatchSource:0}: Error finding container 1f5593832d67ad0341f5fa7644af78d1d18870be1d56311ad778443faa8b8129: Status 404 returned error can't find the container with id 1f5593832d67ad0341f5fa7644af78d1d18870be1d56311ad778443faa8b8129 May 28 18:26:12.106833 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.106796 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96da76a8_d3b0_49c1_b94e_a94d5e7b51ca.slice/crio-1033388be7276102b61d38ef88e07401f9edd9292047df93e672fa7dd8cabe69 WatchSource:0}: Error finding container 1033388be7276102b61d38ef88e07401f9edd9292047df93e672fa7dd8cabe69: Status 404 returned error can't find the container with id 1033388be7276102b61d38ef88e07401f9edd9292047df93e672fa7dd8cabe69 May 28 18:26:12.108054 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.107983 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fa77b5_edb8_44ff_b606_a49a74ca5ece.slice/crio-1e3b78c17c0d4206c5c6c04e990844d23fa8dbe6d22d95b4e179d0f5ea90bf36 WatchSource:0}: Error finding container 1e3b78c17c0d4206c5c6c04e990844d23fa8dbe6d22d95b4e179d0f5ea90bf36: Status 404 returned error can't find the container with id 1e3b78c17c0d4206c5c6c04e990844d23fa8dbe6d22d95b4e179d0f5ea90bf36 May 28 18:26:12.108969 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.108912 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ba8c98_0c00_437e_a193_4b9632e8933f.slice/crio-0324ba7d410b6735a467717261e66825d8061029b7d7d28cc9cef7fe3d1887fb WatchSource:0}: Error finding container 0324ba7d410b6735a467717261e66825d8061029b7d7d28cc9cef7fe3d1887fb: Status 404 returned error can't find the container with id 0324ba7d410b6735a467717261e66825d8061029b7d7d28cc9cef7fe3d1887fb May 28 18:26:12.131645 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.131620 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0672d5_f228_474e_8018_2e7cd8a9453b.slice/crio-192fa785532cc61cf7614dc7fdc8afd463277cad0d0453696ef5e8971eeb14d6 WatchSource:0}: Error finding container 192fa785532cc61cf7614dc7fdc8afd463277cad0d0453696ef5e8971eeb14d6: Status 404 returned error can't find the container with id 192fa785532cc61cf7614dc7fdc8afd463277cad0d0453696ef5e8971eeb14d6 May 28 18:26:12.133938 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:26:12.133835 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af33076_deca_4f21_b0d9_50d8c1b1e792.slice/crio-bebd915e97905c5218b0cd0cf5d56451a8cf96b0b334b092cfb7acf1d32531c9 WatchSource:0}: Error finding container bebd915e97905c5218b0cd0cf5d56451a8cf96b0b334b092cfb7acf1d32531c9: Status 404 returned error can't find the container with id bebd915e97905c5218b0cd0cf5d56451a8cf96b0b334b092cfb7acf1d32531c9 May 28 18:26:12.433595 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.433556 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:10 +0000 UTC" deadline="2027-11-13 10:22:04.430634379 +0000 UTC" May 28 18:26:12.433595 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.433593 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12807h55m51.997044394s" May 28 18:26:12.520006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.519341 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" event={"ID":"4351858acffee685f753b0f84f44bc3a","Type":"ContainerStarted","Data":"cd8159c0818aa543d796c3c202f5fce209d0a98cca215aac7e847b644b4bbdf5"} May 28 18:26:12.527300 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.526688 2568 generic.go:358] "Generic (PLEG): container finished" podID="dfa4899af10c54e176fd5aa0f7946588" containerID="c92f21d4dad2a7169a5eef46d0166605aeffdc19894bc0044398652f98fefddb" exitCode=0 May 28 18:26:12.527300 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.526768 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" event={"ID":"dfa4899af10c54e176fd5aa0f7946588","Type":"ContainerDied","Data":"c92f21d4dad2a7169a5eef46d0166605aeffdc19894bc0044398652f98fefddb"} May 28 18:26:12.529603 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.529534 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dl65" event={"ID":"0af33076-deca-4f21-b0d9-50d8c1b1e792","Type":"ContainerStarted","Data":"bebd915e97905c5218b0cd0cf5d56451a8cf96b0b334b092cfb7acf1d32531c9"} May 28 18:26:12.531451 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.531393 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" event={"ID":"4a0672d5-f228-474e-8018-2e7cd8a9453b","Type":"ContainerStarted","Data":"192fa785532cc61cf7614dc7fdc8afd463277cad0d0453696ef5e8971eeb14d6"} May 28 18:26:12.535264 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.535213 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-19.ec2.internal" podStartSLOduration=2.535198531 podStartE2EDuration="2.535198531s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:12.534617008 +0000 UTC m=+3.659966102" watchObservedRunningTime="2026-05-28 18:26:12.535198531 +0000 UTC m=+3.660547625" May 28 18:26:12.536710 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.536663 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfpqj" event={"ID":"10fa77b5-edb8-44ff-b606-a49a74ca5ece","Type":"ContainerStarted","Data":"1e3b78c17c0d4206c5c6c04e990844d23fa8dbe6d22d95b4e179d0f5ea90bf36"} May 28 18:26:12.538848 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.538812 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" event={"ID":"98344b08-0e45-4b07-bc13-71b57d4bbe4d","Type":"ContainerStarted","Data":"811f1995ea33e6b4c802c9bd7d66c7edd044a5058f0b02e70aa315d4a48cf47c"} May 28 18:26:12.540218 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.540191 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8nxk8" event={"ID":"f3ba8c98-0c00-437e-a193-4b9632e8933f","Type":"ContainerStarted","Data":"0324ba7d410b6735a467717261e66825d8061029b7d7d28cc9cef7fe3d1887fb"} May 28 18:26:12.542472 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.542415 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9f8t" event={"ID":"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca","Type":"ContainerStarted","Data":"1033388be7276102b61d38ef88e07401f9edd9292047df93e672fa7dd8cabe69"} May 28 18:26:12.543815 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.543772 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerStarted","Data":"1f5593832d67ad0341f5fa7644af78d1d18870be1d56311ad778443faa8b8129"} May 28 18:26:12.545439 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.545413 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"7a9997eb4045670d0a51b8a4fded4ccf333ead6faac732ca61b935235e47617a"} May 28 18:26:12.549291 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:12.549250 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czpgk" event={"ID":"93234e37-fe33-4c85-903e-9f4806f8cb88","Type":"ContainerStarted","Data":"2676809c566cd85fef575c4a3b67798d1da69ebf2ad1cfd9ec69149fd0747b80"} May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:13.093932 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:13.094002 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094157 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094176 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094189 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094274 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:15.094231796 +0000 UTC m=+6.219580874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094362 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:13.094776 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.094397 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:15.094385069 +0000 UTC m=+6.219734144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:13.506499 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:13.505678 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:13.506499 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.505800 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:13.506499 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:13.506252 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:13.506499 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:13.506354 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:13.572114 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:13.572076 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" event={"ID":"dfa4899af10c54e176fd5aa0f7946588","Type":"ContainerStarted","Data":"9de92acff7e5f74db6b09c4e3458a53a2aef257368f4c4dec39d05fbed658658"} May 28 18:26:15.111769 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:15.111737 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:15.111781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.111878 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.111892 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.111904 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.111946 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:19.111934284 +0000 UTC m=+10.237283355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.112245 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:15.112334 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.112295 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:19.112279304 +0000 UTC m=+10.237628377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:15.503875 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:15.503793 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:15.504035 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.503952 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:15.504363 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:15.504344 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:15.504469 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:15.504444 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:17.504298 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:17.504263 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:17.504838 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:17.504394 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:17.504933 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:17.504861 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:17.505040 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:17.504952 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:19.148482 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:19.148420 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:19.148495 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.148653 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.148673 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.148686 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.148753 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:27.14873333 +0000 UTC m=+18.274082421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.149175 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:19.149617 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.149230 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:27.149212845 +0000 UTC m=+18.274561937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:19.504494 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:19.504418 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:19.504668 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.504536 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:19.505017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:19.504995 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:19.505157 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:19.505120 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:21.503371 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:21.503327 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:21.503840 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:21.503379 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:21.503840 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:21.503474 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:21.503840 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:21.503602 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:23.503243 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:23.503199 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:23.503243 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:23.503241 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:23.503769 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:23.503332 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:23.503769 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:23.503444 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:25.503440 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:25.502938 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:25.503440 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:25.503063 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:25.503440 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:25.503122 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:25.503440 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:25.503260 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:27.209103 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:27.209070 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:27.209133 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209268 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209322 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209350 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209364 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209431 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.209412834 +0000 UTC m=+34.334761914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:27.209664 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.209462 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.209440517 +0000 UTC m=+34.334789589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:27.503668 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:27.503576 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:27.503668 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:27.503634 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:27.503878 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.503705 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:27.503878 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:27.503744 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:29.504312 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:29.504276 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:29.504835 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:29.504393 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:29.504835 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:29.504439 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:29.504835 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:29.504531 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:31.503868 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.503463 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:31.504641 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.503501 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:31.504641 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:31.503960 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:31.504641 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:31.504067 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:31.610722 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.610682 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8nxk8" event={"ID":"f3ba8c98-0c00-437e-a193-4b9632e8933f","Type":"ContainerStarted","Data":"2cde767a8b165b70abcfa38b6e7a2e67caecc797cef2478ca6a91fb0806ffbea"} May 28 18:26:31.612376 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.612346 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="89eb99e619440899698c504a00c43cf55644900c03e49baa1dc2555b4f06ed85" exitCode=0 May 28 18:26:31.612526 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.612425 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"89eb99e619440899698c504a00c43cf55644900c03e49baa1dc2555b4f06ed85"} May 28 18:26:31.615954 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.615934 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:26:31.616275 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616253 2568 generic.go:358] "Generic (PLEG): container finished" podID="a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612" containerID="997863c22da349be08000e56cbd9272a499eb47549eb64e50ad9e50cdccb68a4" exitCode=1 May 28 18:26:31.616346 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616321 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"27ab15e703afb6dd6dfa6ea473bdce7ff8bb8ebdb76aff134577d006a03367f1"} May 28 18:26:31.616392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616344 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"dbc55e2a05548c36c8f9f455b286c26f6a7ff2d3284195de0eaa2676da93f593"} May 28 18:26:31.616392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616357 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"534cba9eb362331ab9399a36007f3432bf73340edbd38e9c5aeb8b7b34223a51"} May 28 18:26:31.616392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616365 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"f4b6e3295e955c2ee0c06c2bfe0c184790982b612bae520d8e9aa8ee29ea10d2"} May 28 18:26:31.616392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616375 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerDied","Data":"997863c22da349be08000e56cbd9272a499eb47549eb64e50ad9e50cdccb68a4"} May 28 18:26:31.616392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.616388 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"9bc213a1d853660d39395f568f34d641bb33d42bdba241a5ad5dc37ed832c714"} May 28 18:26:31.617690 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.617666 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czpgk" event={"ID":"93234e37-fe33-4c85-903e-9f4806f8cb88","Type":"ContainerStarted","Data":"9f6bee9365f1f39563bd83fd89cd55abeaf9dcf8a26f14200107bf61a498e6b0"} May 28 18:26:31.621599 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.621575 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4dl65" event={"ID":"0af33076-deca-4f21-b0d9-50d8c1b1e792","Type":"ContainerStarted","Data":"db25cadeeab4dc0abd67a243575d2f61047877ff55a205981ff32eea2eaf7bdb"} May 28 18:26:31.622970 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.622940 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" event={"ID":"4a0672d5-f228-474e-8018-2e7cd8a9453b","Type":"ContainerStarted","Data":"fe01b9648e92956abb29ace7af38a6f28a1e760013bd4e4e82c24a0972d01e02"} May 28 18:26:31.624267 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.624246 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfpqj" event={"ID":"10fa77b5-edb8-44ff-b606-a49a74ca5ece","Type":"ContainerStarted","Data":"285e58d8f605eb94398a408b6860ac16218a3cedbf92b7b4b9f8a192bca3da09"} May 28 18:26:31.625184 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.625115 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8nxk8" podStartSLOduration=4.198015652 podStartE2EDuration="22.625101382s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.130377958 +0000 UTC m=+3.255727044" lastFinishedPulling="2026-05-28 18:26:30.557463701 +0000 UTC m=+21.682812774" observedRunningTime="2026-05-28 18:26:31.624958288 +0000 UTC m=+22.750307379" watchObservedRunningTime="2026-05-28 18:26:31.625101382 +0000 UTC m=+22.750450476" May 28 18:26:31.625269 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.625236 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-19.ec2.internal" podStartSLOduration=21.62522767 podStartE2EDuration="21.62522767s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:13.591047324 +0000 UTC m=+4.716396421" watchObservedRunningTime="2026-05-28 18:26:31.62522767 +0000 UTC m=+22.750576767" May 28 18:26:31.626248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.626200 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" event={"ID":"98344b08-0e45-4b07-bc13-71b57d4bbe4d","Type":"ContainerStarted","Data":"aadab935c6550f9f4bd2342492abf7bb959ce02a702b35795e33d6a92fcab79e"} May 28 18:26:31.642358 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.642293 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4dl65" podStartSLOduration=4.210640463 podStartE2EDuration="22.642277036s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.136436579 +0000 UTC m=+3.261785666" lastFinishedPulling="2026-05-28 18:26:30.568073168 +0000 UTC m=+21.693422239" observedRunningTime="2026-05-28 18:26:31.642120236 +0000 UTC m=+22.767469330" watchObservedRunningTime="2026-05-28 18:26:31.642277036 +0000 UTC m=+22.767626129" May 28 18:26:31.677908 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.677852 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-czpgk" podStartSLOduration=4.29869523 podStartE2EDuration="22.677837737s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.102888609 +0000 UTC m=+3.228237683" lastFinishedPulling="2026-05-28 18:26:30.48203111 +0000 UTC m=+21.607380190" observedRunningTime="2026-05-28 18:26:31.677515881 +0000 UTC m=+22.802864975" watchObservedRunningTime="2026-05-28 18:26:31.677837737 +0000 UTC m=+22.803186829" May 28 18:26:31.723657 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.723601 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jfpqj" podStartSLOduration=4.297403185 podStartE2EDuration="22.723582316s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.130379658 +0000 UTC m=+3.255728732" lastFinishedPulling="2026-05-28 18:26:30.556558788 +0000 UTC m=+21.681907863" observedRunningTime="2026-05-28 18:26:31.696738118 +0000 UTC m=+22.822087212" watchObservedRunningTime="2026-05-28 18:26:31.723582316 +0000 UTC m=+22.848931430" May 28 18:26:31.723980 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:31.723949 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vx2cp" podStartSLOduration=4.2755518200000004 podStartE2EDuration="22.723941675s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.106633897 +0000 UTC m=+3.231982968" lastFinishedPulling="2026-05-28 18:26:30.555023749 +0000 UTC m=+21.680372823" observedRunningTime="2026-05-28 18:26:31.723528884 +0000 UTC m=+22.848877978" watchObservedRunningTime="2026-05-28 18:26:31.723941675 +0000 UTC m=+22.849290767" May 28 18:26:32.296273 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.296244 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 18:26:32.439728 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.439576 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:26:32.296268513Z","UUID":"e963cc56-2838-4df5-b7e5-d5bf2c67d1eb","Handler":null,"Name":"","Endpoint":""} May 28 18:26:32.443127 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.443102 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 18:26:32.443268 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.443156 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 18:26:32.630704 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.630671 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" event={"ID":"4a0672d5-f228-474e-8018-2e7cd8a9453b","Type":"ContainerStarted","Data":"58c0b355bebf5d4dd5f3a6e5aa777f4e538ecf20e1b5bd9e179b55ad62e316d7"} May 28 18:26:32.632084 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.632059 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9f8t" event={"ID":"96da76a8-d3b0-49c1-b94e-a94d5e7b51ca","Type":"ContainerStarted","Data":"670a0bda47f822db86579cf816b60dd62b0dfeb2d9113125e20c97fd6b8117f6"} May 28 18:26:32.648261 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:32.648209 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h9f8t" podStartSLOduration=5.216737269 podStartE2EDuration="23.648192211s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.130493227 +0000 UTC m=+3.255842303" lastFinishedPulling="2026-05-28 18:26:30.561948161 +0000 UTC m=+21.687297245" observedRunningTime="2026-05-28 18:26:32.648115786 +0000 UTC m=+23.773464884" watchObservedRunningTime="2026-05-28 18:26:32.648192211 +0000 UTC m=+23.773541306" May 28 18:26:33.503631 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.503371 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:33.503786 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.503410 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:33.503786 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:33.503677 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:33.503786 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:33.503771 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:33.640029 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.639988 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" event={"ID":"4a0672d5-f228-474e-8018-2e7cd8a9453b","Type":"ContainerStarted","Data":"9b5dee642b36c7a64c726a8f68844821b54948eeb09f8a681f37c29c4e4e147d"} May 28 18:26:33.657576 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.657535 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf7l9" podStartSLOduration=3.673351052 podStartE2EDuration="24.657519361s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.136132897 +0000 UTC m=+3.261481974" lastFinishedPulling="2026-05-28 18:26:33.12030121 +0000 UTC m=+24.245650283" observedRunningTime="2026-05-28 18:26:33.657430797 +0000 UTC m=+24.782779890" watchObservedRunningTime="2026-05-28 18:26:33.657519361 +0000 UTC m=+24.782868457" May 28 18:26:33.809528 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.809440 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:33.810043 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:33.810027 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:34.644801 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:34.644769 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:26:34.645544 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:34.645506 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"c2043385db5ca6692154ad28289d875d54ec3ed23773d6873fec8989c57cfdba"} May 28 18:26:35.503556 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:35.503518 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:35.503753 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:35.503530 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:35.503753 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:35.503663 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:35.503753 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:35.503705 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:36.651670 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.651641 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:26:36.652328 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.651941 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"f062fae3acbca10c501b298b925d3be849cb4c61cca37d3fc932c9d78b108e72"} May 28 18:26:36.652328 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.652259 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:36.652443 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.652428 2568 scope.go:117] "RemoveContainer" containerID="997863c22da349be08000e56cbd9272a499eb47549eb64e50ad9e50cdccb68a4" May 28 18:26:36.653702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.653652 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="4ddb8accfb1de2a50ced31d98ccf21ed6a0a51277458cceb0a61cfff9b22add1" exitCode=0 May 28 18:26:36.653702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.653684 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"4ddb8accfb1de2a50ced31d98ccf21ed6a0a51277458cceb0a61cfff9b22add1"} May 28 18:26:36.669317 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:36.669296 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:37.503880 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.503844 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:37.504104 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.503853 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:37.504104 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:37.503967 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:37.504104 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:37.504018 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:37.643558 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.643528 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4p7pj"] May 28 18:26:37.646251 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.646224 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvgkq"] May 28 18:26:37.658163 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.658110 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="4cf6d7147effe4215a5b0064e07ce894c87fb082e45afbc5ac378f2e4e89b38b" exitCode=0 May 28 18:26:37.658554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.658187 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"4cf6d7147effe4215a5b0064e07ce894c87fb082e45afbc5ac378f2e4e89b38b"} May 28 18:26:37.662231 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.662211 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:26:37.662644 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.662625 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:37.662727 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.662625 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" event={"ID":"a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612","Type":"ContainerStarted","Data":"cdbd7fa29e1bc88a818a6b7adc8e3892d4719f64c860cbbc807cb86bbd489f22"} May 28 18:26:37.662777 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:37.662747 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:37.662852 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.662832 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:37.662969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.662856 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:37.663036 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:37.663012 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:37.663102 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.663043 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:37.681455 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.681431 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:26:37.708569 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:37.708522 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" podStartSLOduration=9.922901833 podStartE2EDuration="28.708509888s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.103669879 +0000 UTC m=+3.229018950" lastFinishedPulling="2026-05-28 18:26:30.889277919 +0000 UTC m=+22.014627005" observedRunningTime="2026-05-28 18:26:37.706936254 +0000 UTC m=+28.832285348" watchObservedRunningTime="2026-05-28 18:26:37.708509888 +0000 UTC m=+28.833858985" May 28 18:26:38.666968 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:38.666933 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="f5df1a03ad0f8c4546f797b8b2c32ad7e5015c36c8ae35beb722ac8f6841e929" exitCode=0 May 28 18:26:38.667442 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:38.667028 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"f5df1a03ad0f8c4546f797b8b2c32ad7e5015c36c8ae35beb722ac8f6841e929"} May 28 18:26:38.868547 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:38.868506 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:38.868752 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:38.868660 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 18:26:38.869162 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:38.869117 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-czpgk" May 28 18:26:39.504299 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:39.504264 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:39.504483 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:39.504370 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:39.504483 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:39.504458 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:39.504640 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:39.504605 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:41.503367 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:41.503328 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:41.504134 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:41.503467 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:41.504134 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:41.503527 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:41.504134 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:41.503633 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:43.220890 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.220853 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.220913 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221029 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221047 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221074 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221085 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.221071418 +0000 UTC m=+66.346420490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221089 2568 projected.go:194] Error preparing data for projected volume kube-api-access-7hnpx for pod openshift-network-diagnostics/network-check-target-4p7pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:43.221553 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.221162 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx podName:78417364-22ca-422e-9601-8c8f4ae0f425 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.221129041 +0000 UTC m=+66.346478118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7hnpx" (UniqueName: "kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx") pod "network-check-target-4p7pj" (UID: "78417364-22ca-422e-9601-8c8f4ae0f425") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:43.503562 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.503476 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:43.503762 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.503611 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4p7pj" podUID="78417364-22ca-422e-9601-8c8f4ae0f425" May 28 18:26:43.503762 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.503669 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:43.503874 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.503791 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvgkq" podUID="9d44eb9c-d8bc-4686-979b-032afd106b59" May 28 18:26:43.642130 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.642097 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-19.ec2.internal" event="NodeReady" May 28 18:26:43.642310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.642279 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 18:26:43.685607 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.685567 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbfsd"] May 28 18:26:43.721228 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.721187 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n64wh"] May 28 18:26:43.721393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.721375 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.723850 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.723830 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 18:26:43.724005 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.723906 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 18:26:43.724170 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.724132 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\"" May 28 18:26:43.736092 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.736070 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n64wh"] May 28 18:26:43.736092 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.736095 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbfsd"] May 28 18:26:43.736268 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.736227 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:43.738888 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.738868 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 18:26:43.739005 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.738939 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\"" May 28 18:26:43.739071 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.739052 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 18:26:43.739330 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.739311 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cfd886-6c34-493c-90c8-0b386beeca41-tmp-dir\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hcc\" (UniqueName: \"kubernetes.io/projected/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-kube-api-access-v2hcc\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpvzc\" (UniqueName: \"kubernetes.io/projected/56cfd886-6c34-493c-90c8-0b386beeca41-kube-api-access-qpvzc\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:43.824956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.824860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56cfd886-6c34-493c-90c8-0b386beeca41-config-volume\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.925357 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.925357 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925370 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hcc\" (UniqueName: \"kubernetes.io/projected/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-kube-api-access-v2hcc\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925394 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzc\" (UniqueName: \"kubernetes.io/projected/56cfd886-6c34-493c-90c8-0b386beeca41-kube-api-access-qpvzc\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925433 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925456 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56cfd886-6c34-493c-90c8-0b386beeca41-config-volume\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925476 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cfd886-6c34-493c-90c8-0b386beeca41-tmp-dir\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.925514 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.925561 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:43.925612 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.925588 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:44.425566619 +0000 UTC m=+35.550915696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:26:43.925937 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:43.925625 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:44.425608339 +0000 UTC m=+35.550957410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:43.925937 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.925814 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56cfd886-6c34-493c-90c8-0b386beeca41-tmp-dir\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.926215 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.926184 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56cfd886-6c34-493c-90c8-0b386beeca41-config-volume\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.936609 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.936587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpvzc\" (UniqueName: \"kubernetes.io/projected/56cfd886-6c34-493c-90c8-0b386beeca41-kube-api-access-qpvzc\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:43.936772 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:43.936753 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hcc\" (UniqueName: \"kubernetes.io/projected/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-kube-api-access-v2hcc\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:44.429453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:44.429262 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:44.429816 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:44.429473 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:44.429816 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:44.429418 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:44.429816 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:44.429572 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:45.429555368 +0000 UTC m=+36.554904439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:26:44.429816 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:44.429585 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:44.429816 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:44.429627 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:45.429615922 +0000 UTC m=+36.554964994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:45.436257 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.436218 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:45.436637 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.436275 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:45.436637 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:45.436361 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:45.436637 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:45.436376 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:45.436637 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:45.436423 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:47.436407613 +0000 UTC m=+38.561756691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:45.436637 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:45.436437 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:47.436430919 +0000 UTC m=+38.561779989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:26:45.503313 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.503277 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:26:45.503462 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.503319 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:26:45.507699 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.507673 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 18:26:45.507699 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.507690 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 18:26:45.507894 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.507687 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\"" May 28 18:26:45.507894 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.507731 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\"" May 28 18:26:45.507894 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.507808 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 18:26:45.682418 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.682384 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="8ddabc399e3c57c68c8bd495c84fde8c6f92632061e745f3c0dea0d3da7c67d1" exitCode=0 May 28 18:26:45.682550 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:45.682434 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"8ddabc399e3c57c68c8bd495c84fde8c6f92632061e745f3c0dea0d3da7c67d1"} May 28 18:26:46.686462 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:46.686430 2568 generic.go:358] "Generic (PLEG): container finished" podID="0614382a-1dd6-4867-a4b0-79639c6a37d7" containerID="884987105f3e15f6cc1534af0798a4951ee44c1a494cbec25d2f4f811e2ef18d" exitCode=0 May 28 18:26:46.686917 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:46.686478 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerDied","Data":"884987105f3e15f6cc1534af0798a4951ee44c1a494cbec25d2f4f811e2ef18d"} May 28 18:26:47.452164 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:47.452077 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:47.452164 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:47.452122 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:47.452349 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:47.452239 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:47.452349 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:47.452241 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:47.452349 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:47.452290 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:51.45227625 +0000 UTC m=+42.577625321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:47.452349 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:47.452303 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:51.452296887 +0000 UTC m=+42.577645957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:26:47.690663 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:47.690631 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k96j5" event={"ID":"0614382a-1dd6-4867-a4b0-79639c6a37d7","Type":"ContainerStarted","Data":"963e536078e2c52c2e1415113ee1012800a0f4d6fa12a72952664fc74115037e"} May 28 18:26:47.714565 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:47.714475 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k96j5" podStartSLOduration=6.082249471 podStartE2EDuration="38.714461954s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:12.130315549 +0000 UTC m=+3.255664626" lastFinishedPulling="2026-05-28 18:26:44.762528038 +0000 UTC m=+35.887877109" observedRunningTime="2026-05-28 18:26:47.712908541 +0000 UTC m=+38.838257635" watchObservedRunningTime="2026-05-28 18:26:47.714461954 +0000 UTC m=+38.839811046" May 28 18:26:51.480298 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:51.480260 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:51.480298 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:51.480313 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:51.480761 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:51.480412 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:51.480761 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:51.480412 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:51.480761 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:51.480466 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:59.480451918 +0000 UTC m=+50.605800988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:51.480761 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:51.480479 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:59.480473143 +0000 UTC m=+50.605822214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:26:59.534355 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:59.534317 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:26:59.534843 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:26:59.534374 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:26:59.534843 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:59.534462 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:59.534843 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:59.534467 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:59.534843 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:59.534520 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.53450568 +0000 UTC m=+66.659854752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:26:59.534843 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:26:59.534542 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.534536299 +0000 UTC m=+66.659885369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:27:09.681124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:09.681093 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6ld" May 28 18:27:15.239080 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.239038 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:27:15.239564 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.239096 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:27:15.242164 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.242122 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 18:27:15.242265 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.242188 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 18:27:15.249616 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.249597 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 18:27:15.249708 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.249650 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs podName:9d44eb9c-d8bc-4686-979b-032afd106b59 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:19.249635329 +0000 UTC m=+130.374984399 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs") pod "network-metrics-daemon-xvgkq" (UID: "9d44eb9c-d8bc-4686-979b-032afd106b59") : secret "metrics-daemon-secret" not found May 28 18:27:15.251687 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.251673 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 18:27:15.263310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.263281 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hnpx\" (UniqueName: \"kubernetes.io/projected/78417364-22ca-422e-9601-8c8f4ae0f425-kube-api-access-7hnpx\") pod \"network-check-target-4p7pj\" (UID: \"78417364-22ca-422e-9601-8c8f4ae0f425\") " pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:27:15.515661 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.515581 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\"" May 28 18:27:15.522732 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.522713 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:27:15.540964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.540837 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:27:15.540964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.540896 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:27:15.541117 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.541017 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:27:15.541117 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.541083 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:47.541067011 +0000 UTC m=+98.666416083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:27:15.541117 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.541017 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:27:15.541284 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:15.541240 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:47.541218143 +0000 UTC m=+98.666567231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:27:15.710990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.710958 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4p7pj"] May 28 18:27:15.714051 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:27:15.714024 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78417364_22ca_422e_9601_8c8f4ae0f425.slice/crio-1b4c31ff45c2f11e79f84416b1ead1f2bfa2ebe48c0ab6fee12bfd253604a37d WatchSource:0}: Error finding container 1b4c31ff45c2f11e79f84416b1ead1f2bfa2ebe48c0ab6fee12bfd253604a37d: Status 404 returned error can't find the container with id 1b4c31ff45c2f11e79f84416b1ead1f2bfa2ebe48c0ab6fee12bfd253604a37d May 28 18:27:15.744613 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:15.744567 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4p7pj" event={"ID":"78417364-22ca-422e-9601-8c8f4ae0f425","Type":"ContainerStarted","Data":"1b4c31ff45c2f11e79f84416b1ead1f2bfa2ebe48c0ab6fee12bfd253604a37d"} May 28 18:27:18.752326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:18.752240 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4p7pj" event={"ID":"78417364-22ca-422e-9601-8c8f4ae0f425","Type":"ContainerStarted","Data":"f89ba6b34811c3b1a81d8d1a4f0111a61920d01a2f1a00d2736ab849f43559a7"} May 28 18:27:18.752688 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:18.752365 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:27:47.552036 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:47.551955 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:27:47.552036 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:47.551999 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:27:47.552463 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:47.552097 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:27:47.552463 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:47.552099 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:27:47.552463 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:47.552180 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert podName:4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:51.552163546 +0000 UTC m=+162.677512617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert") pod "ingress-canary-n64wh" (UID: "4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8") : secret "canary-serving-cert" not found May 28 18:27:47.552463 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:47.552194 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls podName:56cfd886-6c34-493c-90c8-0b386beeca41 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:51.552188023 +0000 UTC m=+162.677537093 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls") pod "dns-default-gbfsd" (UID: "56cfd886-6c34-493c-90c8-0b386beeca41") : secret "dns-default-metrics-tls" not found May 28 18:27:49.757102 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:49.757070 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4p7pj" May 28 18:27:49.772595 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:49.772547 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4p7pj" podStartSLOduration=98.053821086 podStartE2EDuration="1m40.772531708s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:27:15.715876008 +0000 UTC m=+66.841225079" lastFinishedPulling="2026-05-28 18:27:18.434586626 +0000 UTC m=+69.559935701" observedRunningTime="2026-05-28 18:27:18.76684678 +0000 UTC m=+69.892195873" watchObservedRunningTime="2026-05-28 18:27:49.772531708 +0000 UTC m=+100.897880801" May 28 18:27:56.800209 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.800181 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6"] May 28 18:27:56.803009 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.802994 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:56.805688 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.805655 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 18:27:56.807244 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.807227 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 18:27:56.807382 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.807358 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n67gf\"" May 28 18:27:56.807382 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.807374 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 18:27:56.812044 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.812021 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6"] May 28 18:27:56.908619 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.908588 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w"] May 28 18:27:56.911439 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.911420 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:56.913014 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.912989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tvff\" (UniqueName: \"kubernetes.io/projected/4833b41f-22ed-41d5-84cc-76e7a500508c-kube-api-access-7tvff\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:56.913123 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.913059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:56.916186 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.916169 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 18:27:56.916274 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.916169 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 18:27:56.916274 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.916170 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 18:27:56.916468 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.916450 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8hgsb\"" May 28 18:27:56.916603 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.916587 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 18:27:56.919895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.919879 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-s4pvh"] May 28 18:27:56.922568 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.922553 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:56.924408 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.924383 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w"] May 28 18:27:56.925318 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.925296 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t44mw\"" May 28 18:27:56.925430 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.925341 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 18:27:56.925637 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.925620 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 18:27:56.925637 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.925632 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 18:27:56.925743 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.925721 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 18:27:56.931035 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.931010 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 18:27:56.932333 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:56.932286 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-s4pvh"] May 28 18:27:57.008398 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.008363 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc"] May 28 18:27:57.011301 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.011285 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.013572 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013550 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tvff\" (UniqueName: \"kubernetes.io/projected/4833b41f-22ed-41d5-84cc-76e7a500508c-kube-api-access-7tvff\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:57.013700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013589 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-snapshots\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-tmp\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-service-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013750 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78dcc4de-c2d6-4392-a8ff-61f410865e78-serving-cert\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebb8d950-335d-414d-9427-400d6819d2ce-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtc4x\" (UniqueName: \"kubernetes.io/projected/78dcc4de-c2d6-4392-a8ff-61f410865e78-kube-api-access-dtc4x\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb8d950-335d-414d-9427-400d6819d2ce-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.013870 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.013849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpt4z\" (UniqueName: \"kubernetes.io/projected/ebb8d950-335d-414d-9427-400d6819d2ce-kube-api-access-cpt4z\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.014546 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.013944 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 18:27:57.014546 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.014027 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls podName:4833b41f-22ed-41d5-84cc-76e7a500508c nodeName:}" failed. No retries permitted until 2026-05-28 18:27:57.514006385 +0000 UTC m=+108.639355460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls") pod "cluster-samples-operator-697587599-w57k6" (UID: "4833b41f-22ed-41d5-84cc-76e7a500508c") : secret "samples-operator-tls" not found May 28 18:27:57.014546 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.014448 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 18:27:57.014694 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.014675 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 18:27:57.014856 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.014841 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8n227\"" May 28 18:27:57.014920 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.014838 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 18:27:57.015767 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.015744 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:27:57.015859 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.015798 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 18:27:57.018819 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.018800 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.022299 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.022281 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 18:27:57.022867 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.022853 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtdtx\"" May 28 18:27:57.023248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.023230 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 18:27:57.023443 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.023264 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 18:27:57.024677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.024634 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc"] May 28 18:27:57.031296 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.031271 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 18:27:57.039681 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.038097 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:27:57.045726 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.044798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tvff\" (UniqueName: \"kubernetes.io/projected/4833b41f-22ed-41d5-84cc-76e7a500508c-kube-api-access-7tvff\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:57.115018 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.114982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9453197a-0933-4672-9837-578e31dabc7b-config\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.115248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115033 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvn9\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115230 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-snapshots\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115275 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-tmp\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115298 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-service-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115369 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78dcc4de-c2d6-4392-a8ff-61f410865e78-serving-cert\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115394 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebb8d950-335d-414d-9427-400d6819d2ce-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115413 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtc4x\" (UniqueName: \"kubernetes.io/projected/78dcc4de-c2d6-4392-a8ff-61f410865e78-kube-api-access-dtc4x\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115432 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb8d950-335d-414d-9427-400d6819d2ce-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115455 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpt4z\" (UniqueName: \"kubernetes.io/projected/ebb8d950-335d-414d-9427-400d6819d2ce-kube-api-access-cpt4z\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115485 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9453197a-0933-4672-9837-578e31dabc7b-serving-cert\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.115524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4tnp\" (UniqueName: \"kubernetes.io/projected/9453197a-0933-4672-9837-578e31dabc7b-kube-api-access-m4tnp\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-tmp\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78dcc4de-c2d6-4392-a8ff-61f410865e78-snapshots\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.115969 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.115931 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebb8d950-335d-414d-9427-400d6819d2ce-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.116306 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.116196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-service-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.116306 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.116206 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78dcc4de-c2d6-4392-a8ff-61f410865e78-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.117888 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.117869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb8d950-335d-414d-9427-400d6819d2ce-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.117964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.117941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78dcc4de-c2d6-4392-a8ff-61f410865e78-serving-cert\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.124446 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.124417 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtc4x\" (UniqueName: \"kubernetes.io/projected/78dcc4de-c2d6-4392-a8ff-61f410865e78-kube-api-access-dtc4x\") pod \"insights-operator-78bdfb888c-s4pvh\" (UID: \"78dcc4de-c2d6-4392-a8ff-61f410865e78\") " pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.124854 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.124836 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpt4z\" (UniqueName: \"kubernetes.io/projected/ebb8d950-335d-414d-9427-400d6819d2ce-kube-api-access-cpt4z\") pod \"kube-storage-version-migrator-operator-565644f49-j5w9w\" (UID: \"ebb8d950-335d-414d-9427-400d6819d2ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.216135 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216084 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216349 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216186 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9453197a-0933-4672-9837-578e31dabc7b-serving-cert\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.216349 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216213 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216349 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216237 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4tnp\" (UniqueName: \"kubernetes.io/projected/9453197a-0933-4672-9837-578e31dabc7b-kube-api-access-m4tnp\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.216341 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.216366 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd45c4f9-bpbp4: secret "image-registry-tls" not found May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216379 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216408 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.216440 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls podName:97b0f838-12de-4a81-b5bf-65d25f7b7fee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:57.716417288 +0000 UTC m=+108.841766372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls") pod "image-registry-6cd45c4f9-bpbp4" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee") : secret "image-registry-tls" not found May 28 18:27:57.216510 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216463 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216798 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216525 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9453197a-0933-4672-9837-578e31dabc7b-config\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.216798 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216572 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn9\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216798 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216604 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.216798 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216654 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.217003 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.216810 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.217185 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.217127 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.217185 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.217169 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9453197a-0933-4672-9837-578e31dabc7b-config\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.218022 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.217999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.218963 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.218946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.219186 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.219168 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9453197a-0933-4672-9837-578e31dabc7b-serving-cert\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.219302 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.219283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.220103 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.220087 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" May 28 18:27:57.225431 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.225409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.225519 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.225486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvn9\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.225639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.225618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4tnp\" (UniqueName: \"kubernetes.io/projected/9453197a-0933-4672-9837-578e31dabc7b-kube-api-access-m4tnp\") pod \"service-ca-operator-57b5b68b8-w29rc\" (UID: \"9453197a-0933-4672-9837-578e31dabc7b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.232445 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.232425 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" May 28 18:27:57.320515 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.320402 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" May 28 18:27:57.350986 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.350955 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w"] May 28 18:27:57.353858 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:27:57.353813 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb8d950_335d_414d_9427_400d6819d2ce.slice/crio-f7824f88ba7f2b5a8940f2411c0bdf855edf15cd164b6e7b7a61e6f0d6415090 WatchSource:0}: Error finding container f7824f88ba7f2b5a8940f2411c0bdf855edf15cd164b6e7b7a61e6f0d6415090: Status 404 returned error can't find the container with id f7824f88ba7f2b5a8940f2411c0bdf855edf15cd164b6e7b7a61e6f0d6415090 May 28 18:27:57.370196 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.370065 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-s4pvh"] May 28 18:27:57.374320 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:27:57.374274 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dcc4de_c2d6_4392_a8ff_61f410865e78.slice/crio-52b0bb0761755fd49495603daa902a3cdaff58619ca04181a099401aa5bb1955 WatchSource:0}: Error finding container 52b0bb0761755fd49495603daa902a3cdaff58619ca04181a099401aa5bb1955: Status 404 returned error can't find the container with id 52b0bb0761755fd49495603daa902a3cdaff58619ca04181a099401aa5bb1955 May 28 18:27:57.450822 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.450790 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc"] May 28 18:27:57.454356 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:27:57.454327 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9453197a_0933_4672_9837_578e31dabc7b.slice/crio-06e8fafe462afc96d1f0420499698a250a506e953bbc3add652b65ce4d705df5 WatchSource:0}: Error finding container 06e8fafe462afc96d1f0420499698a250a506e953bbc3add652b65ce4d705df5: Status 404 returned error can't find the container with id 06e8fafe462afc96d1f0420499698a250a506e953bbc3add652b65ce4d705df5 May 28 18:27:57.520020 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.519989 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:57.520207 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.520128 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 18:27:57.520248 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.520209 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls podName:4833b41f-22ed-41d5-84cc-76e7a500508c nodeName:}" failed. No retries permitted until 2026-05-28 18:27:58.520190204 +0000 UTC m=+109.645539276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls") pod "cluster-samples-operator-697587599-w57k6" (UID: "4833b41f-22ed-41d5-84cc-76e7a500508c") : secret "samples-operator-tls" not found May 28 18:27:57.721861 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.721766 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:57.722073 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.721921 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 18:27:57.722073 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.721939 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd45c4f9-bpbp4: secret "image-registry-tls" not found May 28 18:27:57.722073 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:57.721997 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls podName:97b0f838-12de-4a81-b5bf-65d25f7b7fee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:58.721980238 +0000 UTC m=+109.847329309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls") pod "image-registry-6cd45c4f9-bpbp4" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee") : secret "image-registry-tls" not found May 28 18:27:57.827072 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.827029 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" event={"ID":"ebb8d950-335d-414d-9427-400d6819d2ce","Type":"ContainerStarted","Data":"f7824f88ba7f2b5a8940f2411c0bdf855edf15cd164b6e7b7a61e6f0d6415090"} May 28 18:27:57.828193 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.828161 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" event={"ID":"78dcc4de-c2d6-4392-a8ff-61f410865e78","Type":"ContainerStarted","Data":"52b0bb0761755fd49495603daa902a3cdaff58619ca04181a099401aa5bb1955"} May 28 18:27:57.829374 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:57.829351 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" event={"ID":"9453197a-0933-4672-9837-578e31dabc7b","Type":"ContainerStarted","Data":"06e8fafe462afc96d1f0420499698a250a506e953bbc3add652b65ce4d705df5"} May 28 18:27:58.529010 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:58.528967 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:27:58.529298 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:58.529171 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 18:27:58.529298 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:58.529262 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls podName:4833b41f-22ed-41d5-84cc-76e7a500508c nodeName:}" failed. No retries permitted until 2026-05-28 18:28:00.529240269 +0000 UTC m=+111.654589341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls") pod "cluster-samples-operator-697587599-w57k6" (UID: "4833b41f-22ed-41d5-84cc-76e7a500508c") : secret "samples-operator-tls" not found May 28 18:27:58.731563 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:27:58.731509 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:27:58.731749 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:58.731707 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 18:27:58.731749 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:58.731724 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd45c4f9-bpbp4: secret "image-registry-tls" not found May 28 18:27:58.731871 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:27:58.731796 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls podName:97b0f838-12de-4a81-b5bf-65d25f7b7fee nodeName:}" failed. No retries permitted until 2026-05-28 18:28:00.731776801 +0000 UTC m=+111.857125878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls") pod "image-registry-6cd45c4f9-bpbp4" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee") : secret "image-registry-tls" not found May 28 18:28:00.549515 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.549417 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:28:00.549885 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:00.549591 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 18:28:00.549885 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:00.549678 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls podName:4833b41f-22ed-41d5-84cc-76e7a500508c nodeName:}" failed. No retries permitted until 2026-05-28 18:28:04.549653914 +0000 UTC m=+115.675002990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls") pod "cluster-samples-operator-697587599-w57k6" (UID: "4833b41f-22ed-41d5-84cc-76e7a500508c") : secret "samples-operator-tls" not found May 28 18:28:00.750908 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.750859 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:00.751098 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:00.751009 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 18:28:00.751098 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:00.751032 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd45c4f9-bpbp4: secret "image-registry-tls" not found May 28 18:28:00.751098 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:00.751090 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls podName:97b0f838-12de-4a81-b5bf-65d25f7b7fee nodeName:}" failed. No retries permitted until 2026-05-28 18:28:04.751073721 +0000 UTC m=+115.876422793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls") pod "image-registry-6cd45c4f9-bpbp4" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee") : secret "image-registry-tls" not found May 28 18:28:00.837632 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.837523 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" event={"ID":"9453197a-0933-4672-9837-578e31dabc7b","Type":"ContainerStarted","Data":"f5e81a63f26b12620bdabe9fd810fd291fa360bb7ee54392debf32d727501a9d"} May 28 18:28:00.838925 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.838897 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" event={"ID":"ebb8d950-335d-414d-9427-400d6819d2ce","Type":"ContainerStarted","Data":"34dd4ea8a991a6ee482ccf39fd3ec4b7796611b15ccff4310aaed2e1c58e5a3f"} May 28 18:28:00.840260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.840232 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" event={"ID":"78dcc4de-c2d6-4392-a8ff-61f410865e78","Type":"ContainerStarted","Data":"f3b1610ccc1c096c096ff0b72b8f947cf93f5307b19dce6ac423505ebb4250af"} May 28 18:28:00.854745 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.854695 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" podStartSLOduration=2.041465947 podStartE2EDuration="4.854679661s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:27:57.456173721 +0000 UTC m=+108.581522796" lastFinishedPulling="2026-05-28 18:28:00.269387436 +0000 UTC m=+111.394736510" observedRunningTime="2026-05-28 18:28:00.853539181 +0000 UTC m=+111.978888275" watchObservedRunningTime="2026-05-28 18:28:00.854679661 +0000 UTC m=+111.980028756" May 28 18:28:00.874396 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.874308 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" podStartSLOduration=1.958347651 podStartE2EDuration="4.874289195s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:27:57.355733549 +0000 UTC m=+108.481082621" lastFinishedPulling="2026-05-28 18:28:00.271675093 +0000 UTC m=+111.397024165" observedRunningTime="2026-05-28 18:28:00.872980307 +0000 UTC m=+111.998329402" watchObservedRunningTime="2026-05-28 18:28:00.874289195 +0000 UTC m=+111.999638290" May 28 18:28:00.888616 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:00.888565 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" podStartSLOduration=1.99883516 podStartE2EDuration="4.888546871s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:27:57.376491259 +0000 UTC m=+108.501840330" lastFinishedPulling="2026-05-28 18:28:00.26620297 +0000 UTC m=+111.391552041" observedRunningTime="2026-05-28 18:28:00.887564148 +0000 UTC m=+112.012913246" watchObservedRunningTime="2026-05-28 18:28:00.888546871 +0000 UTC m=+112.013895966" May 28 18:28:02.432855 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.432819 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84"] May 28 18:28:02.437068 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.437052 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" May 28 18:28:02.439606 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.439583 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 18:28:02.439694 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.439584 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 18:28:02.440743 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.440721 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qlgn6\"" May 28 18:28:02.445710 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.445689 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84"] May 28 18:28:02.572033 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.571990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlkd\" (UniqueName: \"kubernetes.io/projected/642b4c25-a616-4ed4-9515-43ae5f59d167-kube-api-access-jdlkd\") pod \"migrator-b985f5d89-bmk84\" (UID: \"642b4c25-a616-4ed4-9515-43ae5f59d167\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" May 28 18:28:02.672796 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.672759 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlkd\" (UniqueName: \"kubernetes.io/projected/642b4c25-a616-4ed4-9515-43ae5f59d167-kube-api-access-jdlkd\") pod \"migrator-b985f5d89-bmk84\" (UID: \"642b4c25-a616-4ed4-9515-43ae5f59d167\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" May 28 18:28:02.680854 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.680830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlkd\" (UniqueName: \"kubernetes.io/projected/642b4c25-a616-4ed4-9515-43ae5f59d167-kube-api-access-jdlkd\") pod \"migrator-b985f5d89-bmk84\" (UID: \"642b4c25-a616-4ed4-9515-43ae5f59d167\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" May 28 18:28:02.746757 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.746672 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" May 28 18:28:02.868247 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:02.868213 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84"] May 28 18:28:02.871283 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:02.871255 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642b4c25_a616_4ed4_9515_43ae5f59d167.slice/crio-db05301b6ce32be0c30a94a38dafc01730c7dfa931a475701170d4ce06939a34 WatchSource:0}: Error finding container db05301b6ce32be0c30a94a38dafc01730c7dfa931a475701170d4ce06939a34: Status 404 returned error can't find the container with id db05301b6ce32be0c30a94a38dafc01730c7dfa931a475701170d4ce06939a34 May 28 18:28:03.792542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:03.792517 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfpqj_10fa77b5-edb8-44ff-b606-a49a74ca5ece/dns-node-resolver/0.log" May 28 18:28:03.848866 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:03.848831 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" event={"ID":"642b4c25-a616-4ed4-9515-43ae5f59d167","Type":"ContainerStarted","Data":"db05301b6ce32be0c30a94a38dafc01730c7dfa931a475701170d4ce06939a34"} May 28 18:28:04.590947 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.590910 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:28:04.591111 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:04.591057 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 18:28:04.591174 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:04.591122 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls podName:4833b41f-22ed-41d5-84cc-76e7a500508c nodeName:}" failed. No retries permitted until 2026-05-28 18:28:12.59110397 +0000 UTC m=+123.716453040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls") pod "cluster-samples-operator-697587599-w57k6" (UID: "4833b41f-22ed-41d5-84cc-76e7a500508c") : secret "samples-operator-tls" not found May 28 18:28:04.792546 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.792501 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:04.793003 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:04.792652 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 18:28:04.793003 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:04.792686 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd45c4f9-bpbp4: secret "image-registry-tls" not found May 28 18:28:04.793003 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:04.792742 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls podName:97b0f838-12de-4a81-b5bf-65d25f7b7fee nodeName:}" failed. No retries permitted until 2026-05-28 18:28:12.792725657 +0000 UTC m=+123.918074727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls") pod "image-registry-6cd45c4f9-bpbp4" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee") : secret "image-registry-tls" not found May 28 18:28:04.793173 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.793157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8nxk8_f3ba8c98-0c00-437e-a193-4b9632e8933f/node-ca/0.log" May 28 18:28:04.854199 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.854093 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" event={"ID":"642b4c25-a616-4ed4-9515-43ae5f59d167","Type":"ContainerStarted","Data":"0f6638bd94488b839fd85c19b8bfcdae8ad327f1a55d4aa538a205c197286b46"} May 28 18:28:04.854199 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.854133 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" event={"ID":"642b4c25-a616-4ed4-9515-43ae5f59d167","Type":"ContainerStarted","Data":"3ebdde79c0a2b9f05cd2222708c46da0d70484d72884d46dbcf97695dae02ad8"} May 28 18:28:04.876601 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:04.876551 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bmk84" podStartSLOduration=1.6920458219999999 podStartE2EDuration="2.876535931s" podCreationTimestamp="2026-05-28 18:28:02 +0000 UTC" firstStartedPulling="2026-05-28 18:28:02.873209711 +0000 UTC m=+113.998558781" lastFinishedPulling="2026-05-28 18:28:04.057699804 +0000 UTC m=+115.183048890" observedRunningTime="2026-05-28 18:28:04.875397112 +0000 UTC m=+116.000746205" watchObservedRunningTime="2026-05-28 18:28:04.876535931 +0000 UTC m=+116.001885071" May 28 18:28:12.657294 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.657250 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:28:12.659772 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.659749 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4833b41f-22ed-41d5-84cc-76e7a500508c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-w57k6\" (UID: \"4833b41f-22ed-41d5-84cc-76e7a500508c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:28:12.714472 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.714437 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n67gf\"" May 28 18:28:12.722505 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.722483 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" May 28 18:28:12.840537 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.840500 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6"] May 28 18:28:12.859011 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.858977 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:12.862337 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.862313 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"image-registry-6cd45c4f9-bpbp4\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:12.933501 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.933422 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtdtx\"" May 28 18:28:12.940733 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:12.940707 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:13.068703 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.068662 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:28:13.072027 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:13.072003 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b0f838_12de_4a81_b5bf_65d25f7b7fee.slice/crio-d1cd2bf68690d396293580c1c3b74e702c18da0f09666aa283910bbc87514bff WatchSource:0}: Error finding container d1cd2bf68690d396293580c1c3b74e702c18da0f09666aa283910bbc87514bff: Status 404 returned error can't find the container with id d1cd2bf68690d396293580c1c3b74e702c18da0f09666aa283910bbc87514bff May 28 18:28:13.882595 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.882559 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" event={"ID":"97b0f838-12de-4a81-b5bf-65d25f7b7fee","Type":"ContainerStarted","Data":"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2"} May 28 18:28:13.882595 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.882602 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" event={"ID":"97b0f838-12de-4a81-b5bf-65d25f7b7fee","Type":"ContainerStarted","Data":"d1cd2bf68690d396293580c1c3b74e702c18da0f09666aa283910bbc87514bff"} May 28 18:28:13.883078 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.882647 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:13.883564 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.883543 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" event={"ID":"4833b41f-22ed-41d5-84cc-76e7a500508c","Type":"ContainerStarted","Data":"86e18d969af5bf02ea0ebd9a3e2745c03b74bff837bbb4857b5188c2fb4e06a1"} May 28 18:28:13.901260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:13.901205 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" podStartSLOduration=17.901188532 podStartE2EDuration="17.901188532s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:28:13.900687153 +0000 UTC m=+125.026036243" watchObservedRunningTime="2026-05-28 18:28:13.901188532 +0000 UTC m=+125.026537627" May 28 18:28:14.887502 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:14.887462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" event={"ID":"4833b41f-22ed-41d5-84cc-76e7a500508c","Type":"ContainerStarted","Data":"1fc5e7e0623e34d3158f615354503033760f982466b8c26d406ee93c6825bc93"} May 28 18:28:14.887874 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:14.887508 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" event={"ID":"4833b41f-22ed-41d5-84cc-76e7a500508c","Type":"ContainerStarted","Data":"0b43ccde95a532a919ffca2436dd1f61e6a4c24c3daec6a9fc97258df445a73f"} May 28 18:28:14.905655 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:14.905574 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-w57k6" podStartSLOduration=17.384096303 podStartE2EDuration="18.905559255s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:28:12.894314976 +0000 UTC m=+124.019664047" lastFinishedPulling="2026-05-28 18:28:14.415777912 +0000 UTC m=+125.541126999" observedRunningTime="2026-05-28 18:28:14.904523086 +0000 UTC m=+126.029872180" watchObservedRunningTime="2026-05-28 18:28:14.905559255 +0000 UTC m=+126.030908347" May 28 18:28:19.311123 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.311069 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:28:19.313512 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.313491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d44eb9c-d8bc-4686-979b-032afd106b59-metrics-certs\") pod \"network-metrics-daemon-xvgkq\" (UID: \"9d44eb9c-d8bc-4686-979b-032afd106b59\") " pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:28:19.420901 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.420866 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\"" May 28 18:28:19.428133 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.428116 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvgkq" May 28 18:28:19.552738 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.552703 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvgkq"] May 28 18:28:19.555643 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:19.555609 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d44eb9c_d8bc_4686_979b_032afd106b59.slice/crio-3a6933500cb6ef283287226596c2f5d6b4785e2dbe4e91bfb567e415a006bb74 WatchSource:0}: Error finding container 3a6933500cb6ef283287226596c2f5d6b4785e2dbe4e91bfb567e415a006bb74: Status 404 returned error can't find the container with id 3a6933500cb6ef283287226596c2f5d6b4785e2dbe4e91bfb567e415a006bb74 May 28 18:28:19.901396 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:19.901350 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvgkq" event={"ID":"9d44eb9c-d8bc-4686-979b-032afd106b59","Type":"ContainerStarted","Data":"3a6933500cb6ef283287226596c2f5d6b4785e2dbe4e91bfb567e415a006bb74"} May 28 18:28:20.905175 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:20.905120 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvgkq" event={"ID":"9d44eb9c-d8bc-4686-979b-032afd106b59","Type":"ContainerStarted","Data":"0a5cc31464c2171f5cdd15cf20938102baef8f274bc7b43ef1133eb993cffca1"} May 28 18:28:20.905175 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:20.905173 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvgkq" event={"ID":"9d44eb9c-d8bc-4686-979b-032afd106b59","Type":"ContainerStarted","Data":"7e3be702683c4e7a682ea578baaa95050b75b86cd7a2bd9669dc9b34ec017365"} May 28 18:28:20.922723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:20.922658 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xvgkq" podStartSLOduration=131.043778174 podStartE2EDuration="2m11.922641202s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:28:19.557525898 +0000 UTC m=+130.682874971" lastFinishedPulling="2026-05-28 18:28:20.436388928 +0000 UTC m=+131.561737999" observedRunningTime="2026-05-28 18:28:20.921014329 +0000 UTC m=+132.046363423" watchObservedRunningTime="2026-05-28 18:28:20.922641202 +0000 UTC m=+132.047990304" May 28 18:28:25.574241 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.574207 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6nhg4"] May 28 18:28:25.577177 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.577161 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.581624 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.581598 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 18:28:25.581738 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.581603 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 18:28:25.581738 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.581632 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w6q6\"" May 28 18:28:25.596984 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.596957 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nhg4"] May 28 18:28:25.605094 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.605067 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:28:25.758065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.758027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad3db334-4c54-4763-97da-9ebf8f07971a-data-volume\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.758065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.758065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad3db334-4c54-4763-97da-9ebf8f07971a-crio-socket\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.758310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.758089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jtt\" (UniqueName: \"kubernetes.io/projected/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-api-access-57jtt\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.758310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.758108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.758310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.758206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad3db334-4c54-4763-97da-9ebf8f07971a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.859676 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.859676 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859634 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad3db334-4c54-4763-97da-9ebf8f07971a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.859898 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859801 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad3db334-4c54-4763-97da-9ebf8f07971a-data-volume\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.859898 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859835 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad3db334-4c54-4763-97da-9ebf8f07971a-crio-socket\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.859898 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859866 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57jtt\" (UniqueName: \"kubernetes.io/projected/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-api-access-57jtt\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.860043 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.859936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad3db334-4c54-4763-97da-9ebf8f07971a-crio-socket\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.860096 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.860069 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad3db334-4c54-4763-97da-9ebf8f07971a-data-volume\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.860303 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.860283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.862094 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.862076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad3db334-4c54-4763-97da-9ebf8f07971a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.872989 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.872961 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jtt\" (UniqueName: \"kubernetes.io/projected/ad3db334-4c54-4763-97da-9ebf8f07971a-kube-api-access-57jtt\") pod \"insights-runtime-extractor-6nhg4\" (UID: \"ad3db334-4c54-4763-97da-9ebf8f07971a\") " pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:25.885844 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:25.885815 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nhg4" May 28 18:28:26.016711 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:26.016677 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nhg4"] May 28 18:28:26.019970 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:26.019945 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3db334_4c54_4763_97da_9ebf8f07971a.slice/crio-bbc13be38afa93ac0335a91b381efbd73bc921832843c7a67c1f8daf63944cec WatchSource:0}: Error finding container bbc13be38afa93ac0335a91b381efbd73bc921832843c7a67c1f8daf63944cec: Status 404 returned error can't find the container with id bbc13be38afa93ac0335a91b381efbd73bc921832843c7a67c1f8daf63944cec May 28 18:28:26.928269 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:26.928231 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nhg4" event={"ID":"ad3db334-4c54-4763-97da-9ebf8f07971a","Type":"ContainerStarted","Data":"37dd1664257f7924c2e8b4531df5642e040aacf26a9ab0b37b1b9b4cb3265729"} May 28 18:28:26.928269 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:26.928270 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nhg4" event={"ID":"ad3db334-4c54-4763-97da-9ebf8f07971a","Type":"ContainerStarted","Data":"b37383893110469a220b854e8dbc264506a7355dad967c4723c4cdf86183c551"} May 28 18:28:26.928679 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:26.928280 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nhg4" event={"ID":"ad3db334-4c54-4763-97da-9ebf8f07971a","Type":"ContainerStarted","Data":"bbc13be38afa93ac0335a91b381efbd73bc921832843c7a67c1f8daf63944cec"} May 28 18:28:28.935237 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:28.935201 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nhg4" event={"ID":"ad3db334-4c54-4763-97da-9ebf8f07971a","Type":"ContainerStarted","Data":"adc058f78a12ae241bfdf262589c257f2cca211902865d9e31e18e3f918b1aec"} May 28 18:28:28.954276 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:28.954216 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6nhg4" podStartSLOduration=2.009183664 podStartE2EDuration="3.954201072s" podCreationTimestamp="2026-05-28 18:28:25 +0000 UTC" firstStartedPulling="2026-05-28 18:28:26.076644467 +0000 UTC m=+137.201993538" lastFinishedPulling="2026-05-28 18:28:28.021661875 +0000 UTC m=+139.147010946" observedRunningTime="2026-05-28 18:28:28.953239888 +0000 UTC m=+140.078588981" watchObservedRunningTime="2026-05-28 18:28:28.954201072 +0000 UTC m=+140.079550188" May 28 18:28:33.539083 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.539045 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk"] May 28 18:28:33.543423 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.543406 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.547234 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547210 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l9mlr\"" May 28 18:28:33.547362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547241 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 18:28:33.547362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547210 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 18:28:33.547362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547291 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 18:28:33.547362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547313 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 18:28:33.547362 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.547328 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 18:28:33.549470 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.549452 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk"] May 28 18:28:33.617569 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.617538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511da6a0-d94f-486f-96ca-56caad1eb352-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.617743 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.617580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.617743 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.617598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42n27\" (UniqueName: \"kubernetes.io/projected/511da6a0-d94f-486f-96ca-56caad1eb352-kube-api-access-42n27\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.617743 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.617714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.718818 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.718782 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.718983 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.718828 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511da6a0-d94f-486f-96ca-56caad1eb352-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.718983 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.718868 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.718983 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.718889 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42n27\" (UniqueName: \"kubernetes.io/projected/511da6a0-d94f-486f-96ca-56caad1eb352-kube-api-access-42n27\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.719699 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.719604 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511da6a0-d94f-486f-96ca-56caad1eb352-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.721428 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.721398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.721518 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.721459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511da6a0-d94f-486f-96ca-56caad1eb352-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.730598 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.730572 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42n27\" (UniqueName: \"kubernetes.io/projected/511da6a0-d94f-486f-96ca-56caad1eb352-kube-api-access-42n27\") pod \"prometheus-operator-7779bbdd78-g9jtk\" (UID: \"511da6a0-d94f-486f-96ca-56caad1eb352\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.853300 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.853213 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" May 28 18:28:33.977400 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:33.977230 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk"] May 28 18:28:33.979717 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:33.979690 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511da6a0_d94f_486f_96ca_56caad1eb352.slice/crio-11bd6a4e874d8f332a23d119a5f6f4c2957369d18cb3570b166eb0b503b2c998 WatchSource:0}: Error finding container 11bd6a4e874d8f332a23d119a5f6f4c2957369d18cb3570b166eb0b503b2c998: Status 404 returned error can't find the container with id 11bd6a4e874d8f332a23d119a5f6f4c2957369d18cb3570b166eb0b503b2c998 May 28 18:28:34.952529 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:34.952486 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" event={"ID":"511da6a0-d94f-486f-96ca-56caad1eb352","Type":"ContainerStarted","Data":"11bd6a4e874d8f332a23d119a5f6f4c2957369d18cb3570b166eb0b503b2c998"} May 28 18:28:35.610645 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:35.610622 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:35.956577 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:35.956546 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" event={"ID":"511da6a0-d94f-486f-96ca-56caad1eb352","Type":"ContainerStarted","Data":"fad2d63d0a4eb3ddf1d68ae2ee7a0b4e80e8edc7a2df965f702208861dae11cb"} May 28 18:28:35.956577 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:35.956581 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" event={"ID":"511da6a0-d94f-486f-96ca-56caad1eb352","Type":"ContainerStarted","Data":"d1c1ddeb6b888ecad49709a783dfeeb33ff8f73bed4b15dcad9676db93a98319"} May 28 18:28:35.973983 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:35.973931 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-g9jtk" podStartSLOduration=1.434312001 podStartE2EDuration="2.973899814s" podCreationTimestamp="2026-05-28 18:28:33 +0000 UTC" firstStartedPulling="2026-05-28 18:28:33.981576027 +0000 UTC m=+145.106925098" lastFinishedPulling="2026-05-28 18:28:35.521163841 +0000 UTC m=+146.646512911" observedRunningTime="2026-05-28 18:28:35.973323171 +0000 UTC m=+147.098672264" watchObservedRunningTime="2026-05-28 18:28:35.973899814 +0000 UTC m=+147.099248907" May 28 18:28:37.980417 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.980383 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sns9z"] May 28 18:28:37.983425 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.983409 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:37.986651 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.986632 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 18:28:37.986768 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.986675 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfg6h\"" May 28 18:28:37.986876 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.986857 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 18:28:37.987663 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:37.987648 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 18:28:38.051345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-metrics-client-ca\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-tls\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051584 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051584 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051584 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-root\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051584 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfmg\" (UniqueName: \"kubernetes.io/projected/cd3cdf1b-86d8-4065-a469-b33ca406a07d-kube-api-access-zkfmg\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051584 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-textfile\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051804 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-sys\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.051804 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.051678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-wtmp\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152297 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-metrics-client-ca\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152361 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-tls\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152387 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152410 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152433 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-root\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152459 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfmg\" (UniqueName: \"kubernetes.io/projected/cd3cdf1b-86d8-4065-a469-b33ca406a07d-kube-api-access-zkfmg\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152486 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-textfile\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152528 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-sys\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152528 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-root\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152554 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152549 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-wtmp\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152997 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152607 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-sys\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152997 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152849 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-wtmp\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152997 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152930 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-textfile\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.152997 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.152977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-metrics-client-ca\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.153120 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.153048 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-accelerators-collector-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.154983 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.154956 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.155112 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.155052 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd3cdf1b-86d8-4065-a469-b33ca406a07d-node-exporter-tls\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.163839 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.163806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfmg\" (UniqueName: \"kubernetes.io/projected/cd3cdf1b-86d8-4065-a469-b33ca406a07d-kube-api-access-zkfmg\") pod \"node-exporter-sns9z\" (UID: \"cd3cdf1b-86d8-4065-a469-b33ca406a07d\") " pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.292689 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.292599 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sns9z" May 28 18:28:38.300409 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:38.300374 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3cdf1b_86d8_4065_a469_b33ca406a07d.slice/crio-57c14248fdbd685575689560b636ea8d386c5cc1dd17c3edab5af3696ff22002 WatchSource:0}: Error finding container 57c14248fdbd685575689560b636ea8d386c5cc1dd17c3edab5af3696ff22002: Status 404 returned error can't find the container with id 57c14248fdbd685575689560b636ea8d386c5cc1dd17c3edab5af3696ff22002 May 28 18:28:38.965369 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:38.965329 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sns9z" event={"ID":"cd3cdf1b-86d8-4065-a469-b33ca406a07d","Type":"ContainerStarted","Data":"57c14248fdbd685575689560b636ea8d386c5cc1dd17c3edab5af3696ff22002"} May 28 18:28:39.012454 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.012415 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:28:39.017270 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.017245 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.019824 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.019800 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 28 18:28:39.019959 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.019800 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 28 18:28:39.019959 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.019942 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020266 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pst7p\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020288 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020328 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020357 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020288 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020472 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 28 18:28:39.020770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.020591 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 28 18:28:39.030517 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.030413 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:28:39.058742 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058790 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.058942 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.059308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.058984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.059308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.059019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.059308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.059048 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n499\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.059308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.059096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.059308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.059113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.159921 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.159886 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.159921 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.159921 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.159946 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.159978 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.159996 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160019 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160037 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160073 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160099 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:39.160129 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 28 18:28:39.160174 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160133 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160606 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160194 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160606 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:39.160236 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls podName:ead29f40-e996-46cb-9976-59840d280e76 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:39.660213744 +0000 UTC m=+150.785562838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ead29f40-e996-46cb-9976-59840d280e76") : secret "alertmanager-main-tls" not found May 28 18:28:39.160606 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160265 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160606 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160301 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n499\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.160606 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:39.160316 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle podName:ead29f40-e996-46cb-9976-59840d280e76 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:39.660298703 +0000 UTC m=+150.785647795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ead29f40-e996-46cb-9976-59840d280e76") : configmap references non-existent config key: ca-bundle.crt May 28 18:28:39.160882 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.160664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.161418 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.161229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.163082 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.163035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.163337 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.163289 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.163890 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.163846 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.164017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.163967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.164017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.163967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.164017 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.164002 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.164161 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.164126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.164204 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.164160 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.172775 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.172754 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n499\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.665219 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.665176 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.665395 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.665275 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.665445 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:39.665397 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 28 18:28:39.665478 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:39.665471 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls podName:ead29f40-e996-46cb-9976-59840d280e76 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:40.665450215 +0000 UTC m=+151.790799289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ead29f40-e996-46cb-9976-59840d280e76") : secret "alertmanager-main-tls" not found May 28 18:28:39.666049 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.666028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:39.915807 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.915725 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4"] May 28 18:28:39.919237 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.919220 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.922155 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922111 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922160 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922110 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922171 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hjcz6\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922211 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fg66fsvm6dt72\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922160 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 18:28:39.922284 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.922216 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 18:28:39.929326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.929303 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4"] May 28 18:28:39.967672 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.967622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.967848 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.967744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.967848 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.967782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd6qc\" (UniqueName: \"kubernetes.io/projected/76d5bd36-e88f-4457-896e-1bc0247e6c03-kube-api-access-gd6qc\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.967978 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.967870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-grpc-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.968034 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.967981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d5bd36-e88f-4457-896e-1bc0247e6c03-metrics-client-ca\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.968240 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.968035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.968313 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.968271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.971311 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.968365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:39.973838 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.973811 2568 generic.go:358] "Generic (PLEG): container finished" podID="cd3cdf1b-86d8-4065-a469-b33ca406a07d" containerID="4e245003b1157296e5d3588d321216d6779e293b86daf54334efcc30f811a1f1" exitCode=0 May 28 18:28:39.973944 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:39.973875 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sns9z" event={"ID":"cd3cdf1b-86d8-4065-a469-b33ca406a07d","Type":"ContainerDied","Data":"4e245003b1157296e5d3588d321216d6779e293b86daf54334efcc30f811a1f1"} May 28 18:28:40.069397 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069368 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.069734 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069405 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd6qc\" (UniqueName: \"kubernetes.io/projected/76d5bd36-e88f-4457-896e-1bc0247e6c03-kube-api-access-gd6qc\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.069734 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069462 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-grpc-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.069734 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069651 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d5bd36-e88f-4457-896e-1bc0247e6c03-metrics-client-ca\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.069883 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069736 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.070018 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.069990 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.070163 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.070090 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.070163 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.070134 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.070488 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.070462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d5bd36-e88f-4457-896e-1bc0247e6c03-metrics-client-ca\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.072226 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.072125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.072725 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.072693 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.072966 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.072941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.073045 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.073028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.073045 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.073040 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-grpc-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.073123 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.073108 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76d5bd36-e88f-4457-896e-1bc0247e6c03-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.077084 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.077065 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd6qc\" (UniqueName: \"kubernetes.io/projected/76d5bd36-e88f-4457-896e-1bc0247e6c03-kube-api-access-gd6qc\") pod \"thanos-querier-7f5d4d8f85-vbqp4\" (UID: \"76d5bd36-e88f-4457-896e-1bc0247e6c03\") " pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.228820 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.228718 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:40.364495 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.364473 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4"] May 28 18:28:40.366973 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:40.366948 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d5bd36_e88f_4457_896e_1bc0247e6c03.slice/crio-abdce89d5879827843884a6e56b1bde16cbb544734feb13ea23299974e1d9f41 WatchSource:0}: Error finding container abdce89d5879827843884a6e56b1bde16cbb544734feb13ea23299974e1d9f41: Status 404 returned error can't find the container with id abdce89d5879827843884a6e56b1bde16cbb544734feb13ea23299974e1d9f41 May 28 18:28:40.675474 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.675433 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:40.678061 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.678041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:40.833068 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.833019 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:28:40.979593 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.979512 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:28:40.982453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.982421 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"abdce89d5879827843884a6e56b1bde16cbb544734feb13ea23299974e1d9f41"} May 28 18:28:40.983469 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:40.983438 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead29f40_e996_46cb_9976_59840d280e76.slice/crio-197422c4bb744530a0df5e6dff3596e024bc369325215139a09e475b182f9294 WatchSource:0}: Error finding container 197422c4bb744530a0df5e6dff3596e024bc369325215139a09e475b182f9294: Status 404 returned error can't find the container with id 197422c4bb744530a0df5e6dff3596e024bc369325215139a09e475b182f9294 May 28 18:28:40.984814 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.984785 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sns9z" event={"ID":"cd3cdf1b-86d8-4065-a469-b33ca406a07d","Type":"ContainerStarted","Data":"1109b1aba8b29bc76c8f3c1381809e5ce98cea552b7af73b1008ee495f2ca358"} May 28 18:28:40.984910 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:40.984825 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sns9z" event={"ID":"cd3cdf1b-86d8-4065-a469-b33ca406a07d","Type":"ContainerStarted","Data":"560db9c66b0ebe400d3d1fa6a6a13f393ea43f9b81bb311cefeaecc891acdb0b"} May 28 18:28:41.005694 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:41.005637 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sns9z" podStartSLOduration=3.10310044 podStartE2EDuration="4.005621301s" podCreationTimestamp="2026-05-28 18:28:37 +0000 UTC" firstStartedPulling="2026-05-28 18:28:38.302196649 +0000 UTC m=+149.427545720" lastFinishedPulling="2026-05-28 18:28:39.204717501 +0000 UTC m=+150.330066581" observedRunningTime="2026-05-28 18:28:41.004299047 +0000 UTC m=+152.129648142" watchObservedRunningTime="2026-05-28 18:28:41.005621301 +0000 UTC m=+152.130970395" May 28 18:28:41.989160 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:41.989107 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"197422c4bb744530a0df5e6dff3596e024bc369325215139a09e475b182f9294"} May 28 18:28:42.692040 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.692010 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc"] May 28 18:28:42.696608 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.696586 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:42.699245 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.699221 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-zqvck\"" May 28 18:28:42.699359 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.699227 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 18:28:42.703391 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.703362 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc"] May 28 18:28:42.794599 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.794567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/284a2d8d-e479-4e94-8bf5-4a8844432310-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zxdxc\" (UID: \"284a2d8d-e479-4e94-8bf5-4a8844432310\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:42.895687 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.895652 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/284a2d8d-e479-4e94-8bf5-4a8844432310-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zxdxc\" (UID: \"284a2d8d-e479-4e94-8bf5-4a8844432310\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:42.898177 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.898133 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/284a2d8d-e479-4e94-8bf5-4a8844432310-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zxdxc\" (UID: \"284a2d8d-e479-4e94-8bf5-4a8844432310\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:42.993463 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.993370 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da" exitCode=0 May 28 18:28:42.993463 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.993450 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da"} May 28 18:28:42.995444 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.995419 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"8246232d92513501a6783b747d191fa3119b5e43766f691c94e0b86028280164"} May 28 18:28:42.995520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.995457 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"01b5277f4e646a13a65c4c8a1656c403f7d17b5ce181e5193e7c5d3242547664"} May 28 18:28:42.995520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:42.995474 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"b2315cbf5e3e918bfd2a4601464c6e3022c8777f1f7d8401f0c6087bd110a8b3"} May 28 18:28:43.018914 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:43.018877 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:43.145546 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:43.145519 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc"] May 28 18:28:43.147989 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:43.147959 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284a2d8d_e479_4e94_8bf5_4a8844432310.slice/crio-d5983f23e8b70663e40803a0e53836a1b1a86f7a56f5a9538483a61b9b5d3aca WatchSource:0}: Error finding container d5983f23e8b70663e40803a0e53836a1b1a86f7a56f5a9538483a61b9b5d3aca: Status 404 returned error can't find the container with id d5983f23e8b70663e40803a0e53836a1b1a86f7a56f5a9538483a61b9b5d3aca May 28 18:28:43.999546 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:43.999507 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" event={"ID":"284a2d8d-e479-4e94-8bf5-4a8844432310","Type":"ContainerStarted","Data":"d5983f23e8b70663e40803a0e53836a1b1a86f7a56f5a9538483a61b9b5d3aca"} May 28 18:28:44.003700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.003618 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"e145b86a5807dc3d2af19c76e72750ea2955ee5c30cb998c4bcff826c859f128"} May 28 18:28:44.003700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.003664 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"f197647c1132fb763e67e1113b75be8ed231cbf5c3f6a0c6f905f873f96cd4ee"} May 28 18:28:44.003700 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.003678 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" event={"ID":"76d5bd36-e88f-4457-896e-1bc0247e6c03","Type":"ContainerStarted","Data":"33dc1d8713a2b3da80858008bbf0f7e8959045c6bd6ab8c3bda3620bd1e8b00e"} May 28 18:28:44.004070 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.004003 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:44.031178 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.031098 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" podStartSLOduration=1.896485852 podStartE2EDuration="5.031078447s" podCreationTimestamp="2026-05-28 18:28:39 +0000 UTC" firstStartedPulling="2026-05-28 18:28:40.369183821 +0000 UTC m=+151.494532899" lastFinishedPulling="2026-05-28 18:28:43.503776419 +0000 UTC m=+154.629125494" observedRunningTime="2026-05-28 18:28:44.027808754 +0000 UTC m=+155.153157847" watchObservedRunningTime="2026-05-28 18:28:44.031078447 +0000 UTC m=+155.156427542" May 28 18:28:44.167614 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.166848 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:28:44.174043 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.174011 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.177393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177248 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 18:28:44.177393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177359 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 18:28:44.177393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177369 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 18:28:44.177653 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177248 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 18:28:44.177717 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177620 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 18:28:44.177717 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177640 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 18:28:44.177813 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177795 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 18:28:44.177868 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.177811 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178037 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178103 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178119 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178156 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zjpgv\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178174 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 18:28:44.178232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.178174 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ig1kj9fe0gc8\"" May 28 18:28:44.180994 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.180972 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 18:28:44.186884 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.186856 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:28:44.208995 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.208960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209201 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209201 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209201 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209201 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209406 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209565 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209823 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209823 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482km\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.209823 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.209740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310430 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310328 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310430 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310430 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310416 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310445 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310473 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310498 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310524 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310570 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310591 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310623 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310638 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310656 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-482km\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.310691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310675 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311180 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310700 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311180 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310716 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311180 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310744 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311180 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310773 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311180 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.310802 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.311413 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.311366 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.312187 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.312095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.314312 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.313452 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.314312 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.313982 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.315810 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.315782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.316044 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.316020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.316435 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.316410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.316530 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.316498 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.317828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.317437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.317828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.317652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.317828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.317783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.318011 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.317809 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.318068 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.318043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.318118 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.317647 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.319590 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.319567 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.320415 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.320379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-482km\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.320517 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.320443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.321908 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.321889 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.489279 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.489239 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:44.920437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:44.919987 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:28:44.922354 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:44.922320 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37389c35_0346_49a6_afaf_b19092b219e7.slice/crio-14dfcaa3bdb3ce008f9f44df35f792f1963a671363cf3a649b4f534f4a1c0109 WatchSource:0}: Error finding container 14dfcaa3bdb3ce008f9f44df35f792f1963a671363cf3a649b4f534f4a1c0109: Status 404 returned error can't find the container with id 14dfcaa3bdb3ce008f9f44df35f792f1963a671363cf3a649b4f534f4a1c0109 May 28 18:28:45.009733 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.009700 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e"} May 28 18:28:45.010132 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.009741 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235"} May 28 18:28:45.010132 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.009750 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736"} May 28 18:28:45.011114 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.011071 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} May 28 18:28:45.011114 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.011106 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"14dfcaa3bdb3ce008f9f44df35f792f1963a671363cf3a649b4f534f4a1c0109"} May 28 18:28:45.012404 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.012374 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" event={"ID":"284a2d8d-e479-4e94-8bf5-4a8844432310","Type":"ContainerStarted","Data":"24549daf2dc04c7fe62fa793d5fae24d7655a1fc13148607c1aaa3fcaebbe87e"} May 28 18:28:45.012764 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.012731 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:45.018207 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.018184 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" May 28 18:28:45.051475 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:45.051414 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zxdxc" podStartSLOduration=1.382057364 podStartE2EDuration="3.051398184s" podCreationTimestamp="2026-05-28 18:28:42 +0000 UTC" firstStartedPulling="2026-05-28 18:28:43.149783474 +0000 UTC m=+154.275132545" lastFinishedPulling="2026-05-28 18:28:44.819124291 +0000 UTC m=+155.944473365" observedRunningTime="2026-05-28 18:28:45.051188938 +0000 UTC m=+156.176538029" watchObservedRunningTime="2026-05-28 18:28:45.051398184 +0000 UTC m=+156.176747277" May 28 18:28:46.018476 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.018443 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51"} May 28 18:28:46.019006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.018486 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2"} May 28 18:28:46.019006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.018504 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerStarted","Data":"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557"} May 28 18:28:46.019834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.019809 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" exitCode=0 May 28 18:28:46.019908 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.019889 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} May 28 18:28:46.048345 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:46.048298 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.628458952 podStartE2EDuration="8.048279203s" podCreationTimestamp="2026-05-28 18:28:38 +0000 UTC" firstStartedPulling="2026-05-28 18:28:40.985746158 +0000 UTC m=+152.111095228" lastFinishedPulling="2026-05-28 18:28:44.405566407 +0000 UTC m=+155.530915479" observedRunningTime="2026-05-28 18:28:46.046650795 +0000 UTC m=+157.171999888" watchObservedRunningTime="2026-05-28 18:28:46.048279203 +0000 UTC m=+157.173628295" May 28 18:28:46.732905 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:46.732861 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbfsd" podUID="56cfd886-6c34-493c-90c8-0b386beeca41" May 28 18:28:46.747152 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:46.747098 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-n64wh" podUID="4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8" May 28 18:28:47.024849 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:47.024759 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbfsd" May 28 18:28:49.033511 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033479 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} May 28 18:28:49.033511 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033512 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} May 28 18:28:49.033902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033529 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} May 28 18:28:49.033902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033543 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} May 28 18:28:49.033902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033553 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} May 28 18:28:49.033902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.033562 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerStarted","Data":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} May 28 18:28:49.072619 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.072492 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.535870656 podStartE2EDuration="5.07247567s" podCreationTimestamp="2026-05-28 18:28:44 +0000 UTC" firstStartedPulling="2026-05-28 18:28:46.021094203 +0000 UTC m=+157.146443273" lastFinishedPulling="2026-05-28 18:28:48.557699209 +0000 UTC m=+159.683048287" observedRunningTime="2026-05-28 18:28:49.069621329 +0000 UTC m=+160.194970419" watchObservedRunningTime="2026-05-28 18:28:49.07247567 +0000 UTC m=+160.197824762" May 28 18:28:49.489979 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:49.489946 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:28:50.018560 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.018524 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f5d4d8f85-vbqp4" May 28 18:28:50.625406 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.625329 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" podUID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" containerName="registry" containerID="cri-o://ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2" gracePeriod=30 May 28 18:28:50.860070 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.860044 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:50.979519 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979402 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979519 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979482 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979768 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979637 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wvn9\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979768 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979690 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979865 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979780 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979865 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979843 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979968 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979873 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979968 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979916 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration\") pod \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\" (UID: \"97b0f838-12de-4a81-b5bf-65d25f7b7fee\") " May 28 18:28:50.979968 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.979896 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:28:50.980418 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.980288 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-trusted-ca\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:50.980418 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.980224 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:28:50.982273 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.982228 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9" (OuterVolumeSpecName: "kube-api-access-8wvn9") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "kube-api-access-8wvn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:28:50.982548 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.982525 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:28:50.982648 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.982627 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:28:50.982706 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.982662 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:28:50.982824 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.982807 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:28:50.989695 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:50.989670 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "97b0f838-12de-4a81-b5bf-65d25f7b7fee" (UID: "97b0f838-12de-4a81-b5bf-65d25f7b7fee"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:28:51.039730 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.039691 2568 generic.go:358] "Generic (PLEG): container finished" podID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" containerID="ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2" exitCode=0 May 28 18:28:51.039934 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.039762 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" May 28 18:28:51.039934 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.039790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" event={"ID":"97b0f838-12de-4a81-b5bf-65d25f7b7fee","Type":"ContainerDied","Data":"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2"} May 28 18:28:51.039934 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.039839 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd45c4f9-bpbp4" event={"ID":"97b0f838-12de-4a81-b5bf-65d25f7b7fee","Type":"ContainerDied","Data":"d1cd2bf68690d396293580c1c3b74e702c18da0f09666aa283910bbc87514bff"} May 28 18:28:51.039934 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.039859 2568 scope.go:117] "RemoveContainer" containerID="ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2" May 28 18:28:51.049386 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.049349 2568 scope.go:117] "RemoveContainer" containerID="ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2" May 28 18:28:51.050717 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:28:51.050692 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2\": container with ID starting with ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2 not found: ID does not exist" containerID="ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2" May 28 18:28:51.050812 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.050725 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2"} err="failed to get container status \"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2\": rpc error: code = NotFound desc = could not find container \"ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2\": container with ID starting with ae908d1f471cc107fb1ae406eaf9366d3fcd8f42c3d1b049a46abed324fe41f2 not found: ID does not exist" May 28 18:28:51.061298 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.061266 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:28:51.065536 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.065498 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cd45c4f9-bpbp4"] May 28 18:28:51.081766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081729 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wvn9\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-kube-api-access-8wvn9\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081766 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081767 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97b0f838-12de-4a81-b5bf-65d25f7b7fee-ca-trust-extracted\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081784 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-certificates\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081799 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-registry-tls\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081831 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-installation-pull-secrets\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081847 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97b0f838-12de-4a81-b5bf-65d25f7b7fee-image-registry-private-configuration\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.081958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.081865 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97b0f838-12de-4a81-b5bf-65d25f7b7fee-bound-sa-token\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:28:51.509678 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.509641 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" path="/var/lib/kubelet/pods/97b0f838-12de-4a81-b5bf-65d25f7b7fee/volumes" May 28 18:28:51.586439 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.586406 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:28:51.586601 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.586454 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:28:51.588990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.588966 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56cfd886-6c34-493c-90c8-0b386beeca41-metrics-tls\") pod \"dns-default-gbfsd\" (UID: \"56cfd886-6c34-493c-90c8-0b386beeca41\") " pod="openshift-dns/dns-default-gbfsd" May 28 18:28:51.589084 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.588989 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8-cert\") pod \"ingress-canary-n64wh\" (UID: \"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8\") " pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:28:51.827998 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.827919 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\"" May 28 18:28:51.836128 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.836109 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbfsd" May 28 18:28:51.964183 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:51.964133 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbfsd"] May 28 18:28:51.966275 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:51.966251 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cfd886_6c34_493c_90c8_0b386beeca41.slice/crio-4dfbf09262ea427a28f1cbf990d6ad69ef1f9e5bdd9e6afa872fb53c662f39d3 WatchSource:0}: Error finding container 4dfbf09262ea427a28f1cbf990d6ad69ef1f9e5bdd9e6afa872fb53c662f39d3: Status 404 returned error can't find the container with id 4dfbf09262ea427a28f1cbf990d6ad69ef1f9e5bdd9e6afa872fb53c662f39d3 May 28 18:28:52.045422 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:52.045389 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbfsd" event={"ID":"56cfd886-6c34-493c-90c8-0b386beeca41","Type":"ContainerStarted","Data":"4dfbf09262ea427a28f1cbf990d6ad69ef1f9e5bdd9e6afa872fb53c662f39d3"} May 28 18:28:54.052981 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:54.052945 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbfsd" event={"ID":"56cfd886-6c34-493c-90c8-0b386beeca41","Type":"ContainerStarted","Data":"81da03145892f627e82e9ddb736051bfc342fe4dac99449f20e22644b0a0f65e"} May 28 18:28:54.052981 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:54.052981 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbfsd" event={"ID":"56cfd886-6c34-493c-90c8-0b386beeca41","Type":"ContainerStarted","Data":"19b283ff5ff753b70203a8bebbf70ac35f79b9c756f2abdfc21c47f6ec05592d"} May 28 18:28:54.053403 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:54.053063 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbfsd" May 28 18:28:54.070216 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:54.070164 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gbfsd" podStartSLOduration=129.50873643 podStartE2EDuration="2m11.070129972s" podCreationTimestamp="2026-05-28 18:26:43 +0000 UTC" firstStartedPulling="2026-05-28 18:28:51.968232879 +0000 UTC m=+163.093581964" lastFinishedPulling="2026-05-28 18:28:53.529626422 +0000 UTC m=+164.654975506" observedRunningTime="2026-05-28 18:28:54.069136221 +0000 UTC m=+165.194485314" watchObservedRunningTime="2026-05-28 18:28:54.070129972 +0000 UTC m=+165.195479059" May 28 18:28:58.503135 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:58.503049 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:28:58.506413 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:58.506391 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\"" May 28 18:28:58.514126 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:58.514107 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n64wh" May 28 18:28:58.647011 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:58.646979 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n64wh"] May 28 18:28:58.650463 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:28:58.650429 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb02bcb_ad2f_4c42_81e7_9ddf2a5eb1c8.slice/crio-358060ffe76b0a27fa7ce2cf574bf4512fbfa233214b542063a877069b1e0834 WatchSource:0}: Error finding container 358060ffe76b0a27fa7ce2cf574bf4512fbfa233214b542063a877069b1e0834: Status 404 returned error can't find the container with id 358060ffe76b0a27fa7ce2cf574bf4512fbfa233214b542063a877069b1e0834 May 28 18:28:59.071383 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:28:59.071342 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n64wh" event={"ID":"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8","Type":"ContainerStarted","Data":"358060ffe76b0a27fa7ce2cf574bf4512fbfa233214b542063a877069b1e0834"} May 28 18:29:01.078065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:01.078026 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n64wh" event={"ID":"4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8","Type":"ContainerStarted","Data":"7b61e2b72a02f615fdfda14e754eebedc24a83bdcae8f6f9a311c8c8deae1a47"} May 28 18:29:01.093907 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:01.093857 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n64wh" podStartSLOduration=136.403779228 podStartE2EDuration="2m18.093841968s" podCreationTimestamp="2026-05-28 18:26:43 +0000 UTC" firstStartedPulling="2026-05-28 18:28:58.652535893 +0000 UTC m=+169.777884970" lastFinishedPulling="2026-05-28 18:29:00.342598635 +0000 UTC m=+171.467947710" observedRunningTime="2026-05-28 18:29:01.092790516 +0000 UTC m=+172.218139606" watchObservedRunningTime="2026-05-28 18:29:01.093841968 +0000 UTC m=+172.219191060" May 28 18:29:04.058382 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:04.058348 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbfsd" May 28 18:29:17.126598 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:17.126552 2568 generic.go:358] "Generic (PLEG): container finished" podID="ebb8d950-335d-414d-9427-400d6819d2ce" containerID="34dd4ea8a991a6ee482ccf39fd3ec4b7796611b15ccff4310aaed2e1c58e5a3f" exitCode=0 May 28 18:29:17.126598 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:17.126592 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" event={"ID":"ebb8d950-335d-414d-9427-400d6819d2ce","Type":"ContainerDied","Data":"34dd4ea8a991a6ee482ccf39fd3ec4b7796611b15ccff4310aaed2e1c58e5a3f"} May 28 18:29:17.127103 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:17.126886 2568 scope.go:117] "RemoveContainer" containerID="34dd4ea8a991a6ee482ccf39fd3ec4b7796611b15ccff4310aaed2e1c58e5a3f" May 28 18:29:18.131004 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:18.130970 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5w9w" event={"ID":"ebb8d950-335d-414d-9427-400d6819d2ce","Type":"ContainerStarted","Data":"b2b339b7012e7fcd84ee8f110312d3d253f3d044a9624cd6485ad384ab4b7217"} May 28 18:29:22.143373 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.143340 2568 generic.go:358] "Generic (PLEG): container finished" podID="78dcc4de-c2d6-4392-a8ff-61f410865e78" containerID="f3b1610ccc1c096c096ff0b72b8f947cf93f5307b19dce6ac423505ebb4250af" exitCode=0 May 28 18:29:22.143813 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.143422 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" event={"ID":"78dcc4de-c2d6-4392-a8ff-61f410865e78","Type":"ContainerDied","Data":"f3b1610ccc1c096c096ff0b72b8f947cf93f5307b19dce6ac423505ebb4250af"} May 28 18:29:22.143876 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.143826 2568 scope.go:117] "RemoveContainer" containerID="f3b1610ccc1c096c096ff0b72b8f947cf93f5307b19dce6ac423505ebb4250af" May 28 18:29:22.144658 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.144629 2568 generic.go:358] "Generic (PLEG): container finished" podID="9453197a-0933-4672-9837-578e31dabc7b" containerID="f5e81a63f26b12620bdabe9fd810fd291fa360bb7ee54392debf32d727501a9d" exitCode=0 May 28 18:29:22.144753 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.144698 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" event={"ID":"9453197a-0933-4672-9837-578e31dabc7b","Type":"ContainerDied","Data":"f5e81a63f26b12620bdabe9fd810fd291fa360bb7ee54392debf32d727501a9d"} May 28 18:29:22.145014 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:22.144965 2568 scope.go:117] "RemoveContainer" containerID="f5e81a63f26b12620bdabe9fd810fd291fa360bb7ee54392debf32d727501a9d" May 28 18:29:23.148912 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:23.148873 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-s4pvh" event={"ID":"78dcc4de-c2d6-4392-a8ff-61f410865e78","Type":"ContainerStarted","Data":"5e6044316fe0fa938268447bcc0f17068c096e10118569a4b262408588593417"} May 28 18:29:23.150437 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:23.150414 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-w29rc" event={"ID":"9453197a-0933-4672-9837-578e31dabc7b","Type":"ContainerStarted","Data":"04a8a9f2aa86ec4e1c0289a4ba0419420e73755afa954125af2bc5ebb1bcf2d7"} May 28 18:29:44.489767 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:44.489723 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:29:44.509201 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:44.509173 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:29:45.231873 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:45.231846 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:29:58.342471 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.342432 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.342906 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="alertmanager" containerID="cri-o://1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" gracePeriod=120 May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.342938 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy" containerID="cri-o://588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" gracePeriod=120 May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.342939 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-web" containerID="cri-o://85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" gracePeriod=120 May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.343047 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="prom-label-proxy" containerID="cri-o://dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" gracePeriod=120 May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.343058 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-metric" containerID="cri-o://cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" gracePeriod=120 May 28 18:29:58.343233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:58.343038 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="config-reloader" containerID="cri-o://7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" gracePeriod=120 May 28 18:29:59.257731 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257696 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" exitCode=0 May 28 18:29:59.257731 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257721 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" exitCode=0 May 28 18:29:59.257731 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257728 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" exitCode=0 May 28 18:29:59.257731 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257735 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" exitCode=0 May 28 18:29:59.257991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257768 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51"} May 28 18:29:59.257991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257802 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557"} May 28 18:29:59.257991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257812 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235"} May 28 18:29:59.257991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.257821 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736"} May 28 18:29:59.584857 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.584832 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:29:59.590547 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590525 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590569 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590588 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590609 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590633 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590702 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590664 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590702 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590738 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590765 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n499\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590812 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590861 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590898 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.590928 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.590924 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume\") pod \"ead29f40-e996-46cb-9976-59840d280e76\" (UID: \"ead29f40-e996-46cb-9976-59840d280e76\") " May 28 18:29:59.592130 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.591415 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:29:59.592130 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.591879 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:29:59.592382 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.592354 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:29:59.593956 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.593917 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.594340 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.594311 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:29:59.594510 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.594481 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume" (OuterVolumeSpecName: "config-volume") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.595251 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.595217 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499" (OuterVolumeSpecName: "kube-api-access-7n499") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "kube-api-access-7n499". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:29:59.595251 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.595219 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out" (OuterVolumeSpecName: "config-out") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:29:59.595405 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.595255 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.596216 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.596193 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.596319 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.596305 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.599192 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.599033 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.606310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.606281 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config" (OuterVolumeSpecName: "web-config") pod "ead29f40-e996-46cb-9976-59840d280e76" (UID: "ead29f40-e996-46cb-9976-59840d280e76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:59.691770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691725 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-web-config\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691770 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691764 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691798 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-main-db\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691808 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n499\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-kube-api-access-7n499\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691818 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691827 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-main-tls\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691836 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691845 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-config-volume\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691854 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691862 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ead29f40-e996-46cb-9976-59840d280e76-cluster-tls-config\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691870 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ead29f40-e996-46cb-9976-59840d280e76-tls-assets\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691878 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ead29f40-e996-46cb-9976-59840d280e76-config-out\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:29:59.691974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:29:59.691885 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ead29f40-e996-46cb-9976-59840d280e76-metrics-client-ca\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:00.263507 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263469 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" exitCode=0 May 28 18:30:00.263507 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263497 2568 generic.go:358] "Generic (PLEG): container finished" podID="ead29f40-e996-46cb-9976-59840d280e76" containerID="85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" exitCode=0 May 28 18:30:00.263723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263560 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2"} May 28 18:30:00.263723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263592 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e"} May 28 18:30:00.263723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263602 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ead29f40-e996-46cb-9976-59840d280e76","Type":"ContainerDied","Data":"197422c4bb744530a0df5e6dff3596e024bc369325215139a09e475b182f9294"} May 28 18:30:00.263723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263606 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.263723 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.263615 2568 scope.go:117] "RemoveContainer" containerID="dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" May 28 18:30:00.271632 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.271505 2568 scope.go:117] "RemoveContainer" containerID="cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" May 28 18:30:00.279132 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.279114 2568 scope.go:117] "RemoveContainer" containerID="588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" May 28 18:30:00.286268 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.286246 2568 scope.go:117] "RemoveContainer" containerID="85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" May 28 18:30:00.291481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.291435 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:30:00.296067 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.296045 2568 scope.go:117] "RemoveContainer" containerID="7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" May 28 18:30:00.300485 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.300458 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:30:00.304280 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.304260 2568 scope.go:117] "RemoveContainer" containerID="1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" May 28 18:30:00.311322 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.311303 2568 scope.go:117] "RemoveContainer" containerID="5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da" May 28 18:30:00.318173 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318152 2568 scope.go:117] "RemoveContainer" containerID="dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" May 28 18:30:00.318438 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.318418 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51\": container with ID starting with dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51 not found: ID does not exist" containerID="dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" May 28 18:30:00.318542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318448 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51"} err="failed to get container status \"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51\": rpc error: code = NotFound desc = could not find container \"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51\": container with ID starting with dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51 not found: ID does not exist" May 28 18:30:00.318542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318474 2568 scope.go:117] "RemoveContainer" containerID="cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" May 28 18:30:00.318709 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.318692 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2\": container with ID starting with cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2 not found: ID does not exist" containerID="cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" May 28 18:30:00.318751 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318719 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2"} err="failed to get container status \"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2\": rpc error: code = NotFound desc = could not find container \"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2\": container with ID starting with cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2 not found: ID does not exist" May 28 18:30:00.318751 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318738 2568 scope.go:117] "RemoveContainer" containerID="588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" May 28 18:30:00.318950 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.318931 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557\": container with ID starting with 588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557 not found: ID does not exist" containerID="588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" May 28 18:30:00.319013 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318961 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557"} err="failed to get container status \"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557\": rpc error: code = NotFound desc = could not find container \"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557\": container with ID starting with 588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557 not found: ID does not exist" May 28 18:30:00.319013 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.318985 2568 scope.go:117] "RemoveContainer" containerID="85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" May 28 18:30:00.319284 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.319267 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e\": container with ID starting with 85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e not found: ID does not exist" containerID="85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" May 28 18:30:00.319332 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319288 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e"} err="failed to get container status \"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e\": rpc error: code = NotFound desc = could not find container \"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e\": container with ID starting with 85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e not found: ID does not exist" May 28 18:30:00.319332 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319302 2568 scope.go:117] "RemoveContainer" containerID="7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" May 28 18:30:00.319518 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.319498 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235\": container with ID starting with 7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235 not found: ID does not exist" containerID="7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" May 28 18:30:00.319602 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319520 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235"} err="failed to get container status \"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235\": rpc error: code = NotFound desc = could not find container \"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235\": container with ID starting with 7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235 not found: ID does not exist" May 28 18:30:00.319602 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319531 2568 scope.go:117] "RemoveContainer" containerID="1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" May 28 18:30:00.319750 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.319735 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736\": container with ID starting with 1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736 not found: ID does not exist" containerID="1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" May 28 18:30:00.319792 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319755 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736"} err="failed to get container status \"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736\": rpc error: code = NotFound desc = could not find container \"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736\": container with ID starting with 1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736 not found: ID does not exist" May 28 18:30:00.319792 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319768 2568 scope.go:117] "RemoveContainer" containerID="5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da" May 28 18:30:00.319955 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:00.319942 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da\": container with ID starting with 5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da not found: ID does not exist" containerID="5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da" May 28 18:30:00.319991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319956 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da"} err="failed to get container status \"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da\": rpc error: code = NotFound desc = could not find container \"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da\": container with ID starting with 5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da not found: ID does not exist" May 28 18:30:00.319991 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.319974 2568 scope.go:117] "RemoveContainer" containerID="dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51" May 28 18:30:00.320167 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320128 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51"} err="failed to get container status \"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51\": rpc error: code = NotFound desc = could not find container \"dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51\": container with ID starting with dc8d755c26db9ff182971b410db57e65750054a0d00fe04208dda8d7c53b7a51 not found: ID does not exist" May 28 18:30:00.320221 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320168 2568 scope.go:117] "RemoveContainer" containerID="cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2" May 28 18:30:00.320393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320374 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2"} err="failed to get container status \"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2\": rpc error: code = NotFound desc = could not find container \"cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2\": container with ID starting with cd753ee102cc1e3219d4b768f547d0c217a15f36c2f052bbf00116885918e1b2 not found: ID does not exist" May 28 18:30:00.320455 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320396 2568 scope.go:117] "RemoveContainer" containerID="588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557" May 28 18:30:00.320610 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320596 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557"} err="failed to get container status \"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557\": rpc error: code = NotFound desc = could not find container \"588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557\": container with ID starting with 588fa626dca40e091cd974f7476118bc0f4ae80de531f9c16bb2a60b45391557 not found: ID does not exist" May 28 18:30:00.320658 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320609 2568 scope.go:117] "RemoveContainer" containerID="85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e" May 28 18:30:00.320815 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320797 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e"} err="failed to get container status \"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e\": rpc error: code = NotFound desc = could not find container \"85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e\": container with ID starting with 85d6447d95f47cd7d7c7798a61d611667303df0e085e1a762d981c5f8d6a8b4e not found: ID does not exist" May 28 18:30:00.320866 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.320816 2568 scope.go:117] "RemoveContainer" containerID="7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235" May 28 18:30:00.321031 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.321017 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235"} err="failed to get container status \"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235\": rpc error: code = NotFound desc = could not find container \"7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235\": container with ID starting with 7ebbba14ffc6a492eadf41dca5b249c4fa8b65690dae83727cc49650076d8235 not found: ID does not exist" May 28 18:30:00.321089 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.321032 2568 scope.go:117] "RemoveContainer" containerID="1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736" May 28 18:30:00.321255 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.321236 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736"} err="failed to get container status \"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736\": rpc error: code = NotFound desc = could not find container \"1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736\": container with ID starting with 1fc71e3f6c2357439a00448b4c36e99ed0fa0edcd48719546d35b7e63401c736 not found: ID does not exist" May 28 18:30:00.321328 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.321257 2568 scope.go:117] "RemoveContainer" containerID="5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da" May 28 18:30:00.321473 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.321453 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da"} err="failed to get container status \"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da\": rpc error: code = NotFound desc = could not find container \"5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da\": container with ID starting with 5c45f7eebadac9a0f757a1c09cb30c70bb6df80ef8157836981071d18ee316da not found: ID does not exist" May 28 18:30:00.336474 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336437 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:30:00.336749 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336737 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" containerName="registry" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336758 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" containerName="registry" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336770 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="config-reloader" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336776 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="config-reloader" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336786 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="alertmanager" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336792 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="alertmanager" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336798 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-web" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336803 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-web" May 28 18:30:00.336808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336809 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336814 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336822 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="prom-label-proxy" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336827 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="prom-label-proxy" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336836 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="init-config-reloader" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336841 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="init-config-reloader" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336847 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-metric" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336852 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-metric" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336902 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="97b0f838-12de-4a81-b5bf-65d25f7b7fee" containerName="registry" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336910 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="prom-label-proxy" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336916 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="config-reloader" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336926 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-metric" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336935 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy-web" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336940 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="alertmanager" May 28 18:30:00.337050 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.336946 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead29f40-e996-46cb-9976-59840d280e76" containerName="kube-rbac-proxy" May 28 18:30:00.340413 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.340395 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.347359 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347338 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pst7p\"" May 28 18:30:00.347490 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347358 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 28 18:30:00.347490 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347357 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 28 18:30:00.347490 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347423 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 28 18:30:00.347646 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347619 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 28 18:30:00.347745 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347727 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 28 18:30:00.347834 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347812 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 28 18:30:00.347909 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347830 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 28 18:30:00.347909 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.347857 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 28 18:30:00.353886 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.353866 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 28 18:30:00.361389 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.361365 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:30:00.397378 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397337 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397548 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98z9f\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-kube-api-access-98z9f\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397548 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397624 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397624 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397624 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397624 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-out\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397744 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397744 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397744 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-web-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397744 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397871 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.397871 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.397794 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499039 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499000 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98z9f\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-kube-api-access-98z9f\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499039 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499044 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499075 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499099 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499125 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499209 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-out\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499249 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499276 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499415 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-web-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499453 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499489 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499509 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499537 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499819 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.499931 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.499907 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.500600 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.500579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.502908 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.502953 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-out\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-web-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503119 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503314 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503368 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503330 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.503727 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.503449 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.504478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.504457 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.507769 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.507747 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98z9f\" (UniqueName: \"kubernetes.io/projected/49e086ef-02a6-4802-bc8d-fc099fdd7ab0-kube-api-access-98z9f\") pod \"alertmanager-main-0\" (UID: \"49e086ef-02a6-4802-bc8d-fc099fdd7ab0\") " pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.650622 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.650581 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 18:30:00.796762 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:00.796732 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 18:30:00.799284 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:30:00.799252 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e086ef_02a6_4802_bc8d_fc099fdd7ab0.slice/crio-68f264c488db02150593cc543bc5ba86a6c1f2173946e2d608e24d88f44351ca WatchSource:0}: Error finding container 68f264c488db02150593cc543bc5ba86a6c1f2173946e2d608e24d88f44351ca: Status 404 returned error can't find the container with id 68f264c488db02150593cc543bc5ba86a6c1f2173946e2d608e24d88f44351ca May 28 18:30:01.269740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:01.269703 2568 generic.go:358] "Generic (PLEG): container finished" podID="49e086ef-02a6-4802-bc8d-fc099fdd7ab0" containerID="2611c183675467cefedd3a15c225410259777426ea98956d4724a41aa236be6c" exitCode=0 May 28 18:30:01.269900 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:01.269771 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerDied","Data":"2611c183675467cefedd3a15c225410259777426ea98956d4724a41aa236be6c"} May 28 18:30:01.269900 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:01.269799 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"68f264c488db02150593cc543bc5ba86a6c1f2173946e2d608e24d88f44351ca"} May 28 18:30:01.508079 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:01.508047 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead29f40-e996-46cb-9976-59840d280e76" path="/var/lib/kubelet/pods/ead29f40-e996-46cb-9976-59840d280e76/volumes" May 28 18:30:02.276156 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276094 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"007e88d5bb8567ee4b7ab15311564cbea05289359a2823e53c2403d99bc9420b"} May 28 18:30:02.276156 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276163 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"a2ab549bc5c6675cbee394f376b67473fd0de0728fe536160b8425ed98015f87"} May 28 18:30:02.276580 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276179 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"92ded1e950fe6881dd606cf0cc434af3fa485ca8a3a12eb03eb563ca56171078"} May 28 18:30:02.276580 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276190 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"2f295bb177905c13fae07d416e6c0c0d6dddfcd2b4c1a99a0545347d57025242"} May 28 18:30:02.276580 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276200 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"131631f560c209b83b28b99d3f09eb3d1b6d9394f22f810bc9975377d565af5b"} May 28 18:30:02.276580 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.276211 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e086ef-02a6-4802-bc8d-fc099fdd7ab0","Type":"ContainerStarted","Data":"b5182d8ade7c23604bad234d16df10620778bc18cfa08b27c301b371a9192826"} May 28 18:30:02.311714 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.311635 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.311615822 podStartE2EDuration="2.311615822s" podCreationTimestamp="2026-05-28 18:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:30:02.308490713 +0000 UTC m=+233.433839806" watchObservedRunningTime="2026-05-28 18:30:02.311615822 +0000 UTC m=+233.436964917" May 28 18:30:02.406001 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.405960 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b45995c6-5lrsh"] May 28 18:30:02.408402 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.408378 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.412975 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.412999 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.413019 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d25ll\"" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.413019 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.413162 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 28 18:30:02.413260 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.413213 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 28 18:30:02.414232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-federate-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414232 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-metrics-client-ca\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414492 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-serving-certs-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414492 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414492 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mcj4\" (UniqueName: \"kubernetes.io/projected/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-kube-api-access-5mcj4\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414492 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.414492 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.414475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.418604 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.418580 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 28 18:30:02.425105 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.425078 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b45995c6-5lrsh"] May 28 18:30:02.515185 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515117 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515376 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515212 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515376 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515310 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515376 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515343 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-federate-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515391 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-metrics-client-ca\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515453 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-serving-certs-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515487 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.515520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.515515 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mcj4\" (UniqueName: \"kubernetes.io/projected/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-kube-api-access-5mcj4\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.516117 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.516079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-metrics-client-ca\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.516365 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.516340 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-serving-certs-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.516417 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.516385 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.517985 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.517960 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-federate-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.518074 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.518019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.518524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.518500 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-secret-telemeter-client\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.518715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.518699 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-telemeter-client-tls\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.524112 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.524086 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mcj4\" (UniqueName: \"kubernetes.io/projected/130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6-kube-api-access-5mcj4\") pod \"telemeter-client-5b45995c6-5lrsh\" (UID: \"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6\") " pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.694502 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.694217 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.694867 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="prometheus" containerID="cri-o://4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" gracePeriod=600 May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.695246 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" gracePeriod=600 May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.695328 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy" containerID="cri-o://0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" gracePeriod=600 May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.695398 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-web" containerID="cri-o://da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" gracePeriod=600 May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.695454 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="thanos-sidecar" containerID="cri-o://312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" gracePeriod=600 May 28 18:30:02.695788 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.695503 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="config-reloader" containerID="cri-o://b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" gracePeriod=600 May 28 18:30:02.719660 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.719632 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" May 28 18:30:02.890647 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.890619 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b45995c6-5lrsh"] May 28 18:30:02.893059 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:30:02.893015 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130f3967_ccd6_40ac_80e1_9ab3eeb4b2e6.slice/crio-094e43f0a65a12043d75793a83f156b6936ad726f93db19e2236b9b802a78b6f WatchSource:0}: Error finding container 094e43f0a65a12043d75793a83f156b6936ad726f93db19e2236b9b802a78b6f: Status 404 returned error can't find the container with id 094e43f0a65a12043d75793a83f156b6936ad726f93db19e2236b9b802a78b6f May 28 18:30:02.948811 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:02.948736 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.021515 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021483 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021515 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021519 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021545 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021561 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-482km\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021590 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021616 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021647 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021686 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021713 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021756 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021793 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.021828 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021824 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021861 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021890 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021927 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021972 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.021998 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.022042 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file\") pod \"37389c35-0346-49a6-afaf-b19092b219e7\" (UID: \"37389c35-0346-49a6-afaf-b19092b219e7\") " May 28 18:30:03.022791 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.022512 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:03.022851 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.022803 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:03.023862 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.023828 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:03.024494 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.024455 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:03.026705 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.026678 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:30:03.027198 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.027163 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:03.027396 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.027369 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:30:03.028104 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.028078 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km" (OuterVolumeSpecName: "kube-api-access-482km") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "kube-api-access-482km". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:30:03.028216 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.028203 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.028862 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.028825 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.029095 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.029064 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.029471 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.029436 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.030384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.029598 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.030384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.029608 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out" (OuterVolumeSpecName: "config-out") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:30:03.030384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.029665 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config" (OuterVolumeSpecName: "config") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.030384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.030317 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.032068 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.032036 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.040680 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.040648 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config" (OuterVolumeSpecName: "web-config") pod "37389c35-0346-49a6-afaf-b19092b219e7" (UID: "37389c35-0346-49a6-afaf-b19092b219e7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:03.123524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123487 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123520 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-k8s-db\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123524 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123531 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-metrics-client-ca\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123541 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123552 2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123565 2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-metrics-client-certs\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123574 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-tls-assets\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123583 2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-kube-rbac-proxy\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123591 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-482km\" (UniqueName: \"kubernetes.io/projected/37389c35-0346-49a6-afaf-b19092b219e7-kube-api-access-482km\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123600 2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-config\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123608 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123617 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37389c35-0346-49a6-afaf-b19092b219e7-config-out\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123625 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123633 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37389c35-0346-49a6-afaf-b19092b219e7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123643 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123652 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123660 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-web-config\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.123756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.123668 2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37389c35-0346-49a6-afaf-b19092b219e7-secret-grpc-tls\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:30:03.279832 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.279742 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" event={"ID":"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6","Type":"ContainerStarted","Data":"094e43f0a65a12043d75793a83f156b6936ad726f93db19e2236b9b802a78b6f"} May 28 18:30:03.282402 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282375 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282405 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282416 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282424 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282434 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282442 2568 generic.go:358] "Generic (PLEG): container finished" podID="37389c35-0346-49a6-afaf-b19092b219e7" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" exitCode=0 May 28 18:30:03.282478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282460 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282499 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282508 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282523 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282512 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282633 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282642 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282653 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} May 28 18:30:03.282683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.282671 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37389c35-0346-49a6-afaf-b19092b219e7","Type":"ContainerDied","Data":"14dfcaa3bdb3ce008f9f44df35f792f1963a671363cf3a649b4f534f4a1c0109"} May 28 18:30:03.291392 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.291369 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.298856 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.298836 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.306056 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.306036 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.309874 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.309849 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:03.313542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.313515 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.317375 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.317351 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:03.321021 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.321002 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.328678 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.328656 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.335779 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.335759 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.336079 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.336058 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.336159 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336092 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.336159 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336121 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.336422 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.336406 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.336488 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336429 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.336488 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336448 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.336675 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.336657 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.336715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336683 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.336715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336698 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.336928 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.336913 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.336985 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336935 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.336985 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.336956 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.337174 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.337134 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.337285 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337174 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.337285 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337188 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.337421 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.337405 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.337468 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337423 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.337468 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337437 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.337612 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:30:03.337595 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.337691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337614 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.337691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337630 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.337838 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337820 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.337897 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.337840 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.338031 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338014 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.338093 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338032 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.338238 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338222 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.338298 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338239 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.338419 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338404 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.338484 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338420 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.338587 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338570 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.338643 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338588 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.338785 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338760 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.338823 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338787 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.338990 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338973 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.339048 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.338992 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.339248 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339231 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.339308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339249 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.339441 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339421 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.339503 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339442 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.339627 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339612 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.339664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339626 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.339795 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339781 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.339838 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339794 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.339959 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339945 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.340001 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.339961 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.340163 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340127 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.340204 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340165 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.340334 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340320 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.340378 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340333 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.340517 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340499 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.340577 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340518 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.340862 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340842 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.340965 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.340865 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.341116 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341093 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.341116 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341117 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.341465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341436 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.341465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341465 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.341790 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341744 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.341877 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.341793 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.342072 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342041 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.342072 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342072 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.342421 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342402 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.342421 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342420 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.342661 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342643 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.342716 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342662 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.342895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342877 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.342895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342894 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.343016 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.342924 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.343547 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.343591 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.343954 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.343980 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344105 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344125 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344195 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="prometheus" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344206 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="prometheus" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344218 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-thanos" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344227 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-thanos" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344263 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-web" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344272 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-web" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344278 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344301 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344287 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="config-reloader" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344376 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="config-reloader" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344414 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="init-config-reloader" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344423 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="init-config-reloader" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344434 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="thanos-sidecar" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344443 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="thanos-sidecar" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344591 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="thanos-sidecar" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344611 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="config-reloader" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344621 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344639 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-web" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344652 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="kube-rbac-proxy-thanos" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.344667 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="37389c35-0346-49a6-afaf-b19092b219e7" containerName="prometheus" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.347916 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.349124 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.347942 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.350387 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.349199 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.350387 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.349221 2568 scope.go:117] "RemoveContainer" containerID="630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8" May 28 18:30:03.350387 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.349542 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8"} err="failed to get container status \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": rpc error: code = NotFound desc = could not find container \"630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8\": container with ID starting with 630eb20f891447cc6428d126c0ed1ca9dfeee9a1b321d2113170c25d709e27e8 not found: ID does not exist" May 28 18:30:03.350387 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.349566 2568 scope.go:117] "RemoveContainer" containerID="0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276" May 28 18:30:03.350387 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.350336 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.352061 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352033 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276"} err="failed to get container status \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": rpc error: code = NotFound desc = could not find container \"0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276\": container with ID starting with 0823e8732f40c052a0374ab8d240bb2050c1120aad459a139c006ce8864c1276 not found: ID does not exist" May 28 18:30:03.352179 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352062 2568 scope.go:117] "RemoveContainer" containerID="da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763" May 28 18:30:03.352457 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352420 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763"} err="failed to get container status \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": rpc error: code = NotFound desc = could not find container \"da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763\": container with ID starting with da5e14635afcbe8ef03c12165bab1023aab1edb6082dbaed3ce97193fe223763 not found: ID does not exist" May 28 18:30:03.352555 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352459 2568 scope.go:117] "RemoveContainer" containerID="312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325" May 28 18:30:03.352713 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352690 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325"} err="failed to get container status \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": rpc error: code = NotFound desc = could not find container \"312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325\": container with ID starting with 312bacad26cd43a91c09e9af6c1001a8af855b69e3782f61ac4720de90a19325 not found: ID does not exist" May 28 18:30:03.352792 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352714 2568 scope.go:117] "RemoveContainer" containerID="b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5" May 28 18:30:03.352967 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352947 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5"} err="failed to get container status \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": rpc error: code = NotFound desc = could not find container \"b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5\": container with ID starting with b7ec46d79400be08e5380948c4a145e040848eb35d9fef3a5c95c318a15878e5 not found: ID does not exist" May 28 18:30:03.353062 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.352970 2568 scope.go:117] "RemoveContainer" containerID="4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70" May 28 18:30:03.353333 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.353308 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70"} err="failed to get container status \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": rpc error: code = NotFound desc = could not find container \"4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70\": container with ID starting with 4ded8cfcc4b576f02a33c7dbe7af79328988b5b57593a5fc358d61b8f315ed70 not found: ID does not exist" May 28 18:30:03.353432 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.353353 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 18:30:03.353432 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.353346 2568 scope.go:117] "RemoveContainer" containerID="4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f" May 28 18:30:03.353578 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.353430 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 18:30:03.353751 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.353718 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f"} err="failed to get container status \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": rpc error: code = NotFound desc = could not find container \"4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f\": container with ID starting with 4e9d5ea74c784608d342e6af252346474fd17b6c491f0b13f374d1e2d760e25f not found: ID does not exist" May 28 18:30:03.354310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354058 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 18:30:03.354310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354110 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 18:30:03.354310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354117 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zjpgv\"" May 28 18:30:03.354310 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354251 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ig1kj9fe0gc8\"" May 28 18:30:03.354607 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354531 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 18:30:03.354607 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354552 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 18:30:03.354873 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354839 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 18:30:03.354954 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354888 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 18:30:03.354954 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.354888 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 18:30:03.355129 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.355112 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 18:30:03.355579 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.355558 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 18:30:03.357222 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.357205 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 18:30:03.363257 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.363233 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 18:30:03.364003 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.363982 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:03.426808 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.426973 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnrsm\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-kube-api-access-bnrsm\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.426973 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.426973 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.426973 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config-out\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.426973 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427224 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.426999 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-web-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427224 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427224 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427326 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.427481 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.427465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.508340 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.508301 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37389c35-0346-49a6-afaf-b19092b219e7" path="/var/lib/kubelet/pods/37389c35-0346-49a6-afaf-b19092b219e7/volumes" May 28 18:30:03.528577 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528539 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.528758 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528588 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.528758 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528632 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.528758 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528657 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnrsm\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-kube-api-access-bnrsm\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.528758 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528684 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.528758 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.528722 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.529080 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.529233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529076 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config-out\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.529233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529124 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.529434 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529738 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-web-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529788 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529827 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529856 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529885 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529924 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529955 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.529980 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.530020 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.530465 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.530051 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.531724 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.531743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.532226 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533453 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.533031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533730 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.533504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.533730 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.533599 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.534508 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.534462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.534613 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.534592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.534914 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.534892 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config-out\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.535055 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.535035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.535534 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.535511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.535680 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.535652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.536112 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.536071 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.536452 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.536433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.536917 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.536900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-web-config\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.537842 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.537824 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnrsm\" (UniqueName: \"kubernetes.io/projected/b6d0cc11-c92b-4e63-88e6-93aa5edb3039-kube-api-access-bnrsm\") pod \"prometheus-k8s-0\" (UID: \"b6d0cc11-c92b-4e63-88e6-93aa5edb3039\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.663498 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.663459 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:30:03.808966 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:03.808870 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 18:30:03.812663 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:30:03.812630 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d0cc11_c92b_4e63_88e6_93aa5edb3039.slice/crio-923ad59fdd4ee20d7a433a2a17417613060d850c547f6d58027b81bfd8765b8b WatchSource:0}: Error finding container 923ad59fdd4ee20d7a433a2a17417613060d850c547f6d58027b81bfd8765b8b: Status 404 returned error can't find the container with id 923ad59fdd4ee20d7a433a2a17417613060d850c547f6d58027b81bfd8765b8b May 28 18:30:04.288737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:04.288695 2568 generic.go:358] "Generic (PLEG): container finished" podID="b6d0cc11-c92b-4e63-88e6-93aa5edb3039" containerID="e121094dba03d8a089169f938236a8a166e7e1afa17fd2fe400461ec24e536ad" exitCode=0 May 28 18:30:04.288737 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:04.288731 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerDied","Data":"e121094dba03d8a089169f938236a8a166e7e1afa17fd2fe400461ec24e536ad"} May 28 18:30:04.289242 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:04.288773 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"923ad59fdd4ee20d7a433a2a17417613060d850c547f6d58027b81bfd8765b8b"} May 28 18:30:05.294451 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294410 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"4824152cac637cd61b5e9a7672f5f193f7d9feeb7dcc992e4a1ba1768d67724d"} May 28 18:30:05.294902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294455 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"407d7f927c68efea9909c55a502e2078477ac476d105f17fb4782845d751d913"} May 28 18:30:05.294902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294473 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"09fdf4a38477bce0c301429603ac1b077c96ffef0fdf09de08c6588513bbb489"} May 28 18:30:05.294902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294486 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"6e5a27778583967c3e9c69b9fe951a410fd5e33fe80a931c924068943abff731"} May 28 18:30:05.294902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294497 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"e658ff4796374c9924551cb5faaf43b21f9783e80434ac28066083757fe562b7"} May 28 18:30:05.294902 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.294508 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b6d0cc11-c92b-4e63-88e6-93aa5edb3039","Type":"ContainerStarted","Data":"f7f8fedf292a1bb98515e28b0b40ad7c706345a848548d7553397d2ecc528c08"} May 28 18:30:05.296209 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.296186 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" event={"ID":"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6","Type":"ContainerStarted","Data":"9c466439259b4a365c1e94d8e9a10343d24f03944f01a00c579f9d9d34f172b7"} May 28 18:30:05.296314 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.296214 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" event={"ID":"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6","Type":"ContainerStarted","Data":"46dc037702ad9e398f7f0e07a349d94e61eba1acd67cb07bb22b45409edc0cd4"} May 28 18:30:05.296314 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.296231 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" event={"ID":"130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6","Type":"ContainerStarted","Data":"4db541ab0c1da7a00b850e8d22d4fd79d5b89ec7ef1ee8783053276b93b3a14c"} May 28 18:30:05.329240 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.329169 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.329131649 podStartE2EDuration="2.329131649s" podCreationTimestamp="2026-05-28 18:30:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:30:05.327002347 +0000 UTC m=+236.452351440" watchObservedRunningTime="2026-05-28 18:30:05.329131649 +0000 UTC m=+236.454480745" May 28 18:30:05.352218 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:05.352169 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b45995c6-5lrsh" podStartSLOduration=1.344805192 podStartE2EDuration="3.352127961s" podCreationTimestamp="2026-05-28 18:30:02 +0000 UTC" firstStartedPulling="2026-05-28 18:30:02.895712938 +0000 UTC m=+234.021062009" lastFinishedPulling="2026-05-28 18:30:04.9030357 +0000 UTC m=+236.028384778" observedRunningTime="2026-05-28 18:30:05.35097108 +0000 UTC m=+236.476320186" watchObservedRunningTime="2026-05-28 18:30:05.352127961 +0000 UTC m=+236.477477054" May 28 18:30:08.664346 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:30:08.664300 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:31:03.664235 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:03.664190 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:31:03.680739 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:03.680713 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:31:04.483361 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:04.483333 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 18:31:09.393096 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:09.393062 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:31:09.393589 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:09.393176 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:31:09.396064 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:09.396041 2568 kubelet.go:1628] "Image garbage collection succeeded" May 28 18:31:44.081971 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.081936 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7s64q"] May 28 18:31:44.085210 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.085195 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.087776 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.087753 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 18:31:44.090046 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.090022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc358d67-f9f3-4a20-bd51-177756b41ce9-original-pull-secret\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.090204 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.090073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-kubelet-config\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.090204 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.090129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-dbus\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.090419 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.090396 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s64q"] May 28 18:31:44.190596 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.190553 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-dbus\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.190778 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.190632 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc358d67-f9f3-4a20-bd51-177756b41ce9-original-pull-secret\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.190778 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.190660 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-kubelet-config\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.190778 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.190737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-kubelet-config\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.190877 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.190812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc358d67-f9f3-4a20-bd51-177756b41ce9-dbus\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.193106 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.193084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc358d67-f9f3-4a20-bd51-177756b41ce9-original-pull-secret\") pod \"global-pull-secret-syncer-7s64q\" (UID: \"bc358d67-f9f3-4a20-bd51-177756b41ce9\") " pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.395885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.395848 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s64q" May 28 18:31:44.526120 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.526009 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s64q"] May 28 18:31:44.528870 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:31:44.528845 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc358d67_f9f3_4a20_bd51_177756b41ce9.slice/crio-66c79f58688dbd6e5e8ca66cf63cb146b07efd952225ef6579f0b664acd1064c WatchSource:0}: Error finding container 66c79f58688dbd6e5e8ca66cf63cb146b07efd952225ef6579f0b664acd1064c: Status 404 returned error can't find the container with id 66c79f58688dbd6e5e8ca66cf63cb146b07efd952225ef6579f0b664acd1064c May 28 18:31:44.530574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.530561 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:31:44.583715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:44.583669 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s64q" event={"ID":"bc358d67-f9f3-4a20-bd51-177756b41ce9","Type":"ContainerStarted","Data":"66c79f58688dbd6e5e8ca66cf63cb146b07efd952225ef6579f0b664acd1064c"} May 28 18:31:49.601965 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:49.601930 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s64q" event={"ID":"bc358d67-f9f3-4a20-bd51-177756b41ce9","Type":"ContainerStarted","Data":"9b785760760f65b85002dfa1a24258f2bcef550a4762257027faa8880d8971f5"} May 28 18:31:49.618042 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:31:49.617991 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7s64q" podStartSLOduration=1.411185565 podStartE2EDuration="5.617975924s" podCreationTimestamp="2026-05-28 18:31:44 +0000 UTC" firstStartedPulling="2026-05-28 18:31:44.530681476 +0000 UTC m=+335.656030546" lastFinishedPulling="2026-05-28 18:31:48.73747182 +0000 UTC m=+339.862820905" observedRunningTime="2026-05-28 18:31:49.616525339 +0000 UTC m=+340.741874434" watchObservedRunningTime="2026-05-28 18:31:49.617975924 +0000 UTC m=+340.743325017" May 28 18:32:28.998819 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:28.998779 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q5fd8"] May 28 18:32:29.002155 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.002124 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.004968 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.004944 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 18:32:29.006132 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.006112 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 18:32:29.006205 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.006120 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p28p2\"" May 28 18:32:29.013609 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.013586 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q5fd8"] May 28 18:32:29.189900 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.189859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.190096 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.189946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrr6\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-kube-api-access-qzrr6\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.290725 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.290608 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrr6\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-kube-api-access-qzrr6\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.290725 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.290695 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.299545 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.299511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.299680 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.299580 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrr6\" (UniqueName: \"kubernetes.io/projected/337de08b-3d4f-4803-a8ef-e555dda73ccd-kube-api-access-qzrr6\") pod \"cert-manager-webhook-587ccfb98-q5fd8\" (UID: \"337de08b-3d4f-4803-a8ef-e555dda73ccd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.321383 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.321351 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:29.451159 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.451116 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-q5fd8"] May 28 18:32:29.453937 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:32:29.453907 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod337de08b_3d4f_4803_a8ef_e555dda73ccd.slice/crio-78fcb1e29aa288c702a16e45f0ecf5b4a4cc18d70b9619870d268107c9f8a53b WatchSource:0}: Error finding container 78fcb1e29aa288c702a16e45f0ecf5b4a4cc18d70b9619870d268107c9f8a53b: Status 404 returned error can't find the container with id 78fcb1e29aa288c702a16e45f0ecf5b4a4cc18d70b9619870d268107c9f8a53b May 28 18:32:29.727192 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:29.727154 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" event={"ID":"337de08b-3d4f-4803-a8ef-e555dda73ccd","Type":"ContainerStarted","Data":"78fcb1e29aa288c702a16e45f0ecf5b4a4cc18d70b9619870d268107c9f8a53b"} May 28 18:32:32.737670 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:32.737629 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" event={"ID":"337de08b-3d4f-4803-a8ef-e555dda73ccd","Type":"ContainerStarted","Data":"53c1cb191236591f718a507422432ec5059b6dbf256de5ec8edf8ed64b6b54d8"} May 28 18:32:32.738098 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:32.737764 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:32:32.760321 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:32.760263 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" podStartSLOduration=2.108100339 podStartE2EDuration="4.760249518s" podCreationTimestamp="2026-05-28 18:32:28 +0000 UTC" firstStartedPulling="2026-05-28 18:32:29.455801833 +0000 UTC m=+380.581150905" lastFinishedPulling="2026-05-28 18:32:32.107951008 +0000 UTC m=+383.233300084" observedRunningTime="2026-05-28 18:32:32.759539671 +0000 UTC m=+383.884888765" watchObservedRunningTime="2026-05-28 18:32:32.760249518 +0000 UTC m=+383.885598611" May 28 18:32:38.743573 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:32:38.743539 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-q5fd8" May 28 18:33:09.189611 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.189574 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf"] May 28 18:33:09.193263 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.193246 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.196603 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.196579 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 18:33:09.197690 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.197668 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 18:33:09.198006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.197979 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 18:33:09.198006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.197985 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 18:33:09.198546 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.198528 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l9hnf\"" May 28 18:33:09.215189 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.215159 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf"] May 28 18:33:09.344302 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.344267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzqsx\" (UniqueName: \"kubernetes.io/projected/42549edf-6650-4994-8a65-7ebe37a9a86b-kube-api-access-pzqsx\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.344460 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.344356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.344460 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.344409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.445250 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.445158 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.445250 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.445208 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzqsx\" (UniqueName: \"kubernetes.io/projected/42549edf-6650-4994-8a65-7ebe37a9a86b-kube-api-access-pzqsx\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.445478 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.445277 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.448080 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.448060 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 18:33:09.454574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.454557 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 18:33:09.458192 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.458173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.458279 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.458176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42549edf-6650-4994-8a65-7ebe37a9a86b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.464946 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.464925 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 18:33:09.475294 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.475263 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzqsx\" (UniqueName: \"kubernetes.io/projected/42549edf-6650-4994-8a65-7ebe37a9a86b-kube-api-access-pzqsx\") pod \"opendatahub-operator-controller-manager-67686c6958-cdqrf\" (UID: \"42549edf-6650-4994-8a65-7ebe37a9a86b\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.505771 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.505741 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l9hnf\"" May 28 18:33:09.512957 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.512921 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:09.649127 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.649100 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf"] May 28 18:33:09.651811 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:33:09.651782 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42549edf_6650_4994_8a65_7ebe37a9a86b.slice/crio-9e665d6935c06e07545a7432ee4cc398a3a7225abfde62e85f7bad2e98c6e4d0 WatchSource:0}: Error finding container 9e665d6935c06e07545a7432ee4cc398a3a7225abfde62e85f7bad2e98c6e4d0: Status 404 returned error can't find the container with id 9e665d6935c06e07545a7432ee4cc398a3a7225abfde62e85f7bad2e98c6e4d0 May 28 18:33:09.851474 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:09.851388 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" event={"ID":"42549edf-6650-4994-8a65-7ebe37a9a86b","Type":"ContainerStarted","Data":"9e665d6935c06e07545a7432ee4cc398a3a7225abfde62e85f7bad2e98c6e4d0"} May 28 18:33:12.864205 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:12.864166 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" event={"ID":"42549edf-6650-4994-8a65-7ebe37a9a86b","Type":"ContainerStarted","Data":"1eea940b3bf8acd2859c0a4e77bba7594e7fcd26440015de1c8dda690af27c29"} May 28 18:33:12.864639 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:12.864248 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:12.899888 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:12.899833 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" podStartSLOduration=1.522669139 podStartE2EDuration="3.899814513s" podCreationTimestamp="2026-05-28 18:33:09 +0000 UTC" firstStartedPulling="2026-05-28 18:33:09.653626656 +0000 UTC m=+420.778975727" lastFinishedPulling="2026-05-28 18:33:12.030772024 +0000 UTC m=+423.156121101" observedRunningTime="2026-05-28 18:33:12.896613505 +0000 UTC m=+424.021962598" watchObservedRunningTime="2026-05-28 18:33:12.899814513 +0000 UTC m=+424.025163608" May 28 18:33:22.089490 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.089448 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs"] May 28 18:33:22.093038 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.093016 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.097447 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097413 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 18:33:22.097589 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097506 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 18:33:22.097589 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097521 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 18:33:22.097589 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097530 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 18:33:22.097589 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097558 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wnqwj\"" May 28 18:33:22.097799 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.097640 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 18:33:22.102370 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.102351 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs"] May 28 18:33:22.155227 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.155197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/064138d6-cde5-4e7f-85af-fe9428ab8283-manager-config\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.155393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.155243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2thf\" (UniqueName: \"kubernetes.io/projected/064138d6-cde5-4e7f-85af-fe9428ab8283-kube-api-access-n2thf\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.155393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.155273 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.155393 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.155311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.255760 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.255721 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.255930 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.255798 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/064138d6-cde5-4e7f-85af-fe9428ab8283-manager-config\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.255930 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.255827 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2thf\" (UniqueName: \"kubernetes.io/projected/064138d6-cde5-4e7f-85af-fe9428ab8283-kube-api-access-n2thf\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.255930 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.255852 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.256542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.256514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/064138d6-cde5-4e7f-85af-fe9428ab8283-manager-config\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.258384 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.258357 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.258588 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.258568 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/064138d6-cde5-4e7f-85af-fe9428ab8283-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.272449 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.272423 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2thf\" (UniqueName: \"kubernetes.io/projected/064138d6-cde5-4e7f-85af-fe9428ab8283-kube-api-access-n2thf\") pod \"lws-controller-manager-77d4cfb68f-dkmfs\" (UID: \"064138d6-cde5-4e7f-85af-fe9428ab8283\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.403027 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.402992 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:22.532677 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.532604 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs"] May 28 18:33:22.534947 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:33:22.534921 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064138d6_cde5_4e7f_85af_fe9428ab8283.slice/crio-fc1a9c7b0027ee7e48ec7f00e45f59b1bab16c9bfe9092bc4f6245113da29339 WatchSource:0}: Error finding container fc1a9c7b0027ee7e48ec7f00e45f59b1bab16c9bfe9092bc4f6245113da29339: Status 404 returned error can't find the container with id fc1a9c7b0027ee7e48ec7f00e45f59b1bab16c9bfe9092bc4f6245113da29339 May 28 18:33:22.897790 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:22.897750 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" event={"ID":"064138d6-cde5-4e7f-85af-fe9428ab8283","Type":"ContainerStarted","Data":"fc1a9c7b0027ee7e48ec7f00e45f59b1bab16c9bfe9092bc4f6245113da29339"} May 28 18:33:23.870974 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:23.870945 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-cdqrf" May 28 18:33:24.907109 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:24.907075 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" event={"ID":"064138d6-cde5-4e7f-85af-fe9428ab8283","Type":"ContainerStarted","Data":"0ff0aed982006cc5a131002b660957e3dbf9f869cc8178338e8e62df137e8316"} May 28 18:33:24.907509 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:24.907216 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:24.930720 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:24.930674 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" podStartSLOduration=0.714349416 podStartE2EDuration="2.930660682s" podCreationTimestamp="2026-05-28 18:33:22 +0000 UTC" firstStartedPulling="2026-05-28 18:33:22.536633818 +0000 UTC m=+433.661982889" lastFinishedPulling="2026-05-28 18:33:24.752945081 +0000 UTC m=+435.878294155" observedRunningTime="2026-05-28 18:33:24.930310465 +0000 UTC m=+436.055659559" watchObservedRunningTime="2026-05-28 18:33:24.930660682 +0000 UTC m=+436.056009774" May 28 18:33:35.913729 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:35.913652 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-dkmfs" May 28 18:33:37.371660 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.371620 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz"] May 28 18:33:37.375187 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.375165 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.377856 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.377836 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 18:33:37.377999 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.377906 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 28 18:33:37.379088 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.379071 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-578ch\"" May 28 18:33:37.379196 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.379077 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 28 18:33:37.379196 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.379078 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 18:33:37.389559 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.389539 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz"] May 28 18:33:37.488126 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.488095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp7q5\" (UniqueName: \"kubernetes.io/projected/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-kube-api-access-cp7q5\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.488329 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.488243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tmp\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.488329 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.488272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.589626 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.589588 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tmp\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.589626 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.589627 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.589846 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.589677 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cp7q5\" (UniqueName: \"kubernetes.io/projected/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-kube-api-access-cp7q5\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.592184 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.592129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tmp\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.592373 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.592356 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.600909 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.600886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp7q5\" (UniqueName: \"kubernetes.io/projected/c4f6a77a-8d61-40d6-af4a-aee0ef86ffea-kube-api-access-cp7q5\") pod \"kube-auth-proxy-6d979fcbd5-jnmpz\" (UID: \"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.687874 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.687795 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" May 28 18:33:37.821224 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.821200 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz"] May 28 18:33:37.823869 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:33:37.823841 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f6a77a_8d61_40d6_af4a_aee0ef86ffea.slice/crio-214f028654318dbe3e55c947f336b4787519fb5d484e6ee6dbb7b7cfe584e6e3 WatchSource:0}: Error finding container 214f028654318dbe3e55c947f336b4787519fb5d484e6ee6dbb7b7cfe584e6e3: Status 404 returned error can't find the container with id 214f028654318dbe3e55c947f336b4787519fb5d484e6ee6dbb7b7cfe584e6e3 May 28 18:33:37.951476 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:37.951388 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" event={"ID":"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea","Type":"ContainerStarted","Data":"214f028654318dbe3e55c947f336b4787519fb5d484e6ee6dbb7b7cfe584e6e3"} May 28 18:33:40.964265 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:40.964223 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" event={"ID":"c4f6a77a-8d61-40d6-af4a-aee0ef86ffea","Type":"ContainerStarted","Data":"5d87544226e15a8e9c31953f75b1b513b8319757aa11698f8d0e61b96458f51d"} May 28 18:33:40.982719 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:33:40.982667 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-jnmpz" podStartSLOduration=1.475538702 podStartE2EDuration="3.98265204s" podCreationTimestamp="2026-05-28 18:33:37 +0000 UTC" firstStartedPulling="2026-05-28 18:33:37.825518884 +0000 UTC m=+448.950867954" lastFinishedPulling="2026-05-28 18:33:40.332632221 +0000 UTC m=+451.457981292" observedRunningTime="2026-05-28 18:33:40.981069809 +0000 UTC m=+452.106418902" watchObservedRunningTime="2026-05-28 18:33:40.98265204 +0000 UTC m=+452.108001133" May 28 18:35:08.913397 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.913313 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d"] May 28 18:35:08.916651 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.916631 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:08.919182 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.919125 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 28 18:35:08.919307 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.919183 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 18:35:08.919307 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.919199 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7tjc6\"" May 28 18:35:08.920242 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.920227 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 28 18:35:08.920330 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.920258 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 18:35:08.928611 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:08.928587 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d"] May 28 18:35:09.010574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.010536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.010754 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.010597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwczp\" (UniqueName: \"kubernetes.io/projected/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-kube-api-access-nwczp\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.010754 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.010678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.111943 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.111907 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.112104 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.111955 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwczp\" (UniqueName: \"kubernetes.io/projected/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-kube-api-access-nwczp\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.112104 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.111984 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.112648 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.112623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.114493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.114473 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.131520 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.131498 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwczp\" (UniqueName: \"kubernetes.io/projected/0b417d12-c429-42e1-b8d2-81eb6d46fdbe-kube-api-access-nwczp\") pod \"kuadrant-console-plugin-6cb54b5c86-b9h6d\" (UID: \"0b417d12-c429-42e1-b8d2-81eb6d46fdbe\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.225738 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.225648 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" May 28 18:35:09.374154 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:09.374096 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d"] May 28 18:35:09.377210 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:35:09.377179 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b417d12_c429_42e1_b8d2_81eb6d46fdbe.slice/crio-fafa153fe949432fbe24dc41bc5e460b61f03b93e8b657bf272043f41e822b63 WatchSource:0}: Error finding container fafa153fe949432fbe24dc41bc5e460b61f03b93e8b657bf272043f41e822b63: Status 404 returned error can't find the container with id fafa153fe949432fbe24dc41bc5e460b61f03b93e8b657bf272043f41e822b63 May 28 18:35:10.273935 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:10.273891 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" event={"ID":"0b417d12-c429-42e1-b8d2-81eb6d46fdbe","Type":"ContainerStarted","Data":"fafa153fe949432fbe24dc41bc5e460b61f03b93e8b657bf272043f41e822b63"} May 28 18:35:30.904294 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:35:30.904260 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b417d12_c429_42e1_b8d2_81eb6d46fdbe.slice/crio-2054a994c7b9041e517328d8dcc27df287165aa8678293bf80ffe68ffaccc879.scope\": RecentStats: unable to find data in memory cache]" May 28 18:35:31.363652 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:31.363616 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" event={"ID":"0b417d12-c429-42e1-b8d2-81eb6d46fdbe","Type":"ContainerStarted","Data":"2054a994c7b9041e517328d8dcc27df287165aa8678293bf80ffe68ffaccc879"} May 28 18:35:31.381121 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:31.381059 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-b9h6d" podStartSLOduration=1.9245820359999999 podStartE2EDuration="23.381042789s" podCreationTimestamp="2026-05-28 18:35:08 +0000 UTC" firstStartedPulling="2026-05-28 18:35:09.378429314 +0000 UTC m=+540.503778385" lastFinishedPulling="2026-05-28 18:35:30.834890064 +0000 UTC m=+561.960239138" observedRunningTime="2026-05-28 18:35:31.379392839 +0000 UTC m=+562.504741932" watchObservedRunningTime="2026-05-28 18:35:31.381042789 +0000 UTC m=+562.506391882" May 28 18:35:56.360202 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.360158 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:35:56.413254 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.413218 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:35:56.413409 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.413277 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:35:56.413409 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.413360 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.415959 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.415937 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 18:35:56.571123 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.571089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e7f7262-2c4f-4368-aed7-8052f1b422e6-config-file\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.571305 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.571132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjznd\" (UniqueName: \"kubernetes.io/projected/9e7f7262-2c4f-4368-aed7-8052f1b422e6-kube-api-access-gjznd\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.672596 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.672563 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e7f7262-2c4f-4368-aed7-8052f1b422e6-config-file\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.672763 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.672608 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjznd\" (UniqueName: \"kubernetes.io/projected/9e7f7262-2c4f-4368-aed7-8052f1b422e6-kube-api-access-gjznd\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.673262 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.673242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e7f7262-2c4f-4368-aed7-8052f1b422e6-config-file\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.680236 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.680217 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjznd\" (UniqueName: \"kubernetes.io/projected/9e7f7262-2c4f-4368-aed7-8052f1b422e6-kube-api-access-gjznd\") pod \"limitador-limitador-78c99df468-txzf8\" (UID: \"9e7f7262-2c4f-4368-aed7-8052f1b422e6\") " pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.723218 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.723182 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:56.853547 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:56.853518 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:35:56.856184 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:35:56.856135 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7f7262_2c4f_4368_aed7_8052f1b422e6.slice/crio-264aebee46c2338f983b9cb451da772951bea69ae6773ae44cda3ef1304a68e0 WatchSource:0}: Error finding container 264aebee46c2338f983b9cb451da772951bea69ae6773ae44cda3ef1304a68e0: Status 404 returned error can't find the container with id 264aebee46c2338f983b9cb451da772951bea69ae6773ae44cda3ef1304a68e0 May 28 18:35:57.455341 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:57.455283 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" event={"ID":"9e7f7262-2c4f-4368-aed7-8052f1b422e6","Type":"ContainerStarted","Data":"264aebee46c2338f983b9cb451da772951bea69ae6773ae44cda3ef1304a68e0"} May 28 18:35:59.463596 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:59.463552 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" event={"ID":"9e7f7262-2c4f-4368-aed7-8052f1b422e6","Type":"ContainerStarted","Data":"013d95badda602fd5da88c0ee217b6de64e8c34fc53fce4aa8950f0d0de76878"} May 28 18:35:59.463958 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:59.463688 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:35:59.481800 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:35:59.481739 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" podStartSLOduration=1.0832676430000001 podStartE2EDuration="3.481718844s" podCreationTimestamp="2026-05-28 18:35:56 +0000 UTC" firstStartedPulling="2026-05-28 18:35:56.857947909 +0000 UTC m=+587.983296980" lastFinishedPulling="2026-05-28 18:35:59.256399105 +0000 UTC m=+590.381748181" observedRunningTime="2026-05-28 18:35:59.480296741 +0000 UTC m=+590.605645834" watchObservedRunningTime="2026-05-28 18:35:59.481718844 +0000 UTC m=+590.607067938" May 28 18:36:09.420889 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:09.419243 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:36:09.422006 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:09.421984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:36:10.468756 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:10.468716 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-txzf8" May 28 18:36:28.965267 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:28.965178 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:36:28.973400 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:28.973368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:28.975195 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:28.975168 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:36:28.977047 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:28.977024 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nnwdw\"" May 28 18:36:28.977188 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:28.977088 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 18:36:29.040189 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.040122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.040189 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.040196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cr5k\" (UniqueName: \"kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.141190 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.141130 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.141376 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.141197 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cr5k\" (UniqueName: \"kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.143683 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.143664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.148923 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.148898 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cr5k\" (UniqueName: \"kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k\") pod \"authorino-868d69f589-h42nk\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.283811 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.283725 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:36:29.412115 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.412081 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:36:29.415334 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:36:29.415308 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03cb4e33_a342_4be3_b0a8_5b0eda98dc61.slice/crio-36704d349c8a990922128505a583d2fcf2d53dfceb539291d994b21fccb926c7 WatchSource:0}: Error finding container 36704d349c8a990922128505a583d2fcf2d53dfceb539291d994b21fccb926c7: Status 404 returned error can't find the container with id 36704d349c8a990922128505a583d2fcf2d53dfceb539291d994b21fccb926c7 May 28 18:36:29.565838 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:29.565755 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868d69f589-h42nk" event={"ID":"03cb4e33-a342-4be3-b0a8-5b0eda98dc61","Type":"ContainerStarted","Data":"36704d349c8a990922128505a583d2fcf2d53dfceb539291d994b21fccb926c7"} May 28 18:36:32.580864 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:32.580773 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868d69f589-h42nk" event={"ID":"03cb4e33-a342-4be3-b0a8-5b0eda98dc61","Type":"ContainerStarted","Data":"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8"} May 28 18:36:32.598177 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:36:32.598104 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-868d69f589-h42nk" podStartSLOduration=1.746221786 podStartE2EDuration="4.598088739s" podCreationTimestamp="2026-05-28 18:36:28 +0000 UTC" firstStartedPulling="2026-05-28 18:36:29.416637712 +0000 UTC m=+620.541986782" lastFinishedPulling="2026-05-28 18:36:32.268504662 +0000 UTC m=+623.393853735" observedRunningTime="2026-05-28 18:36:32.596595186 +0000 UTC m=+623.721944279" watchObservedRunningTime="2026-05-28 18:36:32.598088739 +0000 UTC m=+623.723437898" May 28 18:37:10.650493 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:37:10.650454 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:37:44.700495 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:37:44.700453 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:37:52.902234 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:37:52.902193 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:38:07.500981 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:38:07.500901 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:38:15.595460 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:38:15.595424 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:38:29.297986 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:38:29.297946 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:39:13.720754 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:13.720710 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:39:13.721233 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:13.720933 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-868d69f589-h42nk" podUID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" containerName="authorino" containerID="cri-o://1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8" gracePeriod=30 May 28 18:39:13.967821 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:13.967796 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:39:14.053715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.053624 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cr5k\" (UniqueName: \"kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k\") pod \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " May 28 18:39:14.053715 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.053705 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert\") pod \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\" (UID: \"03cb4e33-a342-4be3-b0a8-5b0eda98dc61\") " May 28 18:39:14.055959 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.055931 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k" (OuterVolumeSpecName: "kube-api-access-9cr5k") pod "03cb4e33-a342-4be3-b0a8-5b0eda98dc61" (UID: "03cb4e33-a342-4be3-b0a8-5b0eda98dc61"). InnerVolumeSpecName "kube-api-access-9cr5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:39:14.065634 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.065608 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "03cb4e33-a342-4be3-b0a8-5b0eda98dc61" (UID: "03cb4e33-a342-4be3-b0a8-5b0eda98dc61"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:39:14.140727 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.140688 2568 generic.go:358] "Generic (PLEG): container finished" podID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" containerID="1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8" exitCode=0 May 28 18:39:14.140885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.140744 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868d69f589-h42nk" event={"ID":"03cb4e33-a342-4be3-b0a8-5b0eda98dc61","Type":"ContainerDied","Data":"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8"} May 28 18:39:14.140885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.140772 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868d69f589-h42nk" event={"ID":"03cb4e33-a342-4be3-b0a8-5b0eda98dc61","Type":"ContainerDied","Data":"36704d349c8a990922128505a583d2fcf2d53dfceb539291d994b21fccb926c7"} May 28 18:39:14.140885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.140787 2568 scope.go:117] "RemoveContainer" containerID="1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8" May 28 18:39:14.140885 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.140749 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868d69f589-h42nk" May 28 18:39:14.149769 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.149744 2568 scope.go:117] "RemoveContainer" containerID="1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8" May 28 18:39:14.150018 ip-10-0-137-19 kubenswrapper[2568]: E0528 18:39:14.150001 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8\": container with ID starting with 1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8 not found: ID does not exist" containerID="1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8" May 28 18:39:14.150070 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.150030 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8"} err="failed to get container status \"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8\": rpc error: code = NotFound desc = could not find container \"1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8\": container with ID starting with 1539cb959b9305eb6da53430dafb042a87e9105a781f3668d1e120d99e5daab8 not found: ID does not exist" May 28 18:39:14.154276 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.154257 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cr5k\" (UniqueName: \"kubernetes.io/projected/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-kube-api-access-9cr5k\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:39:14.154276 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.154278 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/03cb4e33-a342-4be3-b0a8-5b0eda98dc61-tls-cert\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:39:14.162654 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.162632 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:39:14.166725 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:14.166703 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-868d69f589-h42nk"] May 28 18:39:15.507643 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:15.507609 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" path="/var/lib/kubelet/pods/03cb4e33-a342-4be3-b0a8-5b0eda98dc61/volumes" May 28 18:39:40.595164 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:40.595047 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:39:51.690904 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:39:51.690859 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:40:00.793542 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:40:00.793503 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:40:10.996288 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:40:10.996252 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:40:19.792454 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:40:19.792417 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:40:30.693177 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:40:30.693124 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:41:09.453338 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:41:09.453259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:41:09.454888 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:41:09.454865 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:41:42.191120 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:41:42.191082 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:41:57.596989 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:41:57.596955 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:42:36.697033 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:42:36.696938 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:42:52.592064 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:42:52.592026 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:43:07.402056 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:43:07.402021 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:43:23.792691 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:43:23.792653 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:43:49.193313 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:43:49.193276 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:43:54.396810 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:43:54.396760 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:44:29.292946 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:44:29.292906 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:44:39.091394 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:44:39.091354 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:44:55.786561 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:44:55.786512 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:45:00.133669 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.133630 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-wwnpb"] May 28 18:45:00.134065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.134021 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" containerName="authorino" May 28 18:45:00.134065 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.134033 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" containerName="authorino" May 28 18:45:00.134135 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.134097 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="03cb4e33-a342-4be3-b0a8-5b0eda98dc61" containerName="authorino" May 28 18:45:00.137057 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.137039 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:00.139657 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.139635 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q9jh6\"" May 28 18:45:00.153334 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.153310 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-wwnpb"] May 28 18:45:00.313416 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.313374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvdt\" (UniqueName: \"kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt\") pod \"maas-api-key-cleanup-29666565-wwnpb\" (UID: \"13317204-2361-49c6-a27d-4d958e77a47a\") " pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:00.414852 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.414766 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znvdt\" (UniqueName: \"kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt\") pod \"maas-api-key-cleanup-29666565-wwnpb\" (UID: \"13317204-2361-49c6-a27d-4d958e77a47a\") " pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:00.423189 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.423154 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvdt\" (UniqueName: \"kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt\") pod \"maas-api-key-cleanup-29666565-wwnpb\" (UID: \"13317204-2361-49c6-a27d-4d958e77a47a\") " pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:00.446636 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.446602 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:00.579479 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.579329 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-wwnpb"] May 28 18:45:00.584737 ip-10-0-137-19 kubenswrapper[2568]: W0528 18:45:00.584503 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13317204_2361_49c6_a27d_4d958e77a47a.slice/crio-c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185 WatchSource:0}: Error finding container c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185: Status 404 returned error can't find the container with id c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185 May 28 18:45:00.586497 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:00.586469 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:45:01.329992 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:01.329950 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" event={"ID":"13317204-2361-49c6-a27d-4d958e77a47a","Type":"ContainerStarted","Data":"c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185"} May 28 18:45:03.338580 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:03.338542 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" event={"ID":"13317204-2361-49c6-a27d-4d958e77a47a","Type":"ContainerStarted","Data":"6d171e58a6cf6c0ac5cfa30f589ac0662e7a801c2e902937257e6d1f24e0b67f"} May 28 18:45:03.351984 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:03.351872 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" podStartSLOduration=1.038565808 podStartE2EDuration="3.351854657s" podCreationTimestamp="2026-05-28 18:45:00 +0000 UTC" firstStartedPulling="2026-05-28 18:45:00.586610967 +0000 UTC m=+1131.711960042" lastFinishedPulling="2026-05-28 18:45:02.899899816 +0000 UTC m=+1134.025248891" observedRunningTime="2026-05-28 18:45:03.351771779 +0000 UTC m=+1134.477120873" watchObservedRunningTime="2026-05-28 18:45:03.351854657 +0000 UTC m=+1134.477203752" May 28 18:45:04.344046 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:04.344010 2568 generic.go:358] "Generic (PLEG): container finished" podID="13317204-2361-49c6-a27d-4d958e77a47a" containerID="6d171e58a6cf6c0ac5cfa30f589ac0662e7a801c2e902937257e6d1f24e0b67f" exitCode=0 May 28 18:45:04.344470 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:04.344097 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" event={"ID":"13317204-2361-49c6-a27d-4d958e77a47a","Type":"ContainerDied","Data":"6d171e58a6cf6c0ac5cfa30f589ac0662e7a801c2e902937257e6d1f24e0b67f"} May 28 18:45:04.594860 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:04.594766 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:45:05.478218 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:05.478192 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:05.661341 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:05.661303 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znvdt\" (UniqueName: \"kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt\") pod \"13317204-2361-49c6-a27d-4d958e77a47a\" (UID: \"13317204-2361-49c6-a27d-4d958e77a47a\") " May 28 18:45:05.663707 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:05.663683 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt" (OuterVolumeSpecName: "kube-api-access-znvdt") pod "13317204-2361-49c6-a27d-4d958e77a47a" (UID: "13317204-2361-49c6-a27d-4d958e77a47a"). InnerVolumeSpecName "kube-api-access-znvdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:45:05.762682 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:05.762641 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znvdt\" (UniqueName: \"kubernetes.io/projected/13317204-2361-49c6-a27d-4d958e77a47a-kube-api-access-znvdt\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 18:45:06.351964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:06.351933 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" May 28 18:45:06.351964 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:06.351944 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-wwnpb" event={"ID":"13317204-2361-49c6-a27d-4d958e77a47a","Type":"ContainerDied","Data":"c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185"} May 28 18:45:06.352205 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:06.351976 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c793a0c625edb1e243c128a891824e08a5f20fb78ef4aba745346a07553e5185" May 28 18:45:21.487819 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:21.487776 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:45:28.991266 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:45:28.991163 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:46:01.891552 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:46:01.891513 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:46:09.480109 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:46:09.480081 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:46:09.483261 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:46:09.483241 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:46:37.790649 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:46:37.790613 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:46:55.189740 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:46:55.189702 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:47:12.590685 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:47:12.590592 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:47:23.396184 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:47:23.396127 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:10.806305 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:10.806257 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:15.625268 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:15.625230 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:23.321509 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:23.321469 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:32.232635 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:32.232547 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:41.209121 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:41.209084 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:49.363529 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:49.363489 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:48:58.370664 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:48:58.370625 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:03.636134 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:03.636100 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:07.708316 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:07.708278 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:17.518168 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:17.518121 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:24.894099 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:24.894060 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:33.701760 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:33.701709 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:42.198760 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:42.198724 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:51.193965 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:51.193927 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:49:59.503385 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:49:59.503294 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:50:08.391257 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:50:08.391222 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:50:17.594556 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:50:17.594518 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:50:26.991101 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:50:26.991062 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:50:35.404694 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:50:35.404645 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:51:09.507108 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:51:09.507080 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:51:09.519282 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:51:09.519252 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:52:51.394950 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:52:51.394911 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:52:57.098642 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:52:57.098539 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:53:23.894058 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:53:23.894015 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:53:30.099685 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:53:30.099648 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:53:39.396069 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:53:39.396035 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:53:50.096941 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:53:50.096907 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:53:58.323213 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:53:58.323173 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:09.894840 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:09.894801 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:17.995157 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:17.995101 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:28.600615 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:28.600531 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:36.730687 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:36.730638 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:47.312890 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:47.312848 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:54:56.505953 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:54:56.505918 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:55:29.903628 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:55:29.903590 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:09.538446 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:09.538415 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:56:09.545414 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:09.545392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 18:56:12.503574 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:12.503542 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:22.100308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:22.100270 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:30.098447 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:30.098404 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:38.497634 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:38.497592 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:46.706091 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:46.706049 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:56:59.596746 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:56:59.596698 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:10.295352 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:10.295314 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:17.197350 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:17.197305 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:25.099645 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:25.099604 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:33.400308 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:33.400216 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:42.298496 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:42.298461 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:57:52.490583 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:57:52.490546 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:58:10.904314 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:58:10.904277 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:58:18.697518 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:58:18.697484 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:58:28.197423 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:58:28.197389 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:58:35.893534 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:58:35.893494 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:58:53.195703 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:58:53.195671 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:01.099646 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:01.099544 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:10.194236 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:10.194198 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:18.493807 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:18.493767 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:26.903895 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:26.903862 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:35.600353 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:35.600318 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:44.800617 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:44.800574 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 18:59:56.028720 ip-10-0-137-19 kubenswrapper[2568]: I0528 18:59:56.028673 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:00.130876 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.130838 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-wsnsd"] May 28 19:00:00.131394 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.131243 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13317204-2361-49c6-a27d-4d958e77a47a" containerName="cleanup" May 28 19:00:00.131394 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.131257 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="13317204-2361-49c6-a27d-4d958e77a47a" containerName="cleanup" May 28 19:00:00.131394 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.131331 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="13317204-2361-49c6-a27d-4d958e77a47a" containerName="cleanup" May 28 19:00:00.134300 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.134283 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:00.136828 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.136810 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q9jh6\"" May 28 19:00:00.149952 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.149926 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-wsnsd"] May 28 19:00:00.159968 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.159936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmlc\" (UniqueName: \"kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc\") pod \"maas-api-key-cleanup-29666580-wsnsd\" (UID: \"ce9fc1a4-f701-4307-bd0e-f93c4203fc37\") " pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:00.260530 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.260489 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmlc\" (UniqueName: \"kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc\") pod \"maas-api-key-cleanup-29666580-wsnsd\" (UID: \"ce9fc1a4-f701-4307-bd0e-f93c4203fc37\") " pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:00.269467 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.269433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmlc\" (UniqueName: \"kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc\") pod \"maas-api-key-cleanup-29666580-wsnsd\" (UID: \"ce9fc1a4-f701-4307-bd0e-f93c4203fc37\") " pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:00.444667 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.444584 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:00.578031 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.578007 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-wsnsd"] May 28 19:00:00.580723 ip-10-0-137-19 kubenswrapper[2568]: W0528 19:00:00.580698 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9fc1a4_f701_4307_bd0e_f93c4203fc37.slice/crio-b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f WatchSource:0}: Error finding container b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f: Status 404 returned error can't find the container with id b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f May 28 19:00:00.582577 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:00.582563 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 19:00:01.512448 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:01.512406 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce9fc1a4-f701-4307-bd0e-f93c4203fc37" containerID="2fd6d2d00849a461a1b9674bc9a6f26946995c3ccd9a4284581f6089913cead9" exitCode=0 May 28 19:00:01.513503 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:01.513477 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" event={"ID":"ce9fc1a4-f701-4307-bd0e-f93c4203fc37","Type":"ContainerDied","Data":"2fd6d2d00849a461a1b9674bc9a6f26946995c3ccd9a4284581f6089913cead9"} May 28 19:00:01.513577 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:01.513510 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" event={"ID":"ce9fc1a4-f701-4307-bd0e-f93c4203fc37","Type":"ContainerStarted","Data":"b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f"} May 28 19:00:02.648819 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:02.648795 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:02.680783 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:02.680743 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkmlc\" (UniqueName: \"kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc\") pod \"ce9fc1a4-f701-4307-bd0e-f93c4203fc37\" (UID: \"ce9fc1a4-f701-4307-bd0e-f93c4203fc37\") " May 28 19:00:02.682948 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:02.682917 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc" (OuterVolumeSpecName: "kube-api-access-pkmlc") pod "ce9fc1a4-f701-4307-bd0e-f93c4203fc37" (UID: "ce9fc1a4-f701-4307-bd0e-f93c4203fc37"). InnerVolumeSpecName "kube-api-access-pkmlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 19:00:02.782372 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:02.782271 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkmlc\" (UniqueName: \"kubernetes.io/projected/ce9fc1a4-f701-4307-bd0e-f93c4203fc37-kube-api-access-pkmlc\") on node \"ip-10-0-137-19.ec2.internal\" DevicePath \"\"" May 28 19:00:03.521129 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:03.521087 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" event={"ID":"ce9fc1a4-f701-4307-bd0e-f93c4203fc37","Type":"ContainerDied","Data":"b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f"} May 28 19:00:03.521129 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:03.521120 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b75885656b76b9cdac0dee40bfcbe1cd22761a0703145031f84408d36443130f" May 28 19:00:03.521301 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:03.521126 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-wsnsd" May 28 19:00:05.197026 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:05.196993 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:18.204064 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:18.204026 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:27.099864 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:27.099770 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:35.492767 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:35.492725 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:45.198182 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:45.198130 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:00:50.607553 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:00:50.607516 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:01:08.596765 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:08.596726 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:01:09.565383 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:09.565357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 19:01:09.572050 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:09.572026 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 19:01:17.191753 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:17.191719 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:01:24.894880 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:24.894841 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:01:33.797890 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:33.797852 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:01:56.997487 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:01:56.997404 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:02:09.698008 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:09.697975 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-txzf8"] May 28 19:02:18.338764 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:18.338728 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666565-wwnpb_13317204-2361-49c6-a27d-4d958e77a47a/cleanup/0.log" May 28 19:02:18.444411 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:18.444386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-wsnsd_ce9fc1a4-f701-4307-bd0e-f93c4203fc37/cleanup/0.log" May 28 19:02:18.898277 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:18.898242 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-cdqrf_42549edf-6650-4994-8a65-7ebe37a9a86b/manager/0.log" May 28 19:02:20.693000 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:20.692972 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-b9h6d_0b417d12-c429-42e1-b8d2-81eb6d46fdbe/kuadrant-console-plugin/0.log" May 28 19:02:21.058833 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:21.058759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-txzf8_9e7f7262-2c4f-4368-aed7-8052f1b422e6/limitador/0.log" May 28 19:02:21.842443 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:21.842415 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d979fcbd5-jnmpz_c4f6a77a-8d61-40d6-af4a-aee0ef86ffea/kube-auth-proxy/0.log" May 28 19:02:27.534525 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.534485 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fx658/must-gather-frjbd"] May 28 19:02:27.534966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.534879 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9fc1a4-f701-4307-bd0e-f93c4203fc37" containerName="cleanup" May 28 19:02:27.534966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.534892 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9fc1a4-f701-4307-bd0e-f93c4203fc37" containerName="cleanup" May 28 19:02:27.534966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.534964 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce9fc1a4-f701-4307-bd0e-f93c4203fc37" containerName="cleanup" May 28 19:02:27.538252 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.538233 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.540900 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.540876 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fx658\"/\"default-dockercfg-dz7nn\"" May 28 19:02:27.541023 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.540921 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"openshift-service-ca.crt\"" May 28 19:02:27.541922 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.541908 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"kube-root-ca.crt\"" May 28 19:02:27.553939 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.553914 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/must-gather-frjbd"] May 28 19:02:27.590117 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.590076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlgwr\" (UniqueName: \"kubernetes.io/projected/b45be04a-bf01-479d-9a16-7b9302032e7b-kube-api-access-wlgwr\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.590318 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.590177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b45be04a-bf01-479d-9a16-7b9302032e7b-must-gather-output\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.691236 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.691169 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b45be04a-bf01-479d-9a16-7b9302032e7b-must-gather-output\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.691403 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.691261 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlgwr\" (UniqueName: \"kubernetes.io/projected/b45be04a-bf01-479d-9a16-7b9302032e7b-kube-api-access-wlgwr\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.691504 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.691483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b45be04a-bf01-479d-9a16-7b9302032e7b-must-gather-output\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.699477 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.699451 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlgwr\" (UniqueName: \"kubernetes.io/projected/b45be04a-bf01-479d-9a16-7b9302032e7b-kube-api-access-wlgwr\") pod \"must-gather-frjbd\" (UID: \"b45be04a-bf01-479d-9a16-7b9302032e7b\") " pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.848030 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.847931 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/must-gather-frjbd" May 28 19:02:27.983195 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:27.983174 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/must-gather-frjbd"] May 28 19:02:27.985765 ip-10-0-137-19 kubenswrapper[2568]: W0528 19:02:27.985739 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb45be04a_bf01_479d_9a16_7b9302032e7b.slice/crio-4d16d4b87602a99535bef0977ed0a9d6e00870adc52c63d8fdd1762214633e01 WatchSource:0}: Error finding container 4d16d4b87602a99535bef0977ed0a9d6e00870adc52c63d8fdd1762214633e01: Status 404 returned error can't find the container with id 4d16d4b87602a99535bef0977ed0a9d6e00870adc52c63d8fdd1762214633e01 May 28 19:02:28.024727 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:28.024673 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/must-gather-frjbd" event={"ID":"b45be04a-bf01-479d-9a16-7b9302032e7b","Type":"ContainerStarted","Data":"4d16d4b87602a99535bef0977ed0a9d6e00870adc52c63d8fdd1762214633e01"} May 28 19:02:29.032069 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:29.031593 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/must-gather-frjbd" event={"ID":"b45be04a-bf01-479d-9a16-7b9302032e7b","Type":"ContainerStarted","Data":"582a8f679007f9a1cfe19ce0b50d45118d422ac59ff1880244d11f24c90e74ff"} May 28 19:02:29.032069 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:29.031641 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/must-gather-frjbd" event={"ID":"b45be04a-bf01-479d-9a16-7b9302032e7b","Type":"ContainerStarted","Data":"0aefa84de25cadd322be4d1bc9e9172bc5af3e59211b0ad508da397a8ab09528"} May 28 19:02:29.050715 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:29.048044 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fx658/must-gather-frjbd" podStartSLOduration=1.404630224 podStartE2EDuration="2.048023881s" podCreationTimestamp="2026-05-28 19:02:27 +0000 UTC" firstStartedPulling="2026-05-28 19:02:27.987885468 +0000 UTC m=+2179.113234542" lastFinishedPulling="2026-05-28 19:02:28.631279125 +0000 UTC m=+2179.756628199" observedRunningTime="2026-05-28 19:02:29.04786709 +0000 UTC m=+2180.173216200" watchObservedRunningTime="2026-05-28 19:02:29.048023881 +0000 UTC m=+2180.173372981" May 28 19:02:30.331541 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:30.331507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7s64q_bc358d67-f9f3-4a20-bd51-177756b41ce9/global-pull-secret-syncer/0.log" May 28 19:02:30.533811 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:30.533777 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-czpgk_93234e37-fe33-4c85-903e-9f4806f8cb88/konnectivity-agent/0.log" May 28 19:02:30.576756 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:30.576717 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-19.ec2.internal_4351858acffee685f753b0f84f44bc3a/haproxy/0.log" May 28 19:02:34.969116 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:34.969081 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-b9h6d_0b417d12-c429-42e1-b8d2-81eb6d46fdbe/kuadrant-console-plugin/0.log" May 28 19:02:35.116412 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:35.116388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-txzf8_9e7f7262-2c4f-4368-aed7-8052f1b422e6/limitador/0.log" May 28 19:02:36.653513 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.653395 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/alertmanager/0.log" May 28 19:02:36.676761 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.676713 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/config-reloader/0.log" May 28 19:02:36.701856 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.701831 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/kube-rbac-proxy-web/0.log" May 28 19:02:36.728894 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.728770 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/kube-rbac-proxy/0.log" May 28 19:02:36.750197 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.750158 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/kube-rbac-proxy-metric/0.log" May 28 19:02:36.772937 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.772902 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/prom-label-proxy/0.log" May 28 19:02:36.793655 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.793604 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49e086ef-02a6-4802-bc8d-fc099fdd7ab0/init-config-reloader/0.log" May 28 19:02:36.980234 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:36.980056 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-zxdxc_284a2d8d-e479-4e94-8bf5-4a8844432310/monitoring-plugin/0.log" May 28 19:02:37.175029 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.174989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sns9z_cd3cdf1b-86d8-4065-a469-b33ca406a07d/node-exporter/0.log" May 28 19:02:37.196884 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.196859 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sns9z_cd3cdf1b-86d8-4065-a469-b33ca406a07d/kube-rbac-proxy/0.log" May 28 19:02:37.220079 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.219983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sns9z_cd3cdf1b-86d8-4065-a469-b33ca406a07d/init-textfile/0.log" May 28 19:02:37.344767 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.344659 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/prometheus/0.log" May 28 19:02:37.372345 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.372282 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/config-reloader/0.log" May 28 19:02:37.394162 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.394120 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/thanos-sidecar/0.log" May 28 19:02:37.418311 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.418282 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/kube-rbac-proxy-web/0.log" May 28 19:02:37.440757 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.440731 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/kube-rbac-proxy/0.log" May 28 19:02:37.464856 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.464828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/kube-rbac-proxy-thanos/0.log" May 28 19:02:37.491117 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.491086 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b6d0cc11-c92b-4e63-88e6-93aa5edb3039/init-config-reloader/0.log" May 28 19:02:37.520195 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.520166 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-g9jtk_511da6a0-d94f-486f-96ca-56caad1eb352/prometheus-operator/0.log" May 28 19:02:37.537280 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.537256 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-g9jtk_511da6a0-d94f-486f-96ca-56caad1eb352/kube-rbac-proxy/0.log" May 28 19:02:37.597769 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.597666 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b45995c6-5lrsh_130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6/telemeter-client/0.log" May 28 19:02:37.620492 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.620467 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b45995c6-5lrsh_130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6/reload/0.log" May 28 19:02:37.642098 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.642071 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b45995c6-5lrsh_130f3967-ccd6-40ac-80e1-9ab3eeb4b2e6/kube-rbac-proxy/0.log" May 28 19:02:37.669768 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.669738 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/thanos-query/0.log" May 28 19:02:37.692281 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.692255 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/kube-rbac-proxy-web/0.log" May 28 19:02:37.712391 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.712357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/kube-rbac-proxy/0.log" May 28 19:02:37.731967 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.731940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/prom-label-proxy/0.log" May 28 19:02:37.752339 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.752310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/kube-rbac-proxy-rules/0.log" May 28 19:02:37.775823 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:37.775780 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d4d8f85-vbqp4_76d5bd36-e88f-4457-896e-1bc0247e6c03/kube-rbac-proxy-metrics/0.log" May 28 19:02:39.358344 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.358306 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx"] May 28 19:02:39.362946 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.362919 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.368591 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.368227 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx"] May 28 19:02:39.528966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.528931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-lib-modules\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.528966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.528972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-proc\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.529252 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.529109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-sys\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.529252 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.529194 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5kv\" (UniqueName: \"kubernetes.io/projected/02b74c51-e908-42bd-9ff4-39bdff436804-kube-api-access-2g5kv\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.529252 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.529225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-podres\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630512 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-sys\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630586 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5kv\" (UniqueName: \"kubernetes.io/projected/02b74c51-e908-42bd-9ff4-39bdff436804-kube-api-access-2g5kv\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630633 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-podres\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-sys\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630680 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-lib-modules\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630733 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-proc\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-podres\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-proc\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.630966 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.630938 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b74c51-e908-42bd-9ff4-39bdff436804-lib-modules\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.639811 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.639781 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5kv\" (UniqueName: \"kubernetes.io/projected/02b74c51-e908-42bd-9ff4-39bdff436804-kube-api-access-2g5kv\") pod \"perf-node-gather-daemonset-j4trx\" (UID: \"02b74c51-e908-42bd-9ff4-39bdff436804\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.684273 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.683787 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:39.852400 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:39.851980 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx"] May 28 19:02:40.088449 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:40.088407 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" event={"ID":"02b74c51-e908-42bd-9ff4-39bdff436804","Type":"ContainerStarted","Data":"c69b58548e667af35148f49ea75eadfe595c28fa9baadf6b386bac83da493f01"} May 28 19:02:40.088623 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:40.088458 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" event={"ID":"02b74c51-e908-42bd-9ff4-39bdff436804","Type":"ContainerStarted","Data":"9759ee59b9dd319e0a7cc3cda05d29bfadb77ba423fafce20196e12ae85b09e2"} May 28 19:02:40.088623 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:40.088502 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:40.106768 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:40.106699 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" podStartSLOduration=1.106676638 podStartE2EDuration="1.106676638s" podCreationTimestamp="2026-05-28 19:02:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:02:40.103656735 +0000 UTC m=+2191.229005829" watchObservedRunningTime="2026-05-28 19:02:40.106676638 +0000 UTC m=+2191.232025732" May 28 19:02:41.130094 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:41.126353 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbfsd_56cfd886-6c34-493c-90c8-0b386beeca41/dns/0.log" May 28 19:02:41.173396 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:41.173371 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbfsd_56cfd886-6c34-493c-90c8-0b386beeca41/kube-rbac-proxy/0.log" May 28 19:02:41.271243 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:41.271202 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfpqj_10fa77b5-edb8-44ff-b606-a49a74ca5ece/dns-node-resolver/0.log" May 28 19:02:41.784426 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:41.784399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8nxk8_f3ba8c98-0c00-437e-a193-4b9632e8933f/node-ca/0.log" May 28 19:02:42.775934 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:42.775904 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d979fcbd5-jnmpz_c4f6a77a-8d61-40d6-af4a-aee0ef86ffea/kube-auth-proxy/0.log" May 28 19:02:43.444937 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:43.444911 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n64wh_4bb02bcb-ad2f-4c42-81e7-9ddf2a5eb1c8/serve-healthcheck-canary/0.log" May 28 19:02:44.038941 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:44.038910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-s4pvh_78dcc4de-c2d6-4392-a8ff-61f410865e78/insights-operator/0.log" May 28 19:02:44.039353 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:44.039029 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-s4pvh_78dcc4de-c2d6-4392-a8ff-61f410865e78/insights-operator/1.log" May 28 19:02:44.119389 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:44.119367 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nhg4_ad3db334-4c54-4763-97da-9ebf8f07971a/kube-rbac-proxy/0.log" May 28 19:02:44.138476 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:44.138453 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nhg4_ad3db334-4c54-4763-97da-9ebf8f07971a/exporter/0.log" May 28 19:02:44.160872 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:44.160846 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nhg4_ad3db334-4c54-4763-97da-9ebf8f07971a/extractor/0.log" May 28 19:02:46.103049 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:46.103025 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-j4trx" May 28 19:02:46.151998 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:46.151964 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666565-wwnpb_13317204-2361-49c6-a27d-4d958e77a47a/cleanup/0.log" May 28 19:02:46.175518 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:46.175492 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-wsnsd_ce9fc1a4-f701-4307-bd0e-f93c4203fc37/cleanup/0.log" May 28 19:02:46.398993 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:46.398958 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-cdqrf_42549edf-6650-4994-8a65-7ebe37a9a86b/manager/0.log" May 28 19:02:47.618453 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:47.618422 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77d4cfb68f-dkmfs_064138d6-cde5-4e7f-85af-fe9428ab8283/manager/0.log" May 28 19:02:52.137347 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:52.137319 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bmk84_642b4c25-a616-4ed4-9515-43ae5f59d167/migrator/0.log" May 28 19:02:52.159311 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:52.159278 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bmk84_642b4c25-a616-4ed4-9515-43ae5f59d167/graceful-termination/0.log" May 28 19:02:52.509108 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:52.508236 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j5w9w_ebb8d950-335d-414d-9427-400d6819d2ce/kube-storage-version-migrator-operator/1.log" May 28 19:02:52.510715 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:52.510685 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j5w9w_ebb8d950-335d-414d-9427-400d6819d2ce/kube-storage-version-migrator-operator/0.log" May 28 19:02:53.463459 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.463432 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4dl65_0af33076-deca-4f21-b0d9-50d8c1b1e792/kube-multus/0.log" May 28 19:02:53.484918 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.484887 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/kube-multus-additional-cni-plugins/0.log" May 28 19:02:53.506875 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.506832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/egress-router-binary-copy/0.log" May 28 19:02:53.525856 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.525833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/cni-plugins/0.log" May 28 19:02:53.545758 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.545726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/bond-cni-plugin/0.log" May 28 19:02:53.565646 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.565604 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/routeoverride-cni/0.log" May 28 19:02:53.588326 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.588288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/whereabouts-cni-bincopy/0.log" May 28 19:02:53.609195 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:53.609166 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k96j5_0614382a-1dd6-4867-a4b0-79639c6a37d7/whereabouts-cni/0.log" May 28 19:02:54.052672 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:54.052648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvgkq_9d44eb9c-d8bc-4686-979b-032afd106b59/network-metrics-daemon/0.log" May 28 19:02:54.069440 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:54.069411 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvgkq_9d44eb9c-d8bc-4686-979b-032afd106b59/kube-rbac-proxy/0.log" May 28 19:02:55.235542 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.235510 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-controller/0.log" May 28 19:02:55.253418 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.253379 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/0.log" May 28 19:02:55.264784 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.264753 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovn-acl-logging/1.log" May 28 19:02:55.286044 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.286016 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/kube-rbac-proxy-node/0.log" May 28 19:02:55.307121 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.307063 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/kube-rbac-proxy-ovn-metrics/0.log" May 28 19:02:55.326658 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.326632 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/northd/0.log" May 28 19:02:55.345826 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.345789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/nbdb/0.log" May 28 19:02:55.366547 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.366524 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/sbdb/0.log" May 28 19:02:55.472571 ip-10-0-137-19 kubenswrapper[2568]: I0528 19:02:55.472540 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm6ld_a784bc4b-ef4b-48f3-9c1d-74f7d9c1c612/ovnkube-controller/0.log"