May 27 21:38:08.011243 ip-10-0-140-70 systemd[1]: Starting Kubernetes Kubelet... May 27 21:38:08.515031 ip-10-0-140-70 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:08.515031 ip-10-0-140-70 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 21:38:08.515031 ip-10-0-140-70 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:08.515031 ip-10-0-140-70 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 21:38:08.515031 ip-10-0-140-70 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:08.516970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.516865 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 21:38:08.522224 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522204 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:08.522224 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522220 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:08.522224 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522225 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:08.522224 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522230 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522233 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522236 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522239 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522242 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522245 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522247 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522250 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522253 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522255 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522258 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522261 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522264 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522266 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522269 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522271 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522274 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522276 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522279 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:08.522379 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522282 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522284 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522287 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522289 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522292 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522294 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522297 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522299 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522305 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522307 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522310 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522312 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522315 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522317 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522320 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522323 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522327 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522330 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522332 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522335 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:08.522843 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522337 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522340 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522342 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522346 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522350 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522353 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522356 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522358 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522361 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522363 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522366 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522368 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522371 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522373 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522376 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522378 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522381 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522384 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522386 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:08.523358 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522389 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522392 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522395 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522397 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522399 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522402 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522404 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522407 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522410 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522413 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522415 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522420 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522422 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522425 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522427 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522430 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522433 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522436 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522439 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522442 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522444 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:08.523839 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522447 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522451 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522454 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.522457 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524240 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524249 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524252 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524255 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524258 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524261 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524264 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524266 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524269 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524271 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524274 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524276 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524278 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524281 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524283 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:08.524355 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524286 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524289 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524291 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524293 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524296 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524298 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524300 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524303 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524305 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524308 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524311 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524313 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524315 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524318 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524321 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524325 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524327 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524330 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524332 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524334 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:08.524833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524337 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524340 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524343 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524345 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524348 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524350 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524353 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524356 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524358 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524361 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524363 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524366 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524368 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524371 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524373 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524376 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524378 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524381 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524383 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:08.525348 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524386 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524388 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524391 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524395 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524399 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524402 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524404 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524407 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524411 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524414 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524417 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524421 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524425 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524428 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524430 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524433 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524436 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524438 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524440 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:08.525806 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524443 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524445 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524448 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524450 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524452 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524454 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524457 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524459 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524462 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524464 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524466 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524468 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.524471 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524541 2555 flags.go:64] FLAG: --address="0.0.0.0" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524548 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524554 2555 flags.go:64] FLAG: --anonymous-auth="true" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524559 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524564 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524567 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524571 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524576 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 21:38:08.526276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524580 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524582 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524586 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524589 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524592 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524595 2555 flags.go:64] FLAG: --cgroup-root="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524598 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524601 2555 flags.go:64] FLAG: --client-ca-file="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524604 2555 flags.go:64] FLAG: --cloud-config="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524607 2555 flags.go:64] FLAG: --cloud-provider="external" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524610 2555 flags.go:64] FLAG: --cluster-dns="[]" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524614 2555 flags.go:64] FLAG: --cluster-domain="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524617 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524620 2555 flags.go:64] FLAG: --config-dir="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524623 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524627 2555 flags.go:64] FLAG: --container-log-max-files="5" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524634 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524638 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524641 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524644 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524647 2555 flags.go:64] FLAG: --contention-profiling="false" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524650 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524653 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524656 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524659 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 21:38:08.526808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524663 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524666 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524669 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524671 2555 flags.go:64] FLAG: --enable-load-reader="false" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524675 2555 flags.go:64] FLAG: --enable-server="true" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524677 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524682 2555 flags.go:64] FLAG: --event-burst="100" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524685 2555 flags.go:64] FLAG: --event-qps="50" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524688 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524691 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524694 2555 flags.go:64] FLAG: --eviction-hard="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524698 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524700 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524703 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524706 2555 flags.go:64] FLAG: --eviction-soft="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524709 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524712 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524714 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524717 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524720 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524722 2555 flags.go:64] FLAG: --fail-swap-on="true" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524725 2555 flags.go:64] FLAG: --feature-gates="" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524729 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524731 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524734 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 21:38:08.527450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524738 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524741 2555 flags.go:64] FLAG: --healthz-port="10248" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524744 2555 flags.go:64] FLAG: --help="false" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524747 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-70.ec2.internal" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524750 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524753 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524755 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524759 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524762 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524765 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524768 2555 flags.go:64] FLAG: --image-service-endpoint="" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524770 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524774 2555 flags.go:64] FLAG: --kube-api-burst="100" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524777 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524780 2555 flags.go:64] FLAG: --kube-api-qps="50" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524783 2555 flags.go:64] FLAG: --kube-reserved="" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524786 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524789 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524792 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524794 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524797 2555 flags.go:64] FLAG: --lock-file="" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524800 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524803 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524806 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 21:38:08.528058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524811 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524813 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524816 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524819 2555 flags.go:64] FLAG: --logging-format="text" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524822 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524825 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524828 2555 flags.go:64] FLAG: --manifest-url="" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524831 2555 flags.go:64] FLAG: --manifest-url-header="" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524835 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524838 2555 flags.go:64] FLAG: --max-open-files="1000000" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524842 2555 flags.go:64] FLAG: --max-pods="110" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524845 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524848 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524851 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524854 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524857 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524860 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524862 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524869 2555 flags.go:64] FLAG: --node-status-max-images="50" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524872 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524875 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524878 2555 flags.go:64] FLAG: --pod-cidr="" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524881 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 21:38:08.528622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524899 2555 flags.go:64] FLAG: --pod-manifest-path="" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524903 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524905 2555 flags.go:64] FLAG: --pods-per-core="0" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524908 2555 flags.go:64] FLAG: --port="10250" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524911 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524914 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca8475bede12b1d9" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524917 2555 flags.go:64] FLAG: --qos-reserved="" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524920 2555 flags.go:64] FLAG: --read-only-port="10255" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524923 2555 flags.go:64] FLAG: --register-node="true" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524926 2555 flags.go:64] FLAG: --register-schedulable="true" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524929 2555 flags.go:64] FLAG: --register-with-taints="" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524933 2555 flags.go:64] FLAG: --registry-burst="10" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524936 2555 flags.go:64] FLAG: --registry-qps="5" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524938 2555 flags.go:64] FLAG: --reserved-cpus="" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524941 2555 flags.go:64] FLAG: --reserved-memory="" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524945 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524948 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524951 2555 flags.go:64] FLAG: --rotate-certificates="false" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524953 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524956 2555 flags.go:64] FLAG: --runonce="false" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524959 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524962 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524965 2555 flags.go:64] FLAG: --seccomp-default="false" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524967 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524970 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524973 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 21:38:08.529218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524976 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524979 2555 flags.go:64] FLAG: --storage-driver-password="root" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524981 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524984 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524987 2555 flags.go:64] FLAG: --storage-driver-user="root" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524991 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524994 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524997 2555 flags.go:64] FLAG: --system-cgroups="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.524999 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525004 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525007 2555 flags.go:64] FLAG: --tls-cert-file="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525009 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525013 2555 flags.go:64] FLAG: --tls-min-version="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525016 2555 flags.go:64] FLAG: --tls-private-key-file="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525019 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525021 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525024 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525027 2555 flags.go:64] FLAG: --v="2" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525031 2555 flags.go:64] FLAG: --version="false" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525035 2555 flags.go:64] FLAG: --vmodule="" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525039 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.525042 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525126 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525129 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:08.529865 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525132 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525135 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525138 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525140 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525143 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525145 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525147 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525150 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525152 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525155 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525157 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525160 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525162 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525165 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525168 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525170 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525173 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525175 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525178 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525180 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:08.530502 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525182 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525185 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525187 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525191 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525194 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525198 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525200 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525203 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525208 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525211 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525213 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525216 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525219 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525221 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525224 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525227 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525230 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525232 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525234 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:08.531015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525237 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525239 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525242 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525245 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525247 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525249 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525252 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525254 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525257 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525261 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525265 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525267 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525270 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525272 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525275 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525277 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525280 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525282 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525284 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525287 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:08.531478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525289 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525296 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525298 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525301 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525307 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525310 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525312 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525315 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525317 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525320 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525323 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525325 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525328 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525330 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525333 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525335 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525337 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525340 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525342 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:08.532000 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525345 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525347 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525350 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525353 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525355 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.525358 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:08.532457 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.526138 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:08.532841 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.532820 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 21:38:08.532874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.532842 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 21:38:08.532918 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532902 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:08.532918 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532907 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:08.532918 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532911 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:08.532918 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532914 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:08.532918 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532917 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532922 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532926 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532929 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532932 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532935 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532938 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532941 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532943 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532946 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532948 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532951 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532953 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532956 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532958 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532961 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532963 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532966 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532970 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:08.533050 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532974 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532976 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532979 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532981 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532984 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532987 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532989 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532992 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532995 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.532998 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533000 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533002 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533005 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533007 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533010 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533013 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533016 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533019 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533021 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:08.533520 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533023 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533026 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533028 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533031 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533033 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533036 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533038 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533041 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533043 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533046 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533048 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533050 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533053 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533056 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533058 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533061 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533063 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533066 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533069 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533071 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:08.533992 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533074 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533076 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533082 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533085 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533088 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533090 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533093 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533095 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533099 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533102 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533104 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533107 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533110 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533112 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533115 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533117 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533120 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533122 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533125 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533128 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:08.534485 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533130 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533133 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533135 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533137 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.533142 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533234 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533238 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533242 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533245 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533247 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533250 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533252 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533254 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533258 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533262 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:08.534986 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533269 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533272 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533274 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533277 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533280 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533283 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533286 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533288 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533291 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533293 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533296 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533298 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533301 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533303 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533305 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533308 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533311 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533313 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533315 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533318 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:08.535352 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533320 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533322 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533325 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533327 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533330 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533332 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533335 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533337 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533340 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533342 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533345 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533347 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533349 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533352 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533355 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533357 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533360 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533362 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533365 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533367 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:08.535837 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533369 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533372 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533374 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533377 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533379 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533381 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533384 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533386 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533389 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533391 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533394 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533396 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533398 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533401 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533403 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533407 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533411 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533413 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533415 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:08.536336 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533418 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533420 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533423 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533425 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533427 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533430 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533432 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533435 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533437 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533440 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533442 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533445 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533447 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533449 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533452 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533454 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:08.536787 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:08.533456 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:08.537343 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.533461 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:08.537343 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.534273 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 27 21:38:08.537343 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.537314 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 21:38:08.538404 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.538393 2555 server.go:1019] "Starting client certificate rotation" May 27 21:38:08.538512 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.538495 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:38:08.539531 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.539519 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:38:08.566389 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.566375 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:38:08.569620 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.569500 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:38:08.583203 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.583153 2555 log.go:25] "Validated CRI v1 runtime API" May 27 21:38:08.589453 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.589438 2555 log.go:25] "Validated CRI v1 image API" May 27 21:38:08.591933 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.591915 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 21:38:08.597302 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.597281 2555 fs.go:135] Filesystem UUIDs: map[3b8b82f0-0cc5-49ea-8a23-ce8dd18da0ef:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cd88ceac-0d54-444c-a797-7a58c3002fcd:/dev/nvme0n1p4] May 27 21:38:08.597351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.597303 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 21:38:08.601685 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.601572 2555 manager.go:217] Machine: {Timestamp:2026-05-27 21:38:08.601095079 +0000 UTC m=+0.456165951 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099178 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b6e3a1498080d83661a2f7293816 SystemUUID:ec25b6e3-a149-8080-d836-61a2f7293816 BootID:f1a2e0ec-32ef-4524-b763-da42b0eeb010 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:92:55:c9:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:92:55:c9:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:60:f1:79:2a:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 21:38:08.602752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.602608 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 21:38:08.602884 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.602868 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 21:38:08.605148 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.605125 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 21:38:08.605275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.605151 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 21:38:08.605317 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.605284 2555 topology_manager.go:138] "Creating topology manager with none policy" May 27 21:38:08.605317 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.605292 2555 container_manager_linux.go:306] "Creating device plugin manager" May 27 21:38:08.605317 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.605299 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:38:08.607096 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.607086 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:38:08.609511 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.609500 2555 state_mem.go:36] "Initialized new in-memory state store" May 27 21:38:08.609625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.609615 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 21:38:08.612439 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.612430 2555 kubelet.go:491] "Attempting to sync node with API server" May 27 21:38:08.612477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.612444 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 21:38:08.612477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.612455 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 21:38:08.612477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.612464 2555 kubelet.go:397] "Adding apiserver pod source" May 27 21:38:08.612477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.612473 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 21:38:08.613642 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.613630 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:38:08.613683 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.613648 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:38:08.614083 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.614062 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:38:08.624094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.624080 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 21:38:08.626438 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.626423 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 21:38:08.627365 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627352 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627372 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627381 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627389 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627400 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627409 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627419 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627428 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627437 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 21:38:08.627445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627445 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 21:38:08.627719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627458 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 21:38:08.627874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.627863 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 21:38:08.628924 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.628913 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 21:38:08.628984 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.628927 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 21:38:08.637297 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637278 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 21:38:08.637391 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637303 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 21:38:08.637391 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637345 2555 server.go:1295] "Started kubelet" May 27 21:38:08.637520 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.637495 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 21:38:08.637590 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637549 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 21:38:08.637633 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637608 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 21:38:08.637934 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.637911 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 21:38:08.638015 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.637946 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 21:38:08.638043 ip-10-0-140-70 systemd[1]: Started Kubernetes Kubelet. May 27 21:38:08.639308 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.639294 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 21:38:08.639938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.639927 2555 server.go:317] "Adding debug handlers to kubelet server" May 27 21:38:08.646730 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.645703 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18b389e3a99720a7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-05-27 21:38:08.637313191 +0000 UTC m=+0.492384064,LastTimestamp:2026-05-27 21:38:08.637313191 +0000 UTC m=+0.492384064,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}" May 27 21:38:08.649924 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.649883 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 21:38:08.650019 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650007 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 21:38:08.650657 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650626 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 21:38:08.650751 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650736 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 21:38:08.650751 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650752 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 21:38:08.650877 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650865 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 21:38:08.650945 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650929 2555 reconstruct.go:97] "Volume reconstruction finished" May 27 21:38:08.650945 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.650936 2555 reconciler.go:26] "Reconciler: start to sync state" May 27 21:38:08.651339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651322 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 21:38:08.651339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651338 2555 factory.go:55] Registering systemd factory May 27 21:38:08.651438 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651347 2555 factory.go:223] Registration of the systemd container factory successfully May 27 21:38:08.651562 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651542 2555 factory.go:153] Registering CRI-O factory May 27 21:38:08.651562 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651562 2555 factory.go:223] Registration of the crio container factory successfully May 27 21:38:08.651712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651583 2555 factory.go:103] Registering Raw factory May 27 21:38:08.651712 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.651581 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:08.651712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651596 2555 manager.go:1196] Started watching for new ooms in manager May 27 21:38:08.651989 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.651971 2555 manager.go:319] Starting recovery of all containers May 27 21:38:08.662026 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.662011 2555 manager.go:324] Recovery completed May 27 21:38:08.663998 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.663974 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 21:38:08.664080 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.664026 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 21:38:08.666673 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.666656 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.668312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668296 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.668394 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668328 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.668394 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668345 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.668802 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668788 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 21:38:08.668844 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668802 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 21:38:08.668844 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.668820 2555 state_mem.go:36] "Initialized new in-memory state store" May 27 21:38:08.672451 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.672436 2555 policy_none.go:49] "None policy: Start" May 27 21:38:08.672451 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.672454 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 21:38:08.672541 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.672464 2555 state_mem.go:35] "Initializing new in-memory state store" May 27 21:38:08.677579 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.677512 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18b389e3ab7022e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-05-27 21:38:08.668312297 +0000 UTC m=+0.523383174,LastTimestamp:2026-05-27 21:38:08.668312297 +0000 UTC m=+0.523383174,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}" May 27 21:38:08.682849 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.682831 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpv48" May 27 21:38:08.688879 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.688862 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpv48" May 27 21:38:08.690790 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.690728 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18b389e3ab707dcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-05-27 21:38:08.668335567 +0000 UTC m=+0.523406439,LastTimestamp:2026-05-27 21:38:08.668335567 +0000 UTC m=+0.523406439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}" May 27 21:38:08.713449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.713433 2555 manager.go:341] "Starting Device Plugin manager" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.713469 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.713482 2555 server.go:85] "Starting device plugin registration server" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.713697 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.713707 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.714254 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.714331 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.714339 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.714715 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 21:38:08.734827 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.714748 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:08.750625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.750598 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 21:38:08.751859 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.751842 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 21:38:08.751954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.751872 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 21:38:08.751954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.751904 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 21:38:08.751954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.751913 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 27 21:38:08.752074 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.751985 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 21:38:08.757281 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.757262 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:08.814979 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.814921 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.817097 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.817080 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.817185 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.817112 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.817185 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.817127 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.817185 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.817153 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-70.ec2.internal" May 27 21:38:08.830506 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.830488 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-70.ec2.internal" May 27 21:38:08.830550 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.830511 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-70.ec2.internal\": node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:08.848015 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.847998 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:08.852330 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.852303 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"] May 27 21:38:08.852375 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.852368 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.853091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.853075 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.853163 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.853102 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.853163 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.853112 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.854279 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854267 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.854431 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854418 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:08.854469 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854446 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.854906 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854876 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.854961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854876 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.854961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854920 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.854961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854930 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.854961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854934 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.854961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.854945 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.856535 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.856521 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:08.856591 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.856545 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:08.857137 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.857124 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:08.857212 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.857154 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:08.857212 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:08.857165 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:08.869414 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.869390 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal" May 27 21:38:08.872631 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.872617 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal" May 27 21:38:08.948485 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:08.948466 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.049565 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.049540 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.051765 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.051750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.051858 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.051781 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.051858 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.051808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03aa378766e5aa14d378fa47bd1c4273-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"03aa378766e5aa14d378fa47bd1c4273\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:09.150143 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.150085 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.152283 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152271 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.152332 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152291 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.152332 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152311 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03aa378766e5aa14d378fa47bd1c4273-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"03aa378766e5aa14d378fa47bd1c4273\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:09.152429 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03aa378766e5aa14d378fa47bd1c4273-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"03aa378766e5aa14d378fa47bd1c4273\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:09.152429 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152368 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.152429 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.152390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d758af17a837fb8c91bde5337f780fb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"d758af17a837fb8c91bde5337f780fb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.172412 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.172384 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.175117 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.175098 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:09.250781 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.250756 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.351146 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.351122 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.451546 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.451489 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.537861 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.537835 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 21:38:09.538422 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.537979 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:38:09.552103 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.552081 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found" May 27 21:38:09.574220 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.574198 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:09.613016 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.612991 2555 apiserver.go:52] "Watching apiserver" May 27 21:38:09.621577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.621558 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 21:38:09.621879 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.621860 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-kthvr","openshift-dns/node-resolver-8fkdc","openshift-image-registry/node-ca-6qf9h","openshift-multus/multus-r8fxp","openshift-network-diagnostics/network-check-target-2mk6t","openshift-network-operator/iptables-alerter-5hj7d","openshift-ovn-kubernetes/ovnkube-node-j7fvn","kube-system/konnectivity-agent-kkwqp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww","openshift-cluster-node-tuning-operator/tuned-c5gc9","openshift-multus/multus-additional-cni-plugins-h86vc"] May 27 21:38:09.626270 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.626250 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.626375 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.626354 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.626432 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.626340 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:09.628263 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.628244 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.630134 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.630109 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 21:38:09.630236 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.630116 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.630957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.630934 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 21:38:09.631066 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.631006 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 21:38:09.631066 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.631036 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4lw6s\"" May 27 21:38:09.631174 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.631037 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 21:38:09.631174 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.631104 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 21:38:09.632480 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.632466 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.633154 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.633134 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 21:38:09.634598 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.634582 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r8fxp" May 27 21:38:09.634819 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.634798 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 21:38:09.634928 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.634828 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635094 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z2f79\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635210 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635250 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635267 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635286 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nx5qm\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635286 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635332 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2zm8\"" May 27 21:38:09.635551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.635214 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 21:38:09.637388 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.637262 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:09.637388 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.637339 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:09.638519 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.638500 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 21:38:09.638734 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.638720 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tbxm5\"" May 27 21:38:09.638794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.638736 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 21:38:09.639091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.638879 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 21:38:09.639091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.638964 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 21:38:09.640744 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.640523 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.642656 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.642639 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.644760 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.644742 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.645524 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.645509 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xmj65\"" May 27 21:38:09.645881 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.645864 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:09.645982 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.645928 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 21:38:09.646019 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.646012 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 21:38:09.646307 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.646292 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 21:38:09.646339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.646324 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vngpc\"" May 27 21:38:09.646800 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.646783 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.647680 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.647659 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 21:38:09.647771 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.647722 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 21:38:09.647811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.647783 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 21:38:09.647861 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.647848 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 21:38:09.647922 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.647905 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dtlzm\"" May 27 21:38:09.650090 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.650074 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 21:38:09.650486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.650458 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 21:38:09.650782 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.650767 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" May 27 21:38:09.650853 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.650796 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 21:38:09.650925 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.650866 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-596tc\"" May 27 21:38:09.651857 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.651841 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-log-socket\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-kubelet\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654854 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654878 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-binary-copy\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.654947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-slash\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.654986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgmtl\" (UniqueName: \"kubernetes.io/projected/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kube-api-access-qgmtl\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b22kk\" (UniqueName: \"kubernetes.io/projected/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-kube-api-access-b22kk\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-bin\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovn-node-metrics-cert\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-cni-binary-copy\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-multus-daemon-config\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-node-log\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5l2\" (UniqueName: \"kubernetes.io/projected/3e622ca2-38bb-4876-a548-76c5495472d5-kube-api-access-bk5l2\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b682f0e-f601-41c4-a7d0-084017d6842c-serviceca\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.655280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655279 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-multus-certs\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655311 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hznx\" (UniqueName: \"kubernetes.io/projected/19135a59-0056-4302-a17b-3a376afb0beb-kube-api-access-4hznx\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3127c91-bc61-488f-9396-e68f583a06dc-konnectivity-ca\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e622ca2-38bb-4876-a548-76c5495472d5-host-slash\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-cnibin\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655406 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655438 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysconfig\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-lib-modules\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-tuned\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-bin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-systemd-units\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-var-lib-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-env-overrides\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-run\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-var-lib-kubelet\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.655938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655727 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e622ca2-38bb-4876-a548-76c5495472d5-iptables-alerter-script\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-system-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-hostroot\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-kubernetes\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-device-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655852 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7356e278-b295-4dab-a59b-156c0e47aaeb-tmp-dir\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkfn\" (UniqueName: \"kubernetes.io/projected/3b682f0e-f601-41c4-a7d0-084017d6842c-kube-api-access-gjkfn\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-cnibin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.655975 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-config\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-systemd\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656028 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-os-release\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-netns\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656117 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-etc-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-sys\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b682f0e-f601-41c4-a7d0-084017d6842c-host\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.656773 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3127c91-bc61-488f-9396-e68f583a06dc-agent-certs\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-systemd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-ovn\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-netd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-modprobe-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7356e278-b295-4dab-a59b-156c0e47aaeb-hosts-file\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-conf-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssx74\" (UniqueName: \"kubernetes.io/projected/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-kube-api-access-ssx74\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnn7d\" (UniqueName: \"kubernetes.io/projected/07a02c27-6211-4b29-a358-6a6ecf9150f6-kube-api-access-jnn7d\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-tmp\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-multus\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-kubelet\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8t4\" (UniqueName: \"kubernetes.io/projected/7ba72d86-930d-4230-a503-2e33a9c98cf2-kube-api-access-6t8t4\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-script-lib\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-os-release\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-socket-dir-parent\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-netns\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-conf\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmdl\" (UniqueName: \"kubernetes.io/projected/7356e278-b295-4dab-a59b-156c0e47aaeb-kube-api-access-6gmdl\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-k8s-cni-cncf-io\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-system-cni-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-host\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-etc-kubernetes\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.657995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.656918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.661775 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.661754 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:38:09.666045 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.666027 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"] May 27 21:38:09.667562 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.667549 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:38:09.667626 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.667616 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" May 27 21:38:09.677467 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.677437 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:38:09.678259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.678242 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"] May 27 21:38:09.687312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.687294 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m5fjk" May 27 21:38:09.691047 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.691026 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:33:08 +0000 UTC" deadline="2027-11-05 09:27:08.995253245 +0000 UTC" May 27 21:38:09.691047 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.691046 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12635h48m59.304209464s" May 27 21:38:09.696255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.696241 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m5fjk" May 27 21:38:09.753282 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.753085 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd758af17a837fb8c91bde5337f780fb6.slice/crio-4dd8fc41370134316f7dfa31bd39d9ac6ed04aee5a68ca6b7ace4edfd953be1d WatchSource:0}: Error finding container 4dd8fc41370134316f7dfa31bd39d9ac6ed04aee5a68ca6b7ace4edfd953be1d: Status 404 returned error can't find the container with id 4dd8fc41370134316f7dfa31bd39d9ac6ed04aee5a68ca6b7ace4edfd953be1d May 27 21:38:09.753478 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.753460 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03aa378766e5aa14d378fa47bd1c4273.slice/crio-603ee4ec635262728a1f0a2092bc1a164b8713160d63761b2926f1bfaa04c45b WatchSource:0}: Error finding container 603ee4ec635262728a1f0a2092bc1a164b8713160d63761b2926f1bfaa04c45b: Status 404 returned error can't find the container with id 603ee4ec635262728a1f0a2092bc1a164b8713160d63761b2926f1bfaa04c45b May 27 21:38:09.757457 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757438 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:38:09.757508 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757484 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b22kk\" (UniqueName: \"kubernetes.io/projected/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-kube-api-access-b22kk\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.757537 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757521 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.757679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757660 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-bin\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.757733 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757698 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovn-node-metrics-cert\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.757733 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.757827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757747 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.757827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757769 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-cni-binary-copy\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.757827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757779 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-bin\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.757827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757793 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-multus-daemon-config\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.757827 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757818 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-node-log\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5l2\" (UniqueName: \"kubernetes.io/projected/3e622ca2-38bb-4876-a548-76c5495472d5-kube-api-access-bk5l2\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757866 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b682f0e-f601-41c4-a7d0-084017d6842c-serviceca\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757909 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-multus-certs\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hznx\" (UniqueName: \"kubernetes.io/projected/19135a59-0056-4302-a17b-3a376afb0beb-kube-api-access-4hznx\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-node-log\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757959 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3127c91-bc61-488f-9396-e68f583a06dc-konnectivity-ca\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.757983 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e622ca2-38bb-4876-a548-76c5495472d5-host-slash\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758006 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-cnibin\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758020 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758031 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758054 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysconfig\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758074 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-lib-modules\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758096 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-tuned\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758119 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-bin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758145 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:09.758780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758169 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-systemd-units\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758196 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-var-lib-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758220 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-env-overrides\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758243 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-run\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758259 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysconfig\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758268 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-var-lib-kubelet\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758293 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e622ca2-38bb-4876-a548-76c5495472d5-iptables-alerter-script\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-multus-certs\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758334 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-system-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758358 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-hostroot\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758379 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-kubernetes\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b682f0e-f601-41c4-a7d0-084017d6842c-serviceca\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-multus-daemon-config\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758401 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-device-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758450 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19135a59-0056-4302-a17b-3a376afb0beb-cni-binary-copy\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758444 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-device-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758474 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7356e278-b295-4dab-a59b-156c0e47aaeb-tmp-dir\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758506 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-cnibin\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.761712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758537 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-systemd-units\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758636 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-lib-modules\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-system-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758795 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e622ca2-38bb-4876-a548-76c5495472d5-iptables-alerter-script\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-hostroot\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758169 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-var-lib-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-kubernetes\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758514 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkfn\" (UniqueName: \"kubernetes.io/projected/3b682f0e-f601-41c4-a7d0-084017d6842c-kube-api-access-gjkfn\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758958 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-cnibin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758984 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-config\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.758995 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3127c91-bc61-488f-9396-e68f583a06dc-konnectivity-ca\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759008 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-systemd\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759034 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-os-release\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e622ca2-38bb-4876-a548-76c5495472d5-host-slash\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759059 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.762574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759083 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-netns\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759105 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-etc-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759123 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-sys\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759146 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b682f0e-f601-41c4-a7d0-084017d6842c-host\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759168 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3127c91-bc61-488f-9396-e68f583a06dc-agent-certs\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759192 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-systemd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759197 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7356e278-b295-4dab-a59b-156c0e47aaeb-tmp-dir\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759216 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-ovn\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759242 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-netd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759267 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-modprobe-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759316 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7356e278-b295-4dab-a59b-156c0e47aaeb-hosts-file\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759342 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-conf-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759366 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssx74\" (UniqueName: \"kubernetes.io/projected/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-kube-api-access-ssx74\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759374 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-run\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759395 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnn7d\" (UniqueName: \"kubernetes.io/projected/07a02c27-6211-4b29-a358-6a6ecf9150f6-kube-api-access-jnn7d\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759419 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-tmp\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-env-overrides\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.763351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759470 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-multus\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759488 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-bin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759494 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759498 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-cni-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759527 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-kubelet\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-ovn\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759551 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8t4\" (UniqueName: \"kubernetes.io/projected/7ba72d86-930d-4230-a503-2e33a9c98cf2-kube-api-access-6t8t4\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759577 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-script-lib\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-os-release\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759617 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-socket-dir-parent\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759636 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-netns\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-cni-netd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759681 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-conf\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmdl\" (UniqueName: \"kubernetes.io/projected/7356e278-b295-4dab-a59b-156c0e47aaeb-kube-api-access-6gmdl\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759751 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-k8s-cni-cncf-io\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-conf\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.764130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759779 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-system-cni-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-host\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-etc-kubernetes\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759919 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-config\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759950 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759979 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-log-socket\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-systemd\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760007 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-kubelet\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760031 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760054 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-binary-copy\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760079 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-os-release\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760083 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-slash\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.760166 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760168 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmtl\" (UniqueName: \"kubernetes.io/projected/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kube-api-access-qgmtl\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.764795 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.760247 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:10.260199915 +0000 UTC m=+2.115270794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-modprobe-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7356e278-b295-4dab-a59b-156c0e47aaeb-hosts-file\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-conf-dir\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760455 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-netns\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-etc-openvswitch\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-system-cni-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760532 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-host\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-etc-kubernetes\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-sys\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b682f0e-f601-41c4-a7d0-084017d6842c-host\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-run-systemd\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760657 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-slash\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ba72d86-930d-4230-a503-2e33a9c98cf2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760739 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-sysctl-d\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-log-socket\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-kubelet\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovnkube-script-lib\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-k8s-cni-cncf-io\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760954 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.760959 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-kubelet\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.759444 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-var-lib-kubelet\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761095 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59c5cc0-287f-4864-b5be-4a1c01c0417d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-run-netns\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761153 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-multus-socket-dir-parent\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761207 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07a02c27-6211-4b29-a358-6a6ecf9150f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-os-release\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761248 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-host-var-lib-cni-multus\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19135a59-0056-4302-a17b-3a376afb0beb-cnibin\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07a02c27-6211-4b29-a358-6a6ecf9150f6-ovn-node-metrics-cert\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ba72d86-930d-4230-a503-2e33a9c98cf2-cni-binary-copy\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.761826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-etc-tuned\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.762257 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-tmp\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.765764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.763326 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3127c91-bc61-488f-9396-e68f583a06dc-agent-certs\") pod \"konnectivity-agent-kkwqp\" (UID: \"e3127c91-bc61-488f-9396-e68f583a06dc\") " pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:09.770881 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.770864 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:09.771036 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.770883 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:09.771036 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.770967 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:09.771036 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:09.771030 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:10.271017199 +0000 UTC m=+2.126088062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:09.773341 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.773291 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hznx\" (UniqueName: \"kubernetes.io/projected/19135a59-0056-4302-a17b-3a376afb0beb-kube-api-access-4hznx\") pod \"multus-r8fxp\" (UID: \"19135a59-0056-4302-a17b-3a376afb0beb\") " pod="openshift-multus/multus-r8fxp" May 27 21:38:09.773697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.773676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b22kk\" (UniqueName: \"kubernetes.io/projected/0cf31f56-e4bb-42b5-ae79-de0d34cd474a-kube-api-access-b22kk\") pod \"tuned-c5gc9\" (UID: \"0cf31f56-e4bb-42b5-ae79-de0d34cd474a\") " pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.773905 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.773867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5l2\" (UniqueName: \"kubernetes.io/projected/3e622ca2-38bb-4876-a548-76c5495472d5-kube-api-access-bk5l2\") pod \"iptables-alerter-5hj7d\" (UID: \"3e622ca2-38bb-4876-a548-76c5495472d5\") " pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:09.773972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.773919 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmdl\" (UniqueName: \"kubernetes.io/projected/7356e278-b295-4dab-a59b-156c0e47aaeb-kube-api-access-6gmdl\") pod \"node-resolver-8fkdc\" (UID: \"7356e278-b295-4dab-a59b-156c0e47aaeb\") " pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.774313 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.774289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkfn\" (UniqueName: \"kubernetes.io/projected/3b682f0e-f601-41c4-a7d0-084017d6842c-kube-api-access-gjkfn\") pod \"node-ca-6qf9h\" (UID: \"3b682f0e-f601-41c4-a7d0-084017d6842c\") " pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.774992 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.774966 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssx74\" (UniqueName: \"kubernetes.io/projected/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-kube-api-access-ssx74\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:09.775090 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.775069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnn7d\" (UniqueName: \"kubernetes.io/projected/07a02c27-6211-4b29-a358-6a6ecf9150f6-kube-api-access-jnn7d\") pod \"ovnkube-node-j7fvn\" (UID: \"07a02c27-6211-4b29-a358-6a6ecf9150f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.775274 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.775255 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8t4\" (UniqueName: \"kubernetes.io/projected/7ba72d86-930d-4230-a503-2e33a9c98cf2-kube-api-access-6t8t4\") pod \"multus-additional-cni-plugins-h86vc\" (UID: \"7ba72d86-930d-4230-a503-2e33a9c98cf2\") " pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:09.775439 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.775423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgmtl\" (UniqueName: \"kubernetes.io/projected/a59c5cc0-287f-4864-b5be-4a1c01c0417d-kube-api-access-qgmtl\") pod \"aws-ebs-csi-driver-node-s8nww\" (UID: \"a59c5cc0-287f-4864-b5be-4a1c01c0417d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:09.952337 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.952313 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8fkdc" May 27 21:38:09.958811 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.958789 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7356e278_b295_4dab_a59b_156c0e47aaeb.slice/crio-2db073b06970385f9bdc686802cb93e89609eb20ac024a08bf1aa86d94a2ee56 WatchSource:0}: Error finding container 2db073b06970385f9bdc686802cb93e89609eb20ac024a08bf1aa86d94a2ee56: Status 404 returned error can't find the container with id 2db073b06970385f9bdc686802cb93e89609eb20ac024a08bf1aa86d94a2ee56 May 27 21:38:09.961746 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.961726 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:09.966298 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.966281 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" May 27 21:38:09.967526 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.967504 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a02c27_6211_4b29_a358_6a6ecf9150f6.slice/crio-cb26fe4ae427be6eaabb6e4fb12de8f4f0c222be4b961fb8418c87de77ddd429 WatchSource:0}: Error finding container cb26fe4ae427be6eaabb6e4fb12de8f4f0c222be4b961fb8418c87de77ddd429: Status 404 returned error can't find the container with id cb26fe4ae427be6eaabb6e4fb12de8f4f0c222be4b961fb8418c87de77ddd429 May 27 21:38:09.972207 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.972178 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf31f56_e4bb_42b5_ae79_de0d34cd474a.slice/crio-c7ce69e7f1d7e9f14cf6971186d6b8cbc61dd84a6a79fde0b78c636f3fa5ecf5 WatchSource:0}: Error finding container c7ce69e7f1d7e9f14cf6971186d6b8cbc61dd84a6a79fde0b78c636f3fa5ecf5: Status 404 returned error can't find the container with id c7ce69e7f1d7e9f14cf6971186d6b8cbc61dd84a6a79fde0b78c636f3fa5ecf5 May 27 21:38:09.980172 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:09.980154 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qf9h" May 27 21:38:09.986618 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:09.986595 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b682f0e_f601_41c4_a7d0_084017d6842c.slice/crio-e9468683a16f146308072370c4e6b23908022fd272d7b67c9e26fb4fdd3444ee WatchSource:0}: Error finding container e9468683a16f146308072370c4e6b23908022fd272d7b67c9e26fb4fdd3444ee: Status 404 returned error can't find the container with id e9468683a16f146308072370c4e6b23908022fd272d7b67c9e26fb4fdd3444ee May 27 21:38:10.005985 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.005963 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r8fxp" May 27 21:38:10.011701 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:10.011681 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19135a59_0056_4302_a17b_3a376afb0beb.slice/crio-1005a26339273d88d976b823cef2c05dee81375b6c2c1faf2ef08755b5c63df9 WatchSource:0}: Error finding container 1005a26339273d88d976b823cef2c05dee81375b6c2c1faf2ef08755b5c63df9: Status 404 returned error can't find the container with id 1005a26339273d88d976b823cef2c05dee81375b6c2c1faf2ef08755b5c63df9 May 27 21:38:10.012174 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.012158 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hj7d" May 27 21:38:10.017732 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:10.017709 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e622ca2_38bb_4876_a548_76c5495472d5.slice/crio-dcf4ac12e4ca707991d36fb577698b03769d42a82cea0ddf9cec0c54cb1bd301 WatchSource:0}: Error finding container dcf4ac12e4ca707991d36fb577698b03769d42a82cea0ddf9cec0c54cb1bd301: Status 404 returned error can't find the container with id dcf4ac12e4ca707991d36fb577698b03769d42a82cea0ddf9cec0c54cb1bd301 May 27 21:38:10.031775 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.031755 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:10.037337 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:10.037318 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3127c91_bc61_488f_9396_e68f583a06dc.slice/crio-fed84d7153010b3eab0659c36168cc4f9ce0e37525276daaeac13be9a8f7fb61 WatchSource:0}: Error finding container fed84d7153010b3eab0659c36168cc4f9ce0e37525276daaeac13be9a8f7fb61: Status 404 returned error can't find the container with id fed84d7153010b3eab0659c36168cc4f9ce0e37525276daaeac13be9a8f7fb61 May 27 21:38:10.059586 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.059569 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" May 27 21:38:10.065821 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:10.065795 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59c5cc0_287f_4864_b5be_4a1c01c0417d.slice/crio-a412268b61d9b14d832fba1c254c4caeef775342a2ccbf3405de79875e0f32fe WatchSource:0}: Error finding container a412268b61d9b14d832fba1c254c4caeef775342a2ccbf3405de79875e0f32fe: Status 404 returned error can't find the container with id a412268b61d9b14d832fba1c254c4caeef775342a2ccbf3405de79875e0f32fe May 27 21:38:10.069577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.069561 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h86vc" May 27 21:38:10.075263 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:10.075241 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba72d86_930d_4230_a503_2e33a9c98cf2.slice/crio-1dd4fedac898ccb37f2c34f24d37c5850d66d20ec0c6db291c24d39939617544 WatchSource:0}: Error finding container 1dd4fedac898ccb37f2c34f24d37c5850d66d20ec0c6db291c24d39939617544: Status 404 returned error can't find the container with id 1dd4fedac898ccb37f2c34f24d37c5850d66d20ec0c6db291c24d39939617544 May 27 21:38:10.155297 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.155261 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:10.167409 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.166512 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:10.263679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.263602 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:10.263833 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.263773 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:10.263833 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.263833 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:11.263814288 +0000 UTC m=+3.118885153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:10.364624 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.364588 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:10.364794 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.364743 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:10.364794 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.364760 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:10.364794 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.364772 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:10.364967 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.364826 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:11.364808519 +0000 UTC m=+3.219879384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:10.697916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.697764 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:33:09 +0000 UTC" deadline="2028-03-02 13:01:54.649954658 +0000 UTC" May 27 21:38:10.697916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.697802 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15471h23m43.952156432s" May 27 21:38:10.756225 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.755294 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:10.756225 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.755589 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:10.756225 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.756052 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:10.756225 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:10.756153 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:10.767813 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.767748 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hj7d" event={"ID":"3e622ca2-38bb-4876-a548-76c5495472d5","Type":"ContainerStarted","Data":"dcf4ac12e4ca707991d36fb577698b03769d42a82cea0ddf9cec0c54cb1bd301"} May 27 21:38:10.773461 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.773429 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r8fxp" event={"ID":"19135a59-0056-4302-a17b-3a376afb0beb","Type":"ContainerStarted","Data":"1005a26339273d88d976b823cef2c05dee81375b6c2c1faf2ef08755b5c63df9"} May 27 21:38:10.791960 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.791841 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qf9h" event={"ID":"3b682f0e-f601-41c4-a7d0-084017d6842c","Type":"ContainerStarted","Data":"e9468683a16f146308072370c4e6b23908022fd272d7b67c9e26fb4fdd3444ee"} May 27 21:38:10.794359 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.794329 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"d758af17a837fb8c91bde5337f780fb6","Type":"ContainerStarted","Data":"4dd8fc41370134316f7dfa31bd39d9ac6ed04aee5a68ca6b7ace4edfd953be1d"} May 27 21:38:10.795729 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.795702 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerStarted","Data":"1dd4fedac898ccb37f2c34f24d37c5850d66d20ec0c6db291c24d39939617544"} May 27 21:38:10.798782 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.798727 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" event={"ID":"a59c5cc0-287f-4864-b5be-4a1c01c0417d","Type":"ContainerStarted","Data":"a412268b61d9b14d832fba1c254c4caeef775342a2ccbf3405de79875e0f32fe"} May 27 21:38:10.804761 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.804731 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkwqp" event={"ID":"e3127c91-bc61-488f-9396-e68f583a06dc","Type":"ContainerStarted","Data":"fed84d7153010b3eab0659c36168cc4f9ce0e37525276daaeac13be9a8f7fb61"} May 27 21:38:10.819170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.819142 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" event={"ID":"0cf31f56-e4bb-42b5-ae79-de0d34cd474a","Type":"ContainerStarted","Data":"c7ce69e7f1d7e9f14cf6971186d6b8cbc61dd84a6a79fde0b78c636f3fa5ecf5"} May 27 21:38:10.830271 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.830081 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:10.837319 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.837295 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"cb26fe4ae427be6eaabb6e4fb12de8f4f0c222be4b961fb8418c87de77ddd429"} May 27 21:38:10.841733 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.841709 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fkdc" event={"ID":"7356e278-b295-4dab-a59b-156c0e47aaeb","Type":"ContainerStarted","Data":"2db073b06970385f9bdc686802cb93e89609eb20ac024a08bf1aa86d94a2ee56"} May 27 21:38:10.852116 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:10.852091 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"03aa378766e5aa14d378fa47bd1c4273","Type":"ContainerStarted","Data":"603ee4ec635262728a1f0a2092bc1a164b8713160d63761b2926f1bfaa04c45b"} May 27 21:38:11.271520 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:11.271479 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:11.271688 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.271648 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:11.271761 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.271708 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:13.271690701 +0000 UTC m=+5.126761578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:11.372868 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:11.372269 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:11.372868 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.372457 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:11.372868 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.372475 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:11.372868 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.372487 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:11.372868 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:11.372544 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:13.372525136 +0000 UTC m=+5.227596020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:11.700124 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:11.700039 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:33:09 +0000 UTC" deadline="2027-10-31 10:46:18.067376395 +0000 UTC" May 27 21:38:11.700124 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:11.700076 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12517h8m6.367303328s" May 27 21:38:12.754521 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:12.754052 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:12.754521 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:12.754073 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:12.754521 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:12.754177 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:12.754521 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:12.754328 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:13.288674 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:13.288634 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:13.288860 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.288804 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:13.288949 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.288865 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:17.288846681 +0000 UTC m=+9.143917540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:13.389218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:13.389157 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:13.389396 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.389366 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:13.389396 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.389386 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:13.389535 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.389400 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:13.389535 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:13.389457 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:17.389437631 +0000 UTC m=+9.244508497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:14.753906 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:14.753356 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:14.753906 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:14.753475 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:14.756697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:14.754953 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:14.756697 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:14.755089 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:16.390101 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.390069 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gwgnw"] May 27 21:38:16.394145 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.394120 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.394279 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:16.394190 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:16.411264 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.411225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-dbus\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.411377 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.411281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.411377 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.411318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-kubelet-config\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.512529 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.512492 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-kubelet-config\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.512678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.512595 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-dbus\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.512678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.512625 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.512820 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:16.512737 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:16.512820 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:16.512793 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:17.012775596 +0000 UTC m=+8.867846460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:16.513053 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.513033 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-kubelet-config\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.513127 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.513102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6ddb62-9360-49e6-a006-bb42108963e1-dbus\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:16.753101 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.753068 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:16.753290 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:16.753210 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:16.753528 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:16.753510 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:16.753617 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:16.753575 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:17.017210 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:17.016641 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:17.017210 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.016802 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:17.017210 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.016866 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:18.016852303 +0000 UTC m=+9.871923161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:17.318722 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:17.318627 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:17.318872 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.318780 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.318872 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.318846 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:25.31882634 +0000 UTC m=+17.173897205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.420596 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:17.419989 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:17.420596 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.420196 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:17.420596 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.420216 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:17.420596 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.420229 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:17.420596 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:17.420286 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:25.420267115 +0000 UTC m=+17.275337997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:18.025540 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:18.025506 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:18.025696 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:18.025630 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:18.025696 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:18.025690 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:20.025670572 +0000 UTC m=+11.880741450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:18.754029 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:18.753551 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:18.754029 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:18.753680 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:18.754029 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:18.753777 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:18.754029 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:18.753917 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:18.754029 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:18.753972 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:18.754679 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:18.754054 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:20.040625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:20.040587 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:20.041068 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:20.040749 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:20.041068 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:20.040819 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:24.040801727 +0000 UTC m=+15.895872606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:20.752942 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:20.752906 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:20.753127 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:20.752946 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:20.753127 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:20.753031 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:20.753127 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:20.753060 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:20.753127 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:20.753100 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:20.753278 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:20.753175 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:22.752650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:22.752614 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:22.752650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:22.752641 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:22.753173 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:22.752616 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:22.753173 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:22.752722 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:22.753173 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:22.752828 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:22.753173 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:22.752938 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:24.074567 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:24.074526 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:24.075058 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:24.074654 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:24.075058 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:24.074718 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:32.074702809 +0000 UTC m=+23.929773681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:24.752190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:24.752154 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:24.752190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:24.752182 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:24.752422 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:24.752217 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:24.752422 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:24.752310 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:24.752531 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:24.752418 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:24.752531 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:24.752491 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:25.384969 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:25.384907 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:25.385408 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.385061 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:25.385408 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.385133 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:41.385116352 +0000 UTC m=+33.240187211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:25.485990 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:25.485957 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:25.486184 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.486104 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:25.486184 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.486129 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:25.486184 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.486141 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:25.486285 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:25.486189 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:41.486175749 +0000 UTC m=+33.341246607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:26.752229 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:26.752192 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:26.752679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:26.752192 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:26.752679 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:26.752325 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:26.752679 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:26.752418 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:26.752679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:26.752192 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:26.752679 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:26.752520 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:28.752743 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:28.752710 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:28.753260 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:28.752804 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:28.753260 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:28.752915 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:28.753260 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:28.753021 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:28.753260 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:28.753057 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:28.753260 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:28.753128 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:29.914803 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.914664 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" event={"ID":"0cf31f56-e4bb-42b5-ae79-de0d34cd474a","Type":"ContainerStarted","Data":"afc110a5bf1c0cd7352f78462b67e6b6e9fb6aa00f2d7046ebc43c308f360050"} May 27 21:38:29.928972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.928948 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:38:29.930817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.930765 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c5gc9" podStartSLOduration=2.416367465 podStartE2EDuration="21.930747795s" podCreationTimestamp="2026-05-27 21:38:08 +0000 UTC" firstStartedPulling="2026-05-27 21:38:09.973679782 +0000 UTC m=+1.828750641" lastFinishedPulling="2026-05-27 21:38:29.488060104 +0000 UTC m=+21.343130971" observedRunningTime="2026-05-27 21:38:29.930102699 +0000 UTC m=+21.785173582" watchObservedRunningTime="2026-05-27 21:38:29.930747795 +0000 UTC m=+21.785818677" May 27 21:38:29.931802 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.931770 2555 generic.go:358] "Generic (PLEG): container finished" podID="07a02c27-6211-4b29-a358-6a6ecf9150f6" containerID="5364bc93f3a51a531200cddd76097bb4c690ef5bfd922f603032cb1f01e8f088" exitCode=1 May 27 21:38:29.931873 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.931860 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"11fe2df2281c4a58a11445554488a2c899811c011ee0aec75c12b3af5b7b4904"} May 27 21:38:29.931954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.931910 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerDied","Data":"5364bc93f3a51a531200cddd76097bb4c690ef5bfd922f603032cb1f01e8f088"} May 27 21:38:29.931954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.931929 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"46913001efac5684ec87bb101ecfdb944e0369d40890a8c2c64ca54f58c0dfde"} May 27 21:38:29.942601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.942567 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"03aa378766e5aa14d378fa47bd1c4273","Type":"ContainerStarted","Data":"46bd0b66b62d9ab09ba85e3f6fa67171bec2ac1700fd515c641b7df9e7aa1781"} May 27 21:38:29.951190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.951170 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r8fxp" event={"ID":"19135a59-0056-4302-a17b-3a376afb0beb","Type":"ContainerStarted","Data":"a6798e949b7207c4ef9212e085713ac2985517b0ff7eabe3add6bf699dd9d282"} May 27 21:38:29.958786 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.958750 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" podStartSLOduration=20.958737635 podStartE2EDuration="20.958737635s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:38:29.958466346 +0000 UTC m=+21.813537228" watchObservedRunningTime="2026-05-27 21:38:29.958737635 +0000 UTC m=+21.813808557" May 27 21:38:29.981516 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:29.981479 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-r8fxp" podStartSLOduration=1.206823779 podStartE2EDuration="20.981464562s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:10.013102603 +0000 UTC m=+1.868173466" lastFinishedPulling="2026-05-27 21:38:29.787743385 +0000 UTC m=+21.642814249" observedRunningTime="2026-05-27 21:38:29.980949327 +0000 UTC m=+21.836020210" watchObservedRunningTime="2026-05-27 21:38:29.981464562 +0000 UTC m=+21.836535445" May 27 21:38:30.753099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.753020 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:30.753244 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.753129 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:30.753244 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:30.753133 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:30.753328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.753254 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:30.753328 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:30.753262 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:30.753441 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:30.753368 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:30.953868 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.953831 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="5f489c234645493f322e9421f5fa5a250bfe6360302983c56afdcf71b21cdee9" exitCode=0 May 27 21:38:30.954321 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.953919 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"5f489c234645493f322e9421f5fa5a250bfe6360302983c56afdcf71b21cdee9"} May 27 21:38:30.955207 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.955180 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" event={"ID":"a59c5cc0-287f-4864-b5be-4a1c01c0417d","Type":"ContainerStarted","Data":"ebe8bac61a4939144e03267654b696b887c5a7b24596b34688578245a03958a9"} May 27 21:38:30.956487 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.956471 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkwqp" event={"ID":"e3127c91-bc61-488f-9396-e68f583a06dc","Type":"ContainerStarted","Data":"653b113aeb03087922d903026fbdc802f38b26c180631e04ae876cf013334362"} May 27 21:38:30.958989 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.958973 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:38:30.959316 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.959294 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"01ddcdce9db215785062dd5c3e131bc92e8fd21671e9156380f9b829eebf7927"} May 27 21:38:30.959379 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.959318 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"e6b797053d49d9a19e3d8f0f3504d0acc87aaa1aaa59a46fda991e5a164dc8b2"} May 27 21:38:30.959379 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.959327 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"8cd989e031725e4f0890100de9a2c91a6c678725563573bf73eace2cfb376bd4"} May 27 21:38:30.962122 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.962099 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8fkdc" event={"ID":"7356e278-b295-4dab-a59b-156c0e47aaeb","Type":"ContainerStarted","Data":"899ea74399fc6713c84b517d441b6bc481121f04bc7454ad726b570102668519"} May 27 21:38:30.963668 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.963638 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hj7d" event={"ID":"3e622ca2-38bb-4876-a548-76c5495472d5","Type":"ContainerStarted","Data":"543bd4259c161470db6a06b45d10d2d1346e6d3e35c9c5a3dd0fe696346b8b2a"} May 27 21:38:30.964924 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.964903 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qf9h" event={"ID":"3b682f0e-f601-41c4-a7d0-084017d6842c","Type":"ContainerStarted","Data":"38cd1f62659e26819c966f8778c2c24b931c093be10a4f35036cfa7c7865ff2e"} May 27 21:38:30.966026 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.966008 2555 generic.go:358] "Generic (PLEG): container finished" podID="d758af17a837fb8c91bde5337f780fb6" containerID="76061bcedb0b0a9aed309322db5290aedde76d2216fa222e540928836ace923c" exitCode=0 May 27 21:38:30.966115 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:30.966097 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"d758af17a837fb8c91bde5337f780fb6","Type":"ContainerDied","Data":"76061bcedb0b0a9aed309322db5290aedde76d2216fa222e540928836ace923c"} May 27 21:38:31.011471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.011377 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8fkdc" podStartSLOduration=3.485519945 podStartE2EDuration="23.011360663s" podCreationTimestamp="2026-05-27 21:38:08 +0000 UTC" firstStartedPulling="2026-05-27 21:38:09.960312879 +0000 UTC m=+1.815383738" lastFinishedPulling="2026-05-27 21:38:29.486153596 +0000 UTC m=+21.341224456" observedRunningTime="2026-05-27 21:38:31.010599392 +0000 UTC m=+22.865670273" watchObservedRunningTime="2026-05-27 21:38:31.011360663 +0000 UTC m=+22.866431546" May 27 21:38:31.039282 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.039242 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qf9h" podStartSLOduration=10.584387917 podStartE2EDuration="22.039230155s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:09.987983282 +0000 UTC m=+1.843054142" lastFinishedPulling="2026-05-27 21:38:21.442825505 +0000 UTC m=+13.297896380" observedRunningTime="2026-05-27 21:38:31.025186936 +0000 UTC m=+22.880257817" watchObservedRunningTime="2026-05-27 21:38:31.039230155 +0000 UTC m=+22.894301035" May 27 21:38:31.055527 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.055491 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5hj7d" podStartSLOduration=2.613278396 podStartE2EDuration="22.055476236s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:10.01929597 +0000 UTC m=+1.874366831" lastFinishedPulling="2026-05-27 21:38:29.4614938 +0000 UTC m=+21.316564671" observedRunningTime="2026-05-27 21:38:31.038850644 +0000 UTC m=+22.893921526" watchObservedRunningTime="2026-05-27 21:38:31.055476236 +0000 UTC m=+22.910547119" May 27 21:38:31.069821 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.069783 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kkwqp" podStartSLOduration=2.647305793 podStartE2EDuration="22.06977326s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:10.039018251 +0000 UTC m=+1.894089112" lastFinishedPulling="2026-05-27 21:38:29.461485705 +0000 UTC m=+21.316556579" observedRunningTime="2026-05-27 21:38:31.0696178 +0000 UTC m=+22.924688681" watchObservedRunningTime="2026-05-27 21:38:31.06977326 +0000 UTC m=+22.924844208" May 27 21:38:31.619018 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.618859 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 21:38:31.725361 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.725227 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:38:31.619015936Z","UUID":"af50c7ad-cd39-418f-addc-83cf703060f4","Handler":null,"Name":"","Endpoint":""} May 27 21:38:31.728154 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.728134 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 21:38:31.728272 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.728162 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 21:38:31.969066 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.969036 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" event={"ID":"a59c5cc0-287f-4864-b5be-4a1c01c0417d","Type":"ContainerStarted","Data":"ba0a075a705337ac8b907bbfcbf22cf3a9c783247fb546861ab31ee1e560e766"} May 27 21:38:31.973662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.973631 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"d758af17a837fb8c91bde5337f780fb6","Type":"ContainerStarted","Data":"6e61bfc9e231b4351c5700237c609c6a4e6b3209a0a51f9cad5b0b3c80caf163"} May 27 21:38:31.993526 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:31.993487 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" podStartSLOduration=22.993475751 podStartE2EDuration="22.993475751s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:38:31.992881048 +0000 UTC m=+23.847951929" watchObservedRunningTime="2026-05-27 21:38:31.993475751 +0000 UTC m=+23.848546630" May 27 21:38:32.138663 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.138635 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:32.138827 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:32.138742 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:32.138827 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:32.138801 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret podName:5f6ddb62-9360-49e6-a006-bb42108963e1 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:48.138785559 +0000 UTC m=+39.993856422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret") pod "global-pull-secret-syncer-gwgnw" (UID: "5f6ddb62-9360-49e6-a006-bb42108963e1") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:32.752679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.752648 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:32.752845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.752656 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:32.752845 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:32.752774 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:32.752845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.752656 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:32.752845 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:32.752838 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:32.753040 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:32.752940 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:32.978106 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.978077 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:38:32.978559 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:32.978522 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"4b44de73b633f9dd106193c56a1312144198e709be74cd36189335e90c338d9c"} May 27 21:38:33.982572 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:33.982527 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" event={"ID":"a59c5cc0-287f-4864-b5be-4a1c01c0417d","Type":"ContainerStarted","Data":"12cc84ab61806613d00d7b73197d23155e7809992dc0b0bf00c0870ade594398"} May 27 21:38:34.753057 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.753032 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:34.753248 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.753016 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:34.753248 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:34.753200 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:34.753586 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:34.753563 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:34.753701 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.753615 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:34.753751 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:34.753698 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:34.901767 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.901737 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:34.902463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.902442 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:34.919256 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.919201 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8nww" podStartSLOduration=3.079144726 podStartE2EDuration="25.919184058s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:10.067256298 +0000 UTC m=+1.922327157" lastFinishedPulling="2026-05-27 21:38:32.907295624 +0000 UTC m=+24.762366489" observedRunningTime="2026-05-27 21:38:34.012997211 +0000 UTC m=+25.868068102" watchObservedRunningTime="2026-05-27 21:38:34.919184058 +0000 UTC m=+26.774254939" May 27 21:38:34.984948 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.984924 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:34.985440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:34.985422 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kkwqp" May 27 21:38:35.988845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:35.988697 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:38:35.989211 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:35.989129 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"4be876e0848e6fec745cdcd038a16bd415652572d0ba943692dcd83827b48fb0"} May 27 21:38:35.989593 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:35.989560 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:35.989593 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:35.989591 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:35.989755 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:35.989620 2555 scope.go:117] "RemoveContainer" containerID="5364bc93f3a51a531200cddd76097bb4c690ef5bfd922f603032cb1f01e8f088" May 27 21:38:36.006123 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.006100 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:36.752986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.752958 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:36.752986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.752984 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:36.753170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.752958 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:36.753170 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:36.753064 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:36.753258 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:36.753161 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:36.753258 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:36.753227 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:36.993199 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.993110 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="6cd3d3537d4ee34646563c049d3918130fd3ebfa4516f42c10803cbcaeba711a" exitCode=0 May 27 21:38:36.993594 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.993208 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"6cd3d3537d4ee34646563c049d3918130fd3ebfa4516f42c10803cbcaeba711a"} May 27 21:38:36.997385 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.997364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:38:36.998174 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.998142 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" event={"ID":"07a02c27-6211-4b29-a358-6a6ecf9150f6","Type":"ContainerStarted","Data":"a21ce1af950cb8dc3ed4a645938c9bc4e54329165ad15a837973084d7784ba28"} May 27 21:38:36.998299 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:36.998202 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:37.031914 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.031862 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:38:37.065143 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.065098 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" podStartSLOduration=9.507482816 podStartE2EDuration="29.065084754s" podCreationTimestamp="2026-05-27 21:38:08 +0000 UTC" firstStartedPulling="2026-05-27 21:38:09.969385858 +0000 UTC m=+1.824456720" lastFinishedPulling="2026-05-27 21:38:29.526987797 +0000 UTC m=+21.382058658" observedRunningTime="2026-05-27 21:38:37.064464825 +0000 UTC m=+28.919535706" watchObservedRunningTime="2026-05-27 21:38:37.065084754 +0000 UTC m=+28.920155635" May 27 21:38:37.675091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.675062 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mk6t"] May 27 21:38:37.675349 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.675198 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:37.675349 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:37.675282 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:37.677864 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.677837 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwgnw"] May 27 21:38:37.678020 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.677963 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:37.678087 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:37.678048 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:37.680983 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.680958 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kthvr"] May 27 21:38:37.681106 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:37.681083 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:37.681204 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:37.681183 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:38.001077 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:38.001013 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="3680f7931924a1d5db9542b169b23d19099fdb371ac4f8086ad4f036abeeb19a" exitCode=0 May 27 21:38:38.001424 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:38.001087 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"3680f7931924a1d5db9542b169b23d19099fdb371ac4f8086ad4f036abeeb19a"} May 27 21:38:38.752860 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:38.752790 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:38.753014 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:38.752875 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:39.005088 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:39.005007 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="f3e1879592fd7d7eef0d0311015de55a3450d7caf434d9fbdf8a89181544969e" exitCode=0 May 27 21:38:39.005806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:39.005087 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"f3e1879592fd7d7eef0d0311015de55a3450d7caf434d9fbdf8a89181544969e"} May 27 21:38:39.752625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:39.752595 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:39.752625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:39.752614 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:39.752875 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:39.752712 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:39.753127 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:39.753096 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:40.755658 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:40.755627 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:40.756123 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:40.755738 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2mk6t" podUID="d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6" May 27 21:38:41.415804 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:41.415617 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:41.415804 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.415760 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:41.416031 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.415865 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs podName:0791840b-cac3-41c4-a1cb-f72f86ef1d2c nodeName:}" failed. No retries permitted until 2026-05-27 21:39:13.415848636 +0000 UTC m=+65.270919495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs") pod "network-metrics-daemon-kthvr" (UID: "0791840b-cac3-41c4-a1cb-f72f86ef1d2c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:41.516545 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:41.516508 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:41.516700 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.516678 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:41.516700 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.516700 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:41.516782 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.516710 2555 projected.go:194] Error preparing data for projected volume kube-api-access-pscmn for pod openshift-network-diagnostics/network-check-target-2mk6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:41.516782 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.516763 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn podName:d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:13.516749309 +0000 UTC m=+65.371820168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pscmn" (UniqueName: "kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn") pod "network-check-target-2mk6t" (UID: "d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:41.752538 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:41.752464 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:41.752691 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.752566 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kthvr" podUID="0791840b-cac3-41c4-a1cb-f72f86ef1d2c" May 27 21:38:41.752691 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:41.752631 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:41.752801 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:41.752737 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwgnw" podUID="5f6ddb62-9360-49e6-a006-bb42108963e1" May 27 21:38:42.438880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.438849 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeReady" May 27 21:38:42.439308 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.439009 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 21:38:42.478961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.478857 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8kjtr"] May 27 21:38:42.527934 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.527883 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:38:42.528100 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.528048 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.530405 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.530382 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 21:38:42.530705 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.530681 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b88lf\"" May 27 21:38:42.530820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.530796 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 21:38:42.531065 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.531040 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 21:38:42.531318 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.531300 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 21:38:42.537589 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.537393 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 21:38:42.543755 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.542314 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4"] May 27 21:38:42.556996 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.556967 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8kjtr"] May 27 21:38:42.557092 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.557001 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4"] May 27 21:38:42.557092 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.557017 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz"] May 27 21:38:42.557201 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.557090 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.557254 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.557227 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" May 27 21:38:42.559342 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559319 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:42.559449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559341 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rrxps\"" May 27 21:38:42.559449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559322 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 21:38:42.559570 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559503 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 21:38:42.559622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559580 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 21:38:42.559779 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.559760 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 21:38:42.560063 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.560010 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8r2rz\"" May 27 21:38:42.565401 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.565379 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 21:38:42.567018 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.566999 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl"] May 27 21:38:42.567841 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.567141 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.569702 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.569684 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:42.569937 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.569732 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 27 21:38:42.570023 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.569782 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 27 21:38:42.570267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.570249 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xsjm\"" May 27 21:38:42.580569 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.580551 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk"] May 27 21:38:42.580698 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.580683 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.582817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.582498 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:42.582817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.582506 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zrnfs\"" May 27 21:38:42.582817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.582516 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 27 21:38:42.582817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.582498 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 27 21:38:42.582817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.582520 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 27 21:38:42.589822 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.589797 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vdrrs"] May 27 21:38:42.589966 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.589948 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.591812 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.591797 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:42.591992 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.591975 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 27 21:38:42.592067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.592002 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 27 21:38:42.592067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.591978 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gmjx5\"" May 27 21:38:42.592300 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.592286 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 27 21:38:42.601952 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.601935 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv"] May 27 21:38:42.602077 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.602059 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.604116 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.604096 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hrh46\"" May 27 21:38:42.604352 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.604338 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 21:38:42.605837 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.605804 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:42.605966 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.605804 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 21:38:42.605966 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.605846 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 21:38:42.610040 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.610022 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 21:38:42.616280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.616264 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz"] May 27 21:38:42.616402 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.616389 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.619021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.619001 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 21:38:42.619125 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.619100 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 21:38:42.619176 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.619162 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 21:38:42.619246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.619231 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g6479\"" May 27 21:38:42.619338 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.619312 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 21:38:42.625613 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-snapshots\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.625690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.625690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6tzd\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625766 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625766 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d07ff76-0915-4b2b-a125-211d834818fa-serving-cert\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.625862 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625862 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-tmp\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.625862 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625871 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9sb\" (UniqueName: \"kubernetes.io/projected/9d07ff76-0915-4b2b-a125-211d834818fa-kube-api-access-5r9sb\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.625976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.625976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.625971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.626191 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.626009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.632748 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.632731 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7586c8f6db-w2mxm"] May 27 21:38:42.632854 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.632841 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.636671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.634950 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6sb7t\"" May 27 21:38:42.636671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.635186 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 27 21:38:42.636671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.635445 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 27 21:38:42.649322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.649304 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb"] May 27 21:38:42.649447 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.649431 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.651396 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.651374 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 21:38:42.651396 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.651373 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bzlx6\"" May 27 21:38:42.651546 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.651381 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 21:38:42.651631 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.651612 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 21:38:42.651803 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.651790 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 21:38:42.652094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.652077 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 21:38:42.652374 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.652358 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 21:38:42.659579 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.659558 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-75zhw"] May 27 21:38:42.659710 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.659686 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" May 27 21:38:42.661590 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.661571 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5vbsk\"" May 27 21:38:42.661685 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.661625 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:38:42.661740 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.661731 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:38:42.673957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.673938 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k688w"] May 27 21:38:42.674111 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.674087 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.675851 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.675828 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 21:38:42.675851 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.675844 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 21:38:42.676155 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.676139 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7n5q2\"" May 27 21:38:42.682561 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682533 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682564 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682578 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682589 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682600 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k688w"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682612 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vdrrs"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682623 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75zhw"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682632 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7586c8f6db-w2mxm"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682642 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682653 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682663 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv"] May 27 21:38:42.682665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.682758 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.684426 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.684410 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 21:38:42.684692 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.684667 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 21:38:42.684783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.684672 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wvcgf\"" May 27 21:38:42.684783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.684748 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 21:38:42.727068 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.727246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727078 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-config\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.727246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727111 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d07ff76-0915-4b2b-a125-211d834818fa-serving-cert\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.727246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727167 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28e6fc5b-7fc9-47fa-b373-000f1d19a782-serving-cert\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.727246 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727220 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-tmp\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.727298 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.727325 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3884e3c2-e17e-4070-b9a4-be170e789e70-serving-cert\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727369 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.727392 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.227372284 +0000 UTC m=+35.082443143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7a64ac3-dae1-4f28-8947-3953878dd78c-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727469 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727485 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9sb\" (UniqueName: \"kubernetes.io/projected/9d07ff76-0915-4b2b-a125-211d834818fa-kube-api-access-5r9sb\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.727509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727507 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727541 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj5qq\" (UniqueName: \"kubernetes.io/projected/4012efd7-2087-41c7-80b7-f9aa8d76273d-kube-api-access-zj5qq\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727591 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4012efd7-2087-41c7-80b7-f9aa8d76273d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727633 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6tzd\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3884e3c2-e17e-4070-b9a4-be170e789e70-config\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv428\" (UniqueName: \"kubernetes.io/projected/3884e3c2-e17e-4070-b9a4-be170e789e70-kube-api-access-qv428\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlp2\" (UniqueName: \"kubernetes.io/projected/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-kube-api-access-djlp2\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01aa57a0-f6b0-44a7-b90a-2c631372b819-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727822 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.727845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727844 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-trusted-ca\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvq9\" (UniqueName: \"kubernetes.io/projected/c7a64ac3-dae1-4f28-8947-3953878dd78c-kube-api-access-fxvq9\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727910 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-snapshots\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79znx\" (UniqueName: \"kubernetes.io/projected/828b8b30-3e19-4cf3-9553-a5503c367f84-kube-api-access-79znx\") pod \"volume-data-source-validator-5cf8c89d64-p72q4\" (UID: \"828b8b30-3e19-4cf3-9553-a5503c367f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727948 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4012efd7-2087-41c7-80b7-f9aa8d76273d-config\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727977 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shfj9\" (UniqueName: \"kubernetes.io/projected/28e6fc5b-7fc9-47fa-b373-000f1d19a782-kube-api-access-shfj9\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.727997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.728023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.728371 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.728252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-tmp\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.729091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.729035 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.729091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.729044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.729309 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.729262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d07ff76-0915-4b2b-a125-211d834818fa-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.729427 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.729351 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.729427 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.729375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d07ff76-0915-4b2b-a125-211d834818fa-snapshots\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.732909 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.732876 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d07ff76-0915-4b2b-a125-211d834818fa-serving-cert\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.740456 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.740159 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.740456 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.740302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9sb\" (UniqueName: \"kubernetes.io/projected/9d07ff76-0915-4b2b-a125-211d834818fa-kube-api-access-5r9sb\") pod \"insights-operator-78bdfb888c-8kjtr\" (UID: \"9d07ff76-0915-4b2b-a125-211d834818fa\") " pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.740456 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.740429 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.742931 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.742872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.744434 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.744412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6tzd\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:42.755880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.755842 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:38:42.760101 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.758632 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tcr2\"" May 27 21:38:42.828938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.828904 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.828938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.828945 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-config\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.829166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.828987 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28e6fc5b-7fc9-47fa-b373-000f1d19a782-serving-cert\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.829166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829017 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3884e3c2-e17e-4070-b9a4-be170e789e70-serving-cert\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.829166 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.829059 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:42.829166 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.829124 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.329105371 +0000 UTC m=+35.184176233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:42.829166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18426b1e-b883-41fe-be53-64a05743a2b6-config-volume\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7a64ac3-dae1-4f28-8947-3953878dd78c-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgx5l\" (UniqueName: \"kubernetes.io/projected/5934e7ed-bff7-4ac9-aec0-22a69e4245db-kube-api-access-bgx5l\") pod \"network-check-source-7f44b6dd87-vxhjb\" (UID: \"5934e7ed-bff7-4ac9-aec0-22a69e4245db\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18426b1e-b883-41fe-be53-64a05743a2b6-tmp-dir\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj5qq\" (UniqueName: \"kubernetes.io/projected/4012efd7-2087-41c7-80b7-f9aa8d76273d-kube-api-access-zj5qq\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-default-certificate\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829388 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4012efd7-2087-41c7-80b7-f9aa8d76273d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.829418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829456 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3884e3c2-e17e-4070-b9a4-be170e789e70-config\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829487 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv428\" (UniqueName: \"kubernetes.io/projected/3884e3c2-e17e-4070-b9a4-be170e789e70-kube-api-access-qv428\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh5t5\" (UniqueName: \"kubernetes.io/projected/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-kube-api-access-xh5t5\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829547 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djlp2\" (UniqueName: \"kubernetes.io/projected/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-kube-api-access-djlp2\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2crm\" (UniqueName: \"kubernetes.io/projected/18426b1e-b883-41fe-be53-64a05743a2b6-kube-api-access-t2crm\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829634 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01aa57a0-f6b0-44a7-b90a-2c631372b819-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqlfk\" (UniqueName: \"kubernetes.io/projected/d9cbb529-7b64-41ee-b006-c085869a4edd-kube-api-access-rqlfk\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-trusted-ca\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvq9\" (UniqueName: \"kubernetes.io/projected/c7a64ac3-dae1-4f28-8947-3953878dd78c-kube-api-access-fxvq9\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-stats-auth\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.829993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.829857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79znx\" (UniqueName: \"kubernetes.io/projected/828b8b30-3e19-4cf3-9553-a5503c367f84-kube-api-access-79znx\") pod \"volume-data-source-validator-5cf8c89d64-p72q4\" (UID: \"828b8b30-3e19-4cf3-9553-a5503c367f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830037 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7a64ac3-dae1-4f28-8947-3953878dd78c-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830109 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4012efd7-2087-41c7-80b7-f9aa8d76273d-config\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830140 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shfj9\" (UniqueName: \"kubernetes.io/projected/28e6fc5b-7fc9-47fa-b373-000f1d19a782-kube-api-access-shfj9\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830358 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830403 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01aa57a0-f6b0-44a7-b90a-2c631372b819-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.830475 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.830521 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.330505523 +0000 UTC m=+35.185576396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.830595 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.830646 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.330634096 +0000 UTC m=+35.185704971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:42.830721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.830677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4012efd7-2087-41c7-80b7-f9aa8d76273d-config\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.831284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.831011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3884e3c2-e17e-4070-b9a4-be170e789e70-config\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.831284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.831189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-config\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.831932 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.831880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3884e3c2-e17e-4070-b9a4-be170e789e70-serving-cert\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.832050 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.832030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4012efd7-2087-41c7-80b7-f9aa8d76273d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.836643 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.836528 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28e6fc5b-7fc9-47fa-b373-000f1d19a782-serving-cert\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.836759 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.836718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28e6fc5b-7fc9-47fa-b373-000f1d19a782-trusted-ca\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.840547 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.840522 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj5qq\" (UniqueName: \"kubernetes.io/projected/4012efd7-2087-41c7-80b7-f9aa8d76273d-kube-api-access-zj5qq\") pod \"kube-storage-version-migrator-operator-565644f49-9fdnl\" (UID: \"4012efd7-2087-41c7-80b7-f9aa8d76273d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.840686 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.840628 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" May 27 21:38:42.841448 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.841230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvq9\" (UniqueName: \"kubernetes.io/projected/c7a64ac3-dae1-4f28-8947-3953878dd78c-kube-api-access-fxvq9\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:42.841513 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.841471 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv428\" (UniqueName: \"kubernetes.io/projected/3884e3c2-e17e-4070-b9a4-be170e789e70-kube-api-access-qv428\") pod \"service-ca-operator-57b5b68b8-bx4lk\" (UID: \"3884e3c2-e17e-4070-b9a4-be170e789e70\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.842156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.842131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shfj9\" (UniqueName: \"kubernetes.io/projected/28e6fc5b-7fc9-47fa-b373-000f1d19a782-kube-api-access-shfj9\") pod \"console-operator-76dff48d59-vdrrs\" (UID: \"28e6fc5b-7fc9-47fa-b373-000f1d19a782\") " pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.842364 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.842348 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlp2\" (UniqueName: \"kubernetes.io/projected/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-kube-api-access-djlp2\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:42.844841 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.844803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79znx\" (UniqueName: \"kubernetes.io/projected/828b8b30-3e19-4cf3-9553-a5503c367f84-kube-api-access-79znx\") pod \"volume-data-source-validator-5cf8c89d64-p72q4\" (UID: \"828b8b30-3e19-4cf3-9553-a5503c367f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" May 27 21:38:42.875727 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.875699 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" May 27 21:38:42.890311 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.890287 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" May 27 21:38:42.900230 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.900084 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" May 27 21:38:42.910410 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.910271 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:42.933915 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.932480 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-stats-auth\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.933915 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.932529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.934102 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.934033 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:42.934145 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.934126 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.434102426 +0000 UTC m=+35.289173293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936103 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18426b1e-b883-41fe-be53-64a05743a2b6-config-volume\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936170 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgx5l\" (UniqueName: \"kubernetes.io/projected/5934e7ed-bff7-4ac9-aec0-22a69e4245db-kube-api-access-bgx5l\") pod \"network-check-source-7f44b6dd87-vxhjb\" (UID: \"5934e7ed-bff7-4ac9-aec0-22a69e4245db\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936216 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18426b1e-b883-41fe-be53-64a05743a2b6-tmp-dir\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936263 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936291 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-default-certificate\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936318 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936366 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh5t5\" (UniqueName: \"kubernetes.io/projected/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-kube-api-access-xh5t5\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936392 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2crm\" (UniqueName: \"kubernetes.io/projected/18426b1e-b883-41fe-be53-64a05743a2b6-kube-api-access-t2crm\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqlfk\" (UniqueName: \"kubernetes.io/projected/d9cbb529-7b64-41ee-b006-c085869a4edd-kube-api-access-rqlfk\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936481 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.936606 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.936677 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.436660681 +0000 UTC m=+35.291731546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18426b1e-b883-41fe-be53-64a05743a2b6-config-volume\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.936780 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.436768454 +0000 UTC m=+35.291839349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.936982 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18426b1e-b883-41fe-be53-64a05743a2b6-tmp-dir\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.939087 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.937499 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:42.940018 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:42.937549 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:38:43.437532322 +0000 UTC m=+35.292603196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:42.940018 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.938510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-stats-auth\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.943455 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.943407 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-default-certificate\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.949602 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.949566 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2crm\" (UniqueName: \"kubernetes.io/projected/18426b1e-b883-41fe-be53-64a05743a2b6-kube-api-access-t2crm\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:42.960267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.957511 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqlfk\" (UniqueName: \"kubernetes.io/projected/d9cbb529-7b64-41ee-b006-c085869a4edd-kube-api-access-rqlfk\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:42.960267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.957930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh5t5\" (UniqueName: \"kubernetes.io/projected/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-kube-api-access-xh5t5\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:42.960267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.958643 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgx5l\" (UniqueName: \"kubernetes.io/projected/5934e7ed-bff7-4ac9-aec0-22a69e4245db-kube-api-access-bgx5l\") pod \"network-check-source-7f44b6dd87-vxhjb\" (UID: \"5934e7ed-bff7-4ac9-aec0-22a69e4245db\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" May 27 21:38:42.968879 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:42.968827 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" May 27 21:38:43.083072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.082983 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8kjtr"] May 27 21:38:43.093610 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.093568 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4"] May 27 21:38:43.128580 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.128545 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk"] May 27 21:38:43.131920 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.131824 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl"] May 27 21:38:43.137793 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:43.137743 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3884e3c2_e17e_4070_b9a4_be170e789e70.slice/crio-a701d834407b604c19fa432682fd50345db1be1dc948b43a4d367b932a8cebe8 WatchSource:0}: Error finding container a701d834407b604c19fa432682fd50345db1be1dc948b43a4d367b932a8cebe8: Status 404 returned error can't find the container with id a701d834407b604c19fa432682fd50345db1be1dc948b43a4d367b932a8cebe8 May 27 21:38:43.138085 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:43.138059 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4012efd7_2087_41c7_80b7_f9aa8d76273d.slice/crio-32217ca232e6a44f0d3bc1243879c9dc560d184a513cb6c35ce6042096ec0d3b WatchSource:0}: Error finding container 32217ca232e6a44f0d3bc1243879c9dc560d184a513cb6c35ce6042096ec0d3b: Status 404 returned error can't find the container with id 32217ca232e6a44f0d3bc1243879c9dc560d184a513cb6c35ce6042096ec0d3b May 27 21:38:43.174063 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.174032 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vdrrs"] May 27 21:38:43.177369 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:43.177338 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e6fc5b_7fc9_47fa_b373_000f1d19a782.slice/crio-26093823ca3d163b5d5439b179c2f2a1e175ca80f9bd006a6a0f121dc2f34108 WatchSource:0}: Error finding container 26093823ca3d163b5d5439b179c2f2a1e175ca80f9bd006a6a0f121dc2f34108: Status 404 returned error can't find the container with id 26093823ca3d163b5d5439b179c2f2a1e175ca80f9bd006a6a0f121dc2f34108 May 27 21:38:43.197550 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.197419 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb"] May 27 21:38:43.200168 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:38:43.200144 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5934e7ed_bff7_4ac9_aec0_22a69e4245db.slice/crio-33b7b1d18639ec3eb9a62ce26068c12ef112d5d9105a104c5471e3c2e2e11e21 WatchSource:0}: Error finding container 33b7b1d18639ec3eb9a62ce26068c12ef112d5d9105a104c5471e3c2e2e11e21: Status 404 returned error can't find the container with id 33b7b1d18639ec3eb9a62ce26068c12ef112d5d9105a104c5471e3c2e2e11e21 May 27 21:38:43.241625 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.241569 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:43.241915 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.241882 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:43.242006 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.241916 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:43.242006 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.241970 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.241954031 +0000 UTC m=+36.097024896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:43.343021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.342986 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:43.343172 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.343036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:43.343172 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.343076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:43.343282 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343169 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:43.343282 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343208 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:43.343282 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343208 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:43.343282 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343249 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.343227227 +0000 UTC m=+36.198298105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:43.343475 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343297 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.343279508 +0000 UTC m=+36.198350372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:43.343475 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.343319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.343309991 +0000 UTC m=+36.198380855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:43.444315 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.444277 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.444328 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.444506 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444552 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.444513566 +0000 UTC m=+36.299584439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444583 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444589 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.444619 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444634 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.444618211 +0000 UTC m=+36.299689070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444662 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.444652943 +0000 UTC m=+36.299723818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:43.444719 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444695 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:43.445188 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:43.444738 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:44.444725934 +0000 UTC m=+36.299796799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:43.754283 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.752816 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:43.754283 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.753529 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:38:43.755821 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.755791 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:38:43.755971 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.755838 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd4vz\"" May 27 21:38:43.756092 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:43.756077 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:38:44.027953 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.027810 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" event={"ID":"5934e7ed-bff7-4ac9-aec0-22a69e4245db","Type":"ContainerStarted","Data":"33b7b1d18639ec3eb9a62ce26068c12ef112d5d9105a104c5471e3c2e2e11e21"} May 27 21:38:44.029302 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.029269 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" event={"ID":"9d07ff76-0915-4b2b-a125-211d834818fa","Type":"ContainerStarted","Data":"542dc9564b032acf0acbaa6d46acd7610bb901ebfedf54d06ad793d057278fa8"} May 27 21:38:44.031588 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.031560 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" event={"ID":"28e6fc5b-7fc9-47fa-b373-000f1d19a782","Type":"ContainerStarted","Data":"26093823ca3d163b5d5439b179c2f2a1e175ca80f9bd006a6a0f121dc2f34108"} May 27 21:38:44.033846 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.033795 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" event={"ID":"3884e3c2-e17e-4070-b9a4-be170e789e70","Type":"ContainerStarted","Data":"a701d834407b604c19fa432682fd50345db1be1dc948b43a4d367b932a8cebe8"} May 27 21:38:44.035388 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.035342 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" event={"ID":"4012efd7-2087-41c7-80b7-f9aa8d76273d","Type":"ContainerStarted","Data":"32217ca232e6a44f0d3bc1243879c9dc560d184a513cb6c35ce6042096ec0d3b"} May 27 21:38:44.036928 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.036866 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" event={"ID":"828b8b30-3e19-4cf3-9553-a5503c367f84","Type":"ContainerStarted","Data":"a2d6f1ec388b0e638a9126fa9039f96bdedc1e71945993628ff4a4630287004e"} May 27 21:38:44.253351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.253309 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:44.253561 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.253466 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:44.253561 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.253488 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:44.253561 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.253549 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.253528994 +0000 UTC m=+38.108599866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:44.354444 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.354362 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:44.354444 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.354415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:44.354677 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.354451 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:44.354677 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354534 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:44.354677 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354618 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.35459814 +0000 UTC m=+38.209669003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:44.354677 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354663 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:44.354883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354709 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.35469274 +0000 UTC m=+38.209763600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:44.354883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354785 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:44.354883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.354813 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.354805286 +0000 UTC m=+38.209876144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.456541 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.456710 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.456728 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.456771 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:44.456836 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.456941 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.456918936 +0000 UTC m=+38.311989800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.456962 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.456983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.456962329 +0000 UTC m=+38.312033462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.456998 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.457008 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.456993502 +0000 UTC m=+38.312064374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:44.457034 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:44.457044 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:38:46.457030422 +0000 UTC m=+38.312101283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:46.278452 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.278417 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:46.279101 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.278601 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:46.279101 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.278618 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:46.279101 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.278683 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.278659804 +0000 UTC m=+42.133730663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:46.379564 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.379528 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:46.379564 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.379577 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:46.379785 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.379703 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:46.379785 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.379782 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.379761538 +0000 UTC m=+42.234832400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:46.379883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.379800 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:46.379883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.379843 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.37983136 +0000 UTC m=+42.234902218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:46.379883 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.379864 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:46.380038 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.380027 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:46.380084 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.380057 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.380049275 +0000 UTC m=+42.235120134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:46.481291 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.481253 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:46.481471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.481314 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:46.481471 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481382 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.481363682 +0000 UTC m=+42.336434563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:46.481471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.481419 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:46.481471 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481427 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:46.481471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:46.481461 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:46.481685 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481498 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:46.481685 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481529 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.481517984 +0000 UTC m=+42.336588845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:46.481685 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481543 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:46.481685 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481590 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.481580737 +0000 UTC m=+42.336651596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:46.481685 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:46.481605 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.481597889 +0000 UTC m=+42.336668748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:48.200301 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:48.200256 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:48.210755 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:48.210728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6ddb62-9360-49e6-a006-bb42108963e1-original-pull-secret\") pod \"global-pull-secret-syncer-gwgnw\" (UID: \"5f6ddb62-9360-49e6-a006-bb42108963e1\") " pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:48.287131 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:48.287045 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwgnw" May 27 21:38:50.318199 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.318161 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:50.318668 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.318365 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:50.318668 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.318389 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:50.318668 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.318460 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.318438054 +0000 UTC m=+50.173508914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:50.419272 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.419234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:50.419440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.419281 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:50.419440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.419326 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:50.419440 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419387 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:50.419574 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419469 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.419448488 +0000 UTC m=+50.274519348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:50.419574 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419473 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:50.419574 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419386 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:50.419574 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419526 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.419508069 +0000 UTC m=+50.274578928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:50.419574 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.419543 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.419535608 +0000 UTC m=+50.274606467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:50.520147 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.520106 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:50.520342 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.520174 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:50.520342 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.520284 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:50.520342 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:50.520316 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:50.520507 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520426 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:50.520507 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520472 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.520458981 +0000 UTC m=+50.375529841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:50.520816 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520800 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:50.520871 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520844 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.520832145 +0000 UTC m=+50.375903003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:50.520960 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520922 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:50.520960 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520954 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.520945823 +0000 UTC m=+50.376016682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:50.521063 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:50.520999 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.520993279 +0000 UTC m=+50.376064138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:51.569179 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:51.569154 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwgnw"] May 27 21:38:52.056102 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.056010 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" event={"ID":"5934e7ed-bff7-4ac9-aec0-22a69e4245db","Type":"ContainerStarted","Data":"04b51ac02a581d501c88b7731f0306cb99083f04848c780ea3d55d20d38a663e"} May 27 21:38:52.057565 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.057526 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" event={"ID":"9d07ff76-0915-4b2b-a125-211d834818fa","Type":"ContainerStarted","Data":"b8e7d632cb5d81126e92cba49e45052efe003d4bdeca39b3a56ef7b59ea561c0"} May 27 21:38:52.059036 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.059013 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/0.log" May 27 21:38:52.059134 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.059053 2555 generic.go:358] "Generic (PLEG): container finished" podID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" containerID="737402d6abadb97b643ae39556332004370e3b7d2ff1eac5d0afebfd1ae9ca1a" exitCode=255 May 27 21:38:52.059134 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.059118 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" event={"ID":"28e6fc5b-7fc9-47fa-b373-000f1d19a782","Type":"ContainerDied","Data":"737402d6abadb97b643ae39556332004370e3b7d2ff1eac5d0afebfd1ae9ca1a"} May 27 21:38:52.059368 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.059333 2555 scope.go:117] "RemoveContainer" containerID="737402d6abadb97b643ae39556332004370e3b7d2ff1eac5d0afebfd1ae9ca1a" May 27 21:38:52.061970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.060464 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" event={"ID":"3884e3c2-e17e-4070-b9a4-be170e789e70","Type":"ContainerStarted","Data":"e77c23e39d6ca68444b8446dcb195c3466ffd462d9f0ff224c5a8007854b5bc1"} May 27 21:38:52.063190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.063167 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="f5588410a9b22743b5c361301138dfb07db42a4bf301e429eac7882c15ff069f" exitCode=0 May 27 21:38:52.063302 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.063244 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"f5588410a9b22743b5c361301138dfb07db42a4bf301e429eac7882c15ff069f"} May 27 21:38:52.065002 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.064964 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" event={"ID":"4012efd7-2087-41c7-80b7-f9aa8d76273d","Type":"ContainerStarted","Data":"d0d2781bb92634f315e6dbe91f793e39c09b36865eae8f036ccc152ec1250f16"} May 27 21:38:52.066570 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.066420 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gwgnw" event={"ID":"5f6ddb62-9360-49e6-a006-bb42108963e1","Type":"ContainerStarted","Data":"f15e08bbd90874e171b8f5734529b04894b23e0a264cc6de034a0bc53a51908f"} May 27 21:38:52.067810 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.067789 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" event={"ID":"828b8b30-3e19-4cf3-9553-a5503c367f84","Type":"ContainerStarted","Data":"824a7b682c6706a6e9719b3c40c826a1ee36c32f641db79702dd41e7c5552459"} May 27 21:38:52.071799 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.071734 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxhjb" podStartSLOduration=30.825067067 podStartE2EDuration="39.071719078s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.202126469 +0000 UTC m=+35.057197332" lastFinishedPulling="2026-05-27 21:38:51.448778484 +0000 UTC m=+43.303849343" observedRunningTime="2026-05-27 21:38:52.071128105 +0000 UTC m=+43.926198987" watchObservedRunningTime="2026-05-27 21:38:52.071719078 +0000 UTC m=+43.926789955" May 27 21:38:52.088383 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.088350 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" podStartSLOduration=30.882064087 podStartE2EDuration="39.088340416s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.142800861 +0000 UTC m=+34.997871737" lastFinishedPulling="2026-05-27 21:38:51.349077203 +0000 UTC m=+43.204148066" observedRunningTime="2026-05-27 21:38:52.087652766 +0000 UTC m=+43.942723640" watchObservedRunningTime="2026-05-27 21:38:52.088340416 +0000 UTC m=+43.943411353" May 27 21:38:52.132633 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.129019 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" podStartSLOduration=30.775009318 podStartE2EDuration="39.129002564s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.085255522 +0000 UTC m=+34.940326385" lastFinishedPulling="2026-05-27 21:38:51.439248758 +0000 UTC m=+43.294319631" observedRunningTime="2026-05-27 21:38:52.128056042 +0000 UTC m=+43.983126925" watchObservedRunningTime="2026-05-27 21:38:52.129002564 +0000 UTC m=+43.984073446" May 27 21:38:52.148269 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.148214 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-p72q4" podStartSLOduration=30.822865734 podStartE2EDuration="39.148204177s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.109434708 +0000 UTC m=+34.964505582" lastFinishedPulling="2026-05-27 21:38:51.434773151 +0000 UTC m=+43.289844025" observedRunningTime="2026-05-27 21:38:52.146773143 +0000 UTC m=+44.001844026" watchObservedRunningTime="2026-05-27 21:38:52.148204177 +0000 UTC m=+44.003275057" May 27 21:38:52.197612 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.197229 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" podStartSLOduration=30.940847266 podStartE2EDuration="39.19721068s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.143116446 +0000 UTC m=+34.998187309" lastFinishedPulling="2026-05-27 21:38:51.39947985 +0000 UTC m=+43.254550723" observedRunningTime="2026-05-27 21:38:52.175360854 +0000 UTC m=+44.030431736" watchObservedRunningTime="2026-05-27 21:38:52.19721068 +0000 UTC m=+44.052281563" May 27 21:38:52.910732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.910688 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:52.911197 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:52.910772 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:38:53.074427 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.074404 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/1.log" May 27 21:38:53.074825 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.074811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/0.log" May 27 21:38:53.074912 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.074846 2555 generic.go:358] "Generic (PLEG): container finished" podID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" containerID="3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b" exitCode=255 May 27 21:38:53.074969 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.074931 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" event={"ID":"28e6fc5b-7fc9-47fa-b373-000f1d19a782","Type":"ContainerDied","Data":"3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b"} May 27 21:38:53.075057 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.074977 2555 scope.go:117] "RemoveContainer" containerID="737402d6abadb97b643ae39556332004370e3b7d2ff1eac5d0afebfd1ae9ca1a" May 27 21:38:53.075829 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.075206 2555 scope.go:117] "RemoveContainer" containerID="3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b" May 27 21:38:53.075829 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:53.075405 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vdrrs_openshift-console-operator(28e6fc5b-7fc9-47fa-b373-000f1d19a782)\"" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" podUID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" May 27 21:38:53.085419 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.085395 2555 generic.go:358] "Generic (PLEG): container finished" podID="7ba72d86-930d-4230-a503-2e33a9c98cf2" containerID="548d6ef3818597ec96b414833d46c4a9a6c5c5027940075ea1a950820d598e4d" exitCode=0 May 27 21:38:53.085973 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:53.085949 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerDied","Data":"548d6ef3818597ec96b414833d46c4a9a6c5c5027940075ea1a950820d598e4d"} May 27 21:38:54.092792 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:54.092752 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h86vc" event={"ID":"7ba72d86-930d-4230-a503-2e33a9c98cf2","Type":"ContainerStarted","Data":"f1d5873f133a47a9f8b8f9235d6e2c999014fe7f3751846d99575c4b77cc4c41"} May 27 21:38:54.094496 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:54.094469 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/1.log" May 27 21:38:54.094796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:54.094778 2555 scope.go:117] "RemoveContainer" containerID="3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b" May 27 21:38:54.095024 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:54.095002 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vdrrs_openshift-console-operator(28e6fc5b-7fc9-47fa-b373-000f1d19a782)\"" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" podUID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" May 27 21:38:54.116774 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:54.116724 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h86vc" podStartSLOduration=3.793882683 podStartE2EDuration="45.116706074s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="2026-05-27 21:38:10.076640209 +0000 UTC m=+1.931711068" lastFinishedPulling="2026-05-27 21:38:51.399463593 +0000 UTC m=+43.254534459" observedRunningTime="2026-05-27 21:38:54.116234449 +0000 UTC m=+45.971305323" watchObservedRunningTime="2026-05-27 21:38:54.116706074 +0000 UTC m=+45.971776954" May 27 21:38:56.291323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:56.291224 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fkdc_7356e278-b295-4dab-a59b-156c0e47aaeb/dns-node-resolver/0.log" May 27 21:38:57.104295 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:57.104261 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gwgnw" event={"ID":"5f6ddb62-9360-49e6-a006-bb42108963e1","Type":"ContainerStarted","Data":"6d1c56f9b4d923a8c7a0b208f121af83318c14a68f9420ea720331fb7c92619f"} May 27 21:38:57.122551 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:57.122501 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gwgnw" podStartSLOduration=36.469328935 podStartE2EDuration="41.122487123s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:51.575326023 +0000 UTC m=+43.430396883" lastFinishedPulling="2026-05-27 21:38:56.228484208 +0000 UTC m=+48.083555071" observedRunningTime="2026-05-27 21:38:57.121955299 +0000 UTC m=+48.977026181" watchObservedRunningTime="2026-05-27 21:38:57.122487123 +0000 UTC m=+48.977558003" May 27 21:38:57.288259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:57.288238 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qf9h_3b682f0e-f601-41c4-a7d0-084017d6842c/node-ca/0.log" May 27 21:38:58.394343 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.394311 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:38:58.394705 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.394463 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:58.394705 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.394481 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cd5d8c848-7sls7: secret "image-registry-tls" not found May 27 21:38:58.394705 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.394537 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls podName:4bb857ea-667c-4806-825b-74a2ebb6d124 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.394521073 +0000 UTC m=+66.249591945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls") pod "image-registry-5cd5d8c848-7sls7" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124") : secret "image-registry-tls" not found May 27 21:38:58.495201 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.495173 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:38:58.495201 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.495206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:38:58.495401 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.495227 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:38:58.495401 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495323 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:38:58.495401 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495324 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:38:58.495401 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495388 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls podName:c7a64ac3-dae1-4f28-8947-3953878dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.495368817 +0000 UTC m=+66.350439679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qbmcv" (UID: "c7a64ac3-dae1-4f28-8947-3953878dd78c") : secret "cluster-monitoring-operator-tls" not found May 27 21:38:58.495566 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495412 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls podName:7574c155-3aae-4c42-a7aa-3fed2d8dd78c nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.495403907 +0000 UTC m=+66.350474765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls") pod "cluster-samples-operator-697587599-jcrtz" (UID: "7574c155-3aae-4c42-a7aa-3fed2d8dd78c") : secret "samples-operator-tls" not found May 27 21:38:58.495566 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495324 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 21:38:58.495566 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.495499 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert podName:01aa57a0-f6b0-44a7-b90a-2c631372b819 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.495475718 +0000 UTC m=+66.350546592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j2nsz" (UID: "01aa57a0-f6b0-44a7-b90a-2c631372b819") : secret "networking-console-plugin-cert" not found May 27 21:38:58.596206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.596178 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:58.596328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.596212 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:38:58.596328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.596256 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:38:58.596328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:58.596279 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:38:58.596328 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596314 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.596299858 +0000 UTC m=+66.451370717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : configmap references non-existent config key: service-ca.crt May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596386 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596386 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596415 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596445 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls podName:18426b1e-b883-41fe-be53-64a05743a2b6 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.596428184 +0000 UTC m=+66.451499042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls") pod "dns-default-75zhw" (UID: "18426b1e-b883-41fe-be53-64a05743a2b6") : secret "dns-default-metrics-tls" not found May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596463 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert podName:d9cbb529-7b64-41ee-b006-c085869a4edd nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.596453853 +0000 UTC m=+66.451524712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert") pod "ingress-canary-k688w" (UID: "d9cbb529-7b64-41ee-b006-c085869a4edd") : secret "canary-serving-cert" not found May 27 21:38:58.596526 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:38:58.596476 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs podName:c9fba3ab-1440-4a8b-b779-73ad3617c6c7 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:14.596469893 +0000 UTC m=+66.451540752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs") pod "router-default-7586c8f6db-w2mxm" (UID: "c9fba3ab-1440-4a8b-b779-73ad3617c6c7") : secret "router-metrics-certs-default" not found May 27 21:38:59.090330 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:38:59.090298 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-9fdnl_4012efd7-2087-41c7-80b7-f9aa8d76273d/kube-storage-version-migrator-operator/0.log" May 27 21:39:02.910975 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:02.910940 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:02.910975 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:02.910978 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:02.911447 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:02.911295 2555 scope.go:117] "RemoveContainer" containerID="3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b" May 27 21:39:03.120969 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.120945 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:39:03.121305 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.121290 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/1.log" May 27 21:39:03.121398 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.121323 2555 generic.go:358] "Generic (PLEG): container finished" podID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" containerID="7e174d2a36c2e34068ad1fee92409217d0d6e634e44aa16238eb0aa5f34cd5d8" exitCode=255 May 27 21:39:03.121439 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.121394 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" event={"ID":"28e6fc5b-7fc9-47fa-b373-000f1d19a782","Type":"ContainerDied","Data":"7e174d2a36c2e34068ad1fee92409217d0d6e634e44aa16238eb0aa5f34cd5d8"} May 27 21:39:03.121439 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.121433 2555 scope.go:117] "RemoveContainer" containerID="3d99348dddb6bfd012cdd75884d47b8f295e8ebdfd1bbe61cdb1a4938f8f6a2b" May 27 21:39:03.121751 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:03.121737 2555 scope.go:117] "RemoveContainer" containerID="7e174d2a36c2e34068ad1fee92409217d0d6e634e44aa16238eb0aa5f34cd5d8" May 27 21:39:03.121967 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:03.121947 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-vdrrs_openshift-console-operator(28e6fc5b-7fc9-47fa-b373-000f1d19a782)\"" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" podUID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" May 27 21:39:04.124976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:04.124946 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:39:09.016252 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:09.016228 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7fvn" May 27 21:39:12.911254 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:12.911222 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:12.911254 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:12.911261 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:12.911665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:12.911580 2555 scope.go:117] "RemoveContainer" containerID="7e174d2a36c2e34068ad1fee92409217d0d6e634e44aa16238eb0aa5f34cd5d8" May 27 21:39:12.911759 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:12.911742 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-vdrrs_openshift-console-operator(28e6fc5b-7fc9-47fa-b373-000f1d19a782)\"" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" podUID="28e6fc5b-7fc9-47fa-b373-000f1d19a782" May 27 21:39:13.419021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.418991 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:39:13.421463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.421445 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:39:13.432458 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.432422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0791840b-cac3-41c4-a1cb-f72f86ef1d2c-metrics-certs\") pod \"network-metrics-daemon-kthvr\" (UID: \"0791840b-cac3-41c4-a1cb-f72f86ef1d2c\") " pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:39:13.495871 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.495844 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd4vz\"" May 27 21:39:13.503771 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.503753 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kthvr" May 27 21:39:13.520348 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.520319 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:39:13.523030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.523006 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscmn\" (UniqueName: \"kubernetes.io/projected/d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6-kube-api-access-pscmn\") pod \"network-check-target-2mk6t\" (UID: \"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6\") " pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:39:13.626875 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.626843 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kthvr"] May 27 21:39:13.630908 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:13.630864 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0791840b_cac3_41c4_a1cb_f72f86ef1d2c.slice/crio-22c42cf3867f6afbdb33314c95d9a1770fc11c5beecc5ad037c9199394911294 WatchSource:0}: Error finding container 22c42cf3867f6afbdb33314c95d9a1770fc11c5beecc5ad037c9199394911294: Status 404 returned error can't find the container with id 22c42cf3867f6afbdb33314c95d9a1770fc11c5beecc5ad037c9199394911294 May 27 21:39:13.669072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.669016 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tcr2\"" May 27 21:39:13.677639 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.677617 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:39:13.794943 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:13.794912 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2mk6t"] May 27 21:39:13.797527 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:13.797499 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f3cc5e_6fbf_4fb8_9a7c_bff89e4ad2d6.slice/crio-f1011aa25fdd8713fdd9faed4aced602da714e57a259b852bf143fa89822e932 WatchSource:0}: Error finding container f1011aa25fdd8713fdd9faed4aced602da714e57a259b852bf143fa89822e932: Status 404 returned error can't find the container with id f1011aa25fdd8713fdd9faed4aced602da714e57a259b852bf143fa89822e932 May 27 21:39:14.149855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.149768 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mk6t" event={"ID":"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6","Type":"ContainerStarted","Data":"e662013c29c31d1d1a43ca73f239ec06ce497177efef43625acad953f5f67e81"} May 27 21:39:14.149855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.149815 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2mk6t" event={"ID":"d7f3cc5e-6fbf-4fb8-9a7c-bff89e4ad2d6","Type":"ContainerStarted","Data":"f1011aa25fdd8713fdd9faed4aced602da714e57a259b852bf143fa89822e932"} May 27 21:39:14.150320 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.149930 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:39:14.151395 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.151371 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kthvr" event={"ID":"0791840b-cac3-41c4-a1cb-f72f86ef1d2c","Type":"ContainerStarted","Data":"22c42cf3867f6afbdb33314c95d9a1770fc11c5beecc5ad037c9199394911294"} May 27 21:39:14.168863 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.168819 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2mk6t" podStartSLOduration=65.168809293 podStartE2EDuration="1m5.168809293s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:14.168138496 +0000 UTC m=+66.023209378" watchObservedRunningTime="2026-05-27 21:39:14.168809293 +0000 UTC m=+66.023880174" May 27 21:39:14.430510 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.430479 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:39:14.433243 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.433215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"image-registry-5cd5d8c848-7sls7\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:39:14.532004 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.531963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:39:14.532166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.532015 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:39:14.532166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.532052 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:39:14.535008 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.534957 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01aa57a0-f6b0-44a7-b90a-2c631372b819-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j2nsz\" (UID: \"01aa57a0-f6b0-44a7-b90a-2c631372b819\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:39:14.535448 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.535423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7574c155-3aae-4c42-a7aa-3fed2d8dd78c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-jcrtz\" (UID: \"7574c155-3aae-4c42-a7aa-3fed2d8dd78c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:39:14.535515 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.535423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7a64ac3-dae1-4f28-8947-3953878dd78c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qbmcv\" (UID: \"c7a64ac3-dae1-4f28-8947-3953878dd78c\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:39:14.633086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.633061 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:39:14.633193 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.633141 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:14.633193 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.633180 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:39:14.633301 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.633226 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:14.633877 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.633851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-service-ca-bundle\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:14.635822 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.635798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18426b1e-b883-41fe-be53-64a05743a2b6-metrics-tls\") pod \"dns-default-75zhw\" (UID: \"18426b1e-b883-41fe-be53-64a05743a2b6\") " pod="openshift-dns/dns-default-75zhw" May 27 21:39:14.636224 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.636203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9fba3ab-1440-4a8b-b779-73ad3617c6c7-metrics-certs\") pod \"router-default-7586c8f6db-w2mxm\" (UID: \"c9fba3ab-1440-4a8b-b779-73ad3617c6c7\") " pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:14.636284 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.636203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9cbb529-7b64-41ee-b006-c085869a4edd-cert\") pod \"ingress-canary-k688w\" (UID: \"d9cbb529-7b64-41ee-b006-c085869a4edd\") " pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:39:14.671401 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.671382 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8r2rz\"" May 27 21:39:14.679542 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.679522 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:39:14.682903 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.682843 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xsjm\"" May 27 21:39:14.691440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.691423 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" May 27 21:39:14.726951 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.726741 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g6479\"" May 27 21:39:14.735789 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.735419 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" May 27 21:39:14.746500 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.746276 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6sb7t\"" May 27 21:39:14.754603 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.754525 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" May 27 21:39:14.762359 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.761262 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bzlx6\"" May 27 21:39:14.769383 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.769362 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:14.790160 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.789930 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7n5q2\"" May 27 21:39:14.794440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.794241 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wvcgf\"" May 27 21:39:14.796466 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.796447 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75zhw" May 27 21:39:14.803438 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.803011 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k688w" May 27 21:39:14.857115 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.857056 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:39:14.861733 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:14.861692 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb857ea_667c_4806_825b_74a2ebb6d124.slice/crio-9874540ef407f6b71d4d720c26d750ee8b637a1eacc7aee78566dd5b644a3e5c WatchSource:0}: Error finding container 9874540ef407f6b71d4d720c26d750ee8b637a1eacc7aee78566dd5b644a3e5c: Status 404 returned error can't find the container with id 9874540ef407f6b71d4d720c26d750ee8b637a1eacc7aee78566dd5b644a3e5c May 27 21:39:14.890125 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:14.888997 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz"] May 27 21:39:15.007070 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.006797 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz"] May 27 21:39:15.013473 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:15.013435 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01aa57a0_f6b0_44a7_b90a_2c631372b819.slice/crio-c97b92fdba647aecf37b3b9d6e12b80a82aeff91273020d6f6c9f4cb27c0ee80 WatchSource:0}: Error finding container c97b92fdba647aecf37b3b9d6e12b80a82aeff91273020d6f6c9f4cb27c0ee80: Status 404 returned error can't find the container with id c97b92fdba647aecf37b3b9d6e12b80a82aeff91273020d6f6c9f4cb27c0ee80 May 27 21:39:15.022071 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.022045 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv"] May 27 21:39:15.026445 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:15.026418 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a64ac3_dae1_4f28_8947_3953878dd78c.slice/crio-46245e2255c8d559f4eb42aef483cad798a12af83bbaf3d863f183ab27e5b7fa WatchSource:0}: Error finding container 46245e2255c8d559f4eb42aef483cad798a12af83bbaf3d863f183ab27e5b7fa: Status 404 returned error can't find the container with id 46245e2255c8d559f4eb42aef483cad798a12af83bbaf3d863f183ab27e5b7fa May 27 21:39:15.029200 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:15.029176 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fba3ab_1440_4a8b_b779_73ad3617c6c7.slice/crio-f7735b08cb079f04783a9f9c267f753bfd6947880d1602f47c83a0de63fb02a1 WatchSource:0}: Error finding container f7735b08cb079f04783a9f9c267f753bfd6947880d1602f47c83a0de63fb02a1: Status 404 returned error can't find the container with id f7735b08cb079f04783a9f9c267f753bfd6947880d1602f47c83a0de63fb02a1 May 27 21:39:15.032471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.032403 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7586c8f6db-w2mxm"] May 27 21:39:15.051706 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.051683 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k688w"] May 27 21:39:15.056015 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:15.055990 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cbb529_7b64_41ee_b006_c085869a4edd.slice/crio-f3eff4ee6f1e695b468d856cff553c67dbd9b00648dbfef09d181fd12e80d886 WatchSource:0}: Error finding container f3eff4ee6f1e695b468d856cff553c67dbd9b00648dbfef09d181fd12e80d886: Status 404 returned error can't find the container with id f3eff4ee6f1e695b468d856cff553c67dbd9b00648dbfef09d181fd12e80d886 May 27 21:39:15.073574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.073546 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75zhw"] May 27 21:39:15.076833 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:15.076792 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18426b1e_b883_41fe_be53_64a05743a2b6.slice/crio-9bcce9f1b78597a8e1d757c6dd1d0605bb6bf0f1e7198bb68ccfdabf18e68637 WatchSource:0}: Error finding container 9bcce9f1b78597a8e1d757c6dd1d0605bb6bf0f1e7198bb68ccfdabf18e68637: Status 404 returned error can't find the container with id 9bcce9f1b78597a8e1d757c6dd1d0605bb6bf0f1e7198bb68ccfdabf18e68637 May 27 21:39:15.155653 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.155613 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" event={"ID":"01aa57a0-f6b0-44a7-b90a-2c631372b819","Type":"ContainerStarted","Data":"c97b92fdba647aecf37b3b9d6e12b80a82aeff91273020d6f6c9f4cb27c0ee80"} May 27 21:39:15.156605 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.156582 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k688w" event={"ID":"d9cbb529-7b64-41ee-b006-c085869a4edd","Type":"ContainerStarted","Data":"f3eff4ee6f1e695b468d856cff553c67dbd9b00648dbfef09d181fd12e80d886"} May 27 21:39:15.158271 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.158247 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kthvr" event={"ID":"0791840b-cac3-41c4-a1cb-f72f86ef1d2c","Type":"ContainerStarted","Data":"6076c17348a2cdb392dc1c1756576a9770c86062db6384dc6e5875a5f8697a22"} May 27 21:39:15.158395 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.158278 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kthvr" event={"ID":"0791840b-cac3-41c4-a1cb-f72f86ef1d2c","Type":"ContainerStarted","Data":"a98466c92e8b534fa5658d8c12473bd558b51a1bd6fae0fd861fb70a1784fea4"} May 27 21:39:15.159372 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.159343 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75zhw" event={"ID":"18426b1e-b883-41fe-be53-64a05743a2b6","Type":"ContainerStarted","Data":"9bcce9f1b78597a8e1d757c6dd1d0605bb6bf0f1e7198bb68ccfdabf18e68637"} May 27 21:39:15.160621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.160597 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" event={"ID":"c9fba3ab-1440-4a8b-b779-73ad3617c6c7","Type":"ContainerStarted","Data":"0ef6fef064a344353c8741d752a9814ee72622005eac42b6cded14b48c391ced"} May 27 21:39:15.160725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.160627 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" event={"ID":"c9fba3ab-1440-4a8b-b779-73ad3617c6c7","Type":"ContainerStarted","Data":"f7735b08cb079f04783a9f9c267f753bfd6947880d1602f47c83a0de63fb02a1"} May 27 21:39:15.161604 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.161582 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" event={"ID":"c7a64ac3-dae1-4f28-8947-3953878dd78c","Type":"ContainerStarted","Data":"46245e2255c8d559f4eb42aef483cad798a12af83bbaf3d863f183ab27e5b7fa"} May 27 21:39:15.162523 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.162500 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" event={"ID":"7574c155-3aae-4c42-a7aa-3fed2d8dd78c","Type":"ContainerStarted","Data":"dd8ae9ebc133eab0bf4cf531fb13c5dec606d045e2085d6fff0fe3c0ab9a3c20"} May 27 21:39:15.163917 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.163869 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" event={"ID":"4bb857ea-667c-4806-825b-74a2ebb6d124","Type":"ContainerStarted","Data":"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367"} May 27 21:39:15.163917 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.163918 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" event={"ID":"4bb857ea-667c-4806-825b-74a2ebb6d124","Type":"ContainerStarted","Data":"9874540ef407f6b71d4d720c26d750ee8b637a1eacc7aee78566dd5b644a3e5c"} May 27 21:39:15.186206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.186170 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kthvr" podStartSLOduration=66.201292913 podStartE2EDuration="1m7.186159305s" podCreationTimestamp="2026-05-27 21:38:08 +0000 UTC" firstStartedPulling="2026-05-27 21:39:13.632740349 +0000 UTC m=+65.487811223" lastFinishedPulling="2026-05-27 21:39:14.617606753 +0000 UTC m=+66.472677615" observedRunningTime="2026-05-27 21:39:15.185836526 +0000 UTC m=+67.040907406" watchObservedRunningTime="2026-05-27 21:39:15.186159305 +0000 UTC m=+67.041230185" May 27 21:39:15.218420 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.218325 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" podStartSLOduration=66.218309542 podStartE2EDuration="1m6.218309542s" podCreationTimestamp="2026-05-27 21:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:15.217981524 +0000 UTC m=+67.073052406" watchObservedRunningTime="2026-05-27 21:39:15.218309542 +0000 UTC m=+67.073380423" May 27 21:39:15.240019 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.239967 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" podStartSLOduration=62.239950273 podStartE2EDuration="1m2.239950273s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:15.239214407 +0000 UTC m=+67.094285299" watchObservedRunningTime="2026-05-27 21:39:15.239950273 +0000 UTC m=+67.095021148" May 27 21:39:15.771059 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.771006 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:15.773868 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:15.773840 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:16.173553 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.173514 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:39:16.174505 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.174487 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:16.178717 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.178696 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7586c8f6db-w2mxm" May 27 21:39:16.257915 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.257743 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-59nj7"] May 27 21:39:16.260624 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.260384 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.264784 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.264245 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzgsc\"" May 27 21:39:16.264784 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.264545 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 21:39:16.267012 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.266721 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 21:39:16.278461 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.278412 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59nj7"] May 27 21:39:16.356690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.353356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-crio-socket\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.356690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.353444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-data-volume\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.356690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.353555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.356690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.353664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.356690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.353716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqbcf\" (UniqueName: \"kubernetes.io/projected/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-api-access-kqbcf\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.454939 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.454811 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-data-volume\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455089 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.454953 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455089 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455019 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455089 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455055 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqbcf\" (UniqueName: \"kubernetes.io/projected/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-api-access-kqbcf\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455261 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455136 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-crio-socket\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455261 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455222 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-crio-socket\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455261 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455240 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-data-volume\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.455718 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.455702 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.459238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.459204 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.467336 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.467291 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqbcf\" (UniqueName: \"kubernetes.io/projected/ca6126a3-2842-4a7f-9a54-da9fac08d0ca-kube-api-access-kqbcf\") pod \"insights-runtime-extractor-59nj7\" (UID: \"ca6126a3-2842-4a7f-9a54-da9fac08d0ca\") " pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:16.582847 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:16.582438 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59nj7" May 27 21:39:19.215795 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:19.215742 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59nj7"] May 27 21:39:19.221733 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:19.221689 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6126a3_2842_4a7f_9a54_da9fac08d0ca.slice/crio-2a3566e4ebda4f913e96c524b3506408a4aa5e109f4fbc2498fc221098155afb WatchSource:0}: Error finding container 2a3566e4ebda4f913e96c524b3506408a4aa5e109f4fbc2498fc221098155afb: Status 404 returned error can't find the container with id 2a3566e4ebda4f913e96c524b3506408a4aa5e109f4fbc2498fc221098155afb May 27 21:39:20.186738 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.186707 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k688w" event={"ID":"d9cbb529-7b64-41ee-b006-c085869a4edd","Type":"ContainerStarted","Data":"0be3ab6e014ba167736bab3ea1e04546ddf0474d60416609cbbf0591d1f8e005"} May 27 21:39:20.188296 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.188270 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75zhw" event={"ID":"18426b1e-b883-41fe-be53-64a05743a2b6","Type":"ContainerStarted","Data":"b343e20c73d071826bb2dc3578e5481237931722c0af064504ed170206d3a443"} May 27 21:39:20.188386 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.188307 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75zhw" event={"ID":"18426b1e-b883-41fe-be53-64a05743a2b6","Type":"ContainerStarted","Data":"316f93d76cd96138f9ab6e102c4a58237f3158b50d68d02fa84a2dca8a8c5c8f"} May 27 21:39:20.188386 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.188342 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-75zhw" May 27 21:39:20.189554 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.189534 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" event={"ID":"c7a64ac3-dae1-4f28-8947-3953878dd78c","Type":"ContainerStarted","Data":"ece7ea237c3f43903470541bbf3a82caa83416463076c7d76d0ae2d558ba30b4"} May 27 21:39:20.191172 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.191150 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" event={"ID":"7574c155-3aae-4c42-a7aa-3fed2d8dd78c","Type":"ContainerStarted","Data":"985fcf3f9f17d21865dd0bafaf5abfb1b79b4fafb56cd55f0d8f438d2383242f"} May 27 21:39:20.191265 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.191177 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" event={"ID":"7574c155-3aae-4c42-a7aa-3fed2d8dd78c","Type":"ContainerStarted","Data":"07ca3f049016aa94ac4e2eb7334ba8eee8d47b872127ab63343452909232d00e"} May 27 21:39:20.192402 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.192378 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59nj7" event={"ID":"ca6126a3-2842-4a7f-9a54-da9fac08d0ca","Type":"ContainerStarted","Data":"c37fd58ec9d402b3a82589f0563be1964b8c6f42e0a90df42ccc42610aa3ba90"} May 27 21:39:20.192489 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.192409 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59nj7" event={"ID":"ca6126a3-2842-4a7f-9a54-da9fac08d0ca","Type":"ContainerStarted","Data":"2a3566e4ebda4f913e96c524b3506408a4aa5e109f4fbc2498fc221098155afb"} May 27 21:39:20.193414 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.193396 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" event={"ID":"01aa57a0-f6b0-44a7-b90a-2c631372b819","Type":"ContainerStarted","Data":"9dbce34f3f317b6547218e6cfab70d3b8d257880062c86e0ab63a5f49de3c2c9"} May 27 21:39:20.203851 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.203803 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k688w" podStartSLOduration=34.193929946 podStartE2EDuration="38.203788941s" podCreationTimestamp="2026-05-27 21:38:42 +0000 UTC" firstStartedPulling="2026-05-27 21:39:15.058185781 +0000 UTC m=+66.913256640" lastFinishedPulling="2026-05-27 21:39:19.068044761 +0000 UTC m=+70.923115635" observedRunningTime="2026-05-27 21:39:20.202915479 +0000 UTC m=+72.057986357" watchObservedRunningTime="2026-05-27 21:39:20.203788941 +0000 UTC m=+72.058859823" May 27 21:39:20.218568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.218281 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j2nsz" podStartSLOduration=51.171510384 podStartE2EDuration="55.21826467s" podCreationTimestamp="2026-05-27 21:38:25 +0000 UTC" firstStartedPulling="2026-05-27 21:39:15.019393581 +0000 UTC m=+66.874464448" lastFinishedPulling="2026-05-27 21:39:19.066147855 +0000 UTC m=+70.921218734" observedRunningTime="2026-05-27 21:39:20.217798419 +0000 UTC m=+72.072869320" watchObservedRunningTime="2026-05-27 21:39:20.21826467 +0000 UTC m=+72.073335552" May 27 21:39:20.236733 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.236694 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-75zhw" podStartSLOduration=34.249243754 podStartE2EDuration="38.236683207s" podCreationTimestamp="2026-05-27 21:38:42 +0000 UTC" firstStartedPulling="2026-05-27 21:39:15.078706743 +0000 UTC m=+66.933777605" lastFinishedPulling="2026-05-27 21:39:19.066146198 +0000 UTC m=+70.921217058" observedRunningTime="2026-05-27 21:39:20.236320782 +0000 UTC m=+72.091391663" watchObservedRunningTime="2026-05-27 21:39:20.236683207 +0000 UTC m=+72.091754116" May 27 21:39:20.258331 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.258280 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qbmcv" podStartSLOduration=63.220613903 podStartE2EDuration="1m7.258263596s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:39:15.029910503 +0000 UTC m=+66.884981377" lastFinishedPulling="2026-05-27 21:39:19.067560203 +0000 UTC m=+70.922631070" observedRunningTime="2026-05-27 21:39:20.257454547 +0000 UTC m=+72.112525428" watchObservedRunningTime="2026-05-27 21:39:20.258263596 +0000 UTC m=+72.113334501" May 27 21:39:20.283830 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:20.283790 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-jcrtz" podStartSLOduration=63.213454211 podStartE2EDuration="1m7.283775371s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:39:15.002203187 +0000 UTC m=+66.857274059" lastFinishedPulling="2026-05-27 21:39:19.072524347 +0000 UTC m=+70.927595219" observedRunningTime="2026-05-27 21:39:20.282161593 +0000 UTC m=+72.137232474" watchObservedRunningTime="2026-05-27 21:39:20.283775371 +0000 UTC m=+72.138846272" May 27 21:39:21.197859 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:21.197800 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59nj7" event={"ID":"ca6126a3-2842-4a7f-9a54-da9fac08d0ca","Type":"ContainerStarted","Data":"5359af7e07de29223760ea7359044afd9030d32aa570797ddc519922c78fe189"} May 27 21:39:22.204249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:22.204212 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59nj7" event={"ID":"ca6126a3-2842-4a7f-9a54-da9fac08d0ca","Type":"ContainerStarted","Data":"18c86e0c840ff4d17a784fdb547da3ed5279016059c6d022954ae108489432f9"} May 27 21:39:22.226932 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:22.226863 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-59nj7" podStartSLOduration=3.69406567 podStartE2EDuration="6.226850551s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:19.361069635 +0000 UTC m=+71.216140497" lastFinishedPulling="2026-05-27 21:39:21.893854519 +0000 UTC m=+73.748925378" observedRunningTime="2026-05-27 21:39:22.22484261 +0000 UTC m=+74.079913491" watchObservedRunningTime="2026-05-27 21:39:22.226850551 +0000 UTC m=+74.081921433" May 27 21:39:23.753362 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:23.753327 2555 scope.go:117] "RemoveContainer" containerID="7e174d2a36c2e34068ad1fee92409217d0d6e634e44aa16238eb0aa5f34cd5d8" May 27 21:39:24.211605 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:24.211579 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:39:24.211750 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:24.211643 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" event={"ID":"28e6fc5b-7fc9-47fa-b373-000f1d19a782","Type":"ContainerStarted","Data":"6d5c49095b25f28457f710120f4cd8e3cc1bc3cf9c741f83970ab71cf43fa222"} May 27 21:39:24.211956 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:24.211927 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:24.224135 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:24.224107 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" May 27 21:39:24.234492 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:24.234452 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-vdrrs" podStartSLOduration=62.978805464 podStartE2EDuration="1m11.23443905s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:43.179719469 +0000 UTC m=+35.034790333" lastFinishedPulling="2026-05-27 21:38:51.435353059 +0000 UTC m=+43.290423919" observedRunningTime="2026-05-27 21:39:24.233358941 +0000 UTC m=+76.088429829" watchObservedRunningTime="2026-05-27 21:39:24.23443905 +0000 UTC m=+76.089509931" May 27 21:39:29.168818 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.168710 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9p87m"] May 27 21:39:29.200123 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.200088 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9p87m"] May 27 21:39:29.200253 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.200211 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.203677 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.203655 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 21:39:29.203677 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.203670 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 21:39:29.204221 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.204199 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wqjrd\"" May 27 21:39:29.204323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.204248 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 21:39:29.214503 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.214482 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gtsvn"] May 27 21:39:29.236151 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.236132 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.238238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.238220 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hph2b\"" May 27 21:39:29.238759 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.238742 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 21:39:29.238997 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.238977 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 21:39:29.239350 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.239334 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 21:39:29.359811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.359784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.359811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.359816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w99w\" (UniqueName: \"kubernetes.io/projected/f9ec7979-06ac-45bb-9217-7f510c3a4466-kube-api-access-9w99w\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.359843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.360032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.359921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-root\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.359971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-sys\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88gkc\" (UniqueName: \"kubernetes.io/projected/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-kube-api-access-88gkc\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-textfile\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-wtmp\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-metrics-client-ca\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.360214 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.360215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.460835 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460769 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.460835 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460814 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-sys\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.460835 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460832 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88gkc\" (UniqueName: \"kubernetes.io/projected/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-kube-api-access-88gkc\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460863 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-textfile\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460882 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-wtmp\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:29.460942 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460993 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:29.461015 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls podName:f9ec7979-06ac-45bb-9217-7f510c3a4466 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:29.960992096 +0000 UTC m=+81.816062974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls") pod "node-exporter-gtsvn" (UID: "f9ec7979-06ac-45bb-9217-7f510c3a4466") : secret "node-exporter-tls" not found May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.460906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-sys\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461071 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-wtmp\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461116 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-metrics-client-ca\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461145 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461225 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9w99w\" (UniqueName: \"kubernetes.io/projected/f9ec7979-06ac-45bb-9217-7f510c3a4466-kube-api-access-9w99w\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-textfile\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461265 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461301 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-root\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461385 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9ec7979-06ac-45bb-9217-7f510c3a4466-root\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461835 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.461924 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.461866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.462146 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.462123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ec7979-06ac-45bb-9217-7f510c3a4466-metrics-client-ca\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.463565 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.463544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.463565 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.463563 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.463801 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.463782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.477174 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.477154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w99w\" (UniqueName: \"kubernetes.io/projected/f9ec7979-06ac-45bb-9217-7f510c3a4466-kube-api-access-9w99w\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.478152 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.478133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88gkc\" (UniqueName: \"kubernetes.io/projected/c8fcfb5a-2ca7-4201-9944-7f5a6788c38d-kube-api-access-88gkc\") pod \"openshift-state-metrics-9c959559f-9p87m\" (UID: \"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.509398 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.509376 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" May 27 21:39:29.641048 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.641023 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9p87m"] May 27 21:39:29.643452 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:29.643412 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fcfb5a_2ca7_4201_9944_7f5a6788c38d.slice/crio-68a1ab51f88b26e0e1d9932d08a6a223fa1b56eed7e8d217e5855cae94bea897 WatchSource:0}: Error finding container 68a1ab51f88b26e0e1d9932d08a6a223fa1b56eed7e8d217e5855cae94bea897: Status 404 returned error can't find the container with id 68a1ab51f88b26e0e1d9932d08a6a223fa1b56eed7e8d217e5855cae94bea897 May 27 21:39:29.966103 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.966071 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:29.968382 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:29.968362 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9ec7979-06ac-45bb-9217-7f510c3a4466-node-exporter-tls\") pod \"node-exporter-gtsvn\" (UID: \"f9ec7979-06ac-45bb-9217-7f510c3a4466\") " pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:30.145414 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.145336 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtsvn" May 27 21:39:30.153728 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:30.153701 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ec7979_06ac_45bb_9217_7f510c3a4466.slice/crio-8009e29a89cdba4b5a14c31875cb1ffc8bfce7c34e1ed6518d8de97c94ef0ffa WatchSource:0}: Error finding container 8009e29a89cdba4b5a14c31875cb1ffc8bfce7c34e1ed6518d8de97c94ef0ffa: Status 404 returned error can't find the container with id 8009e29a89cdba4b5a14c31875cb1ffc8bfce7c34e1ed6518d8de97c94ef0ffa May 27 21:39:30.201328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.201306 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-75zhw" May 27 21:39:30.230334 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.230282 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtsvn" event={"ID":"f9ec7979-06ac-45bb-9217-7f510c3a4466","Type":"ContainerStarted","Data":"8009e29a89cdba4b5a14c31875cb1ffc8bfce7c34e1ed6518d8de97c94ef0ffa"} May 27 21:39:30.232464 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.232423 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" event={"ID":"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d","Type":"ContainerStarted","Data":"1c4874fe37abb46164e0313c6b7f517d097ae0a0c9b55797cc0911dd1a46a79a"} May 27 21:39:30.232464 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.232457 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" event={"ID":"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d","Type":"ContainerStarted","Data":"70ddb5debdc2c5cc30c2bd95ba0e41ba84b371c6b6906be9a3e688d584c709b1"} May 27 21:39:30.232646 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.232471 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" event={"ID":"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d","Type":"ContainerStarted","Data":"68a1ab51f88b26e0e1d9932d08a6a223fa1b56eed7e8d217e5855cae94bea897"} May 27 21:39:30.264719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.264686 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:39:30.268210 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.268185 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.270140 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270115 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:39:30.270351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270332 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:39:30.270650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270630 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:39:30.270734 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270638 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:39:30.270799 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270782 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:39:30.271030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270874 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:39:30.271030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270927 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:39:30.271030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.270936 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:39:30.271030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.271014 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k49l2\"" May 27 21:39:30.271253 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.271124 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:39:30.283238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.283215 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:39:30.369428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369601 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.369660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.370121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.370121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.370121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.370121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.370121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.369791 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrcb\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472157 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472128 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrcb\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472169 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472221 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472246 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472267 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472705 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472668 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472765 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:30.472699 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle podName:ebab1227-1167-444f-9a22-c3bcf0e79b32 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:30.972675916 +0000 UTC m=+82.827746786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32") : configmap references non-existent config key: ca-bundle.crt May 27 21:39:30.472765 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:30.472753 2555 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 27 21:39:30.472871 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472762 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.472871 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:39:30.472803 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls podName:ebab1227-1167-444f-9a22-c3bcf0e79b32 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:30.972785062 +0000 UTC m=+82.827855924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32") : secret "alertmanager-main-tls" not found May 27 21:39:30.472871 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472822 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473093 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472884 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473093 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472934 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473093 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.472978 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473093 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.473003 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473683 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.473442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.473683 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.473517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.475561 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.475509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.476855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.476827 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.477170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.477148 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.477265 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.477158 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.477600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.477578 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.478954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.478599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.478954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.478912 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.479761 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.479736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.484919 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.484880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrcb\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.976347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.976307 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.976516 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.976373 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.977261 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.977230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:30.979450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:30.979415 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:31.183200 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.183164 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:39:31.240103 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.240072 2555 generic.go:358] "Generic (PLEG): container finished" podID="f9ec7979-06ac-45bb-9217-7f510c3a4466" containerID="b61a0b92f97c10c6cf15deeda3cbb0d5923c4141be149c8bf23863c733ec6fd5" exitCode=0 May 27 21:39:31.240437 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.240153 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtsvn" event={"ID":"f9ec7979-06ac-45bb-9217-7f510c3a4466","Type":"ContainerDied","Data":"b61a0b92f97c10c6cf15deeda3cbb0d5923c4141be149c8bf23863c733ec6fd5"} May 27 21:39:31.242599 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.242577 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" event={"ID":"c8fcfb5a-2ca7-4201-9944-7f5a6788c38d","Type":"ContainerStarted","Data":"4247341ff126f2f45dab6ef18a0677d06a26530630937807c9df8d17cdbc28b8"} May 27 21:39:31.274477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.274444 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z"] May 27 21:39:31.278579 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.278527 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.282876 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.282852 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 21:39:31.283004 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.282938 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 21:39:31.283004 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.282948 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 21:39:31.283004 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.282993 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a03p7sml04ejc\"" May 27 21:39:31.283170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.282938 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 21:39:31.283170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.283094 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 21:39:31.283315 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.283300 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f85sv\"" May 27 21:39:31.288820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.288771 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9p87m" podStartSLOduration=1.275081708 podStartE2EDuration="2.288755904s" podCreationTimestamp="2026-05-27 21:39:29 +0000 UTC" firstStartedPulling="2026-05-27 21:39:29.798036644 +0000 UTC m=+81.653107506" lastFinishedPulling="2026-05-27 21:39:30.811710839 +0000 UTC m=+82.666781702" observedRunningTime="2026-05-27 21:39:31.287737605 +0000 UTC m=+83.142808519" watchObservedRunningTime="2026-05-27 21:39:31.288755904 +0000 UTC m=+83.143826787" May 27 21:39:31.296613 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.296583 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z"] May 27 21:39:31.332125 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.332101 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:39:31.346970 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:31.346947 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebab1227_1167_444f_9a22_c3bcf0e79b32.slice/crio-6910b497ad2de5108b244594f27bf376147d5b3950bffe8b4e33cb187f33e8d6 WatchSource:0}: Error finding container 6910b497ad2de5108b244594f27bf376147d5b3950bffe8b4e33cb187f33e8d6: Status 404 returned error can't find the container with id 6910b497ad2de5108b244594f27bf376147d5b3950bffe8b4e33cb187f33e8d6 May 27 21:39:31.380320 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-metrics-client-ca\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380412 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm284\" (UniqueName: \"kubernetes.io/projected/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-kube-api-access-cm284\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380412 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-grpc-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380667 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380544 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.380667 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.380572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481612 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481581 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm284\" (UniqueName: \"kubernetes.io/projected/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-kube-api-access-cm284\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481622 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-grpc-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481654 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481687 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481716 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.481752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481744 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.482059 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481771 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.482059 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.481812 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-metrics-client-ca\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.482906 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.482825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-metrics-client-ca\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.484586 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.484562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.484705 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.484595 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.484800 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.484783 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.485052 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.485031 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-grpc-tls\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.485132 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.485103 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.485418 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.485400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.490102 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.490084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm284\" (UniqueName: \"kubernetes.io/projected/da9e2bda-a969-47c0-9f11-9aa0ecc54f98-kube-api-access-cm284\") pod \"thanos-querier-5dcb5c7694-9lc9z\" (UID: \"da9e2bda-a969-47c0-9f11-9aa0ecc54f98\") " pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.599671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.599611 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:31.735701 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:31.735673 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z"] May 27 21:39:31.738153 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:31.738121 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9e2bda_a969_47c0_9f11_9aa0ecc54f98.slice/crio-59a59cededd04f91caf8df7613a00969384ba89338f295e8431a1857917bd43d WatchSource:0}: Error finding container 59a59cededd04f91caf8df7613a00969384ba89338f295e8431a1857917bd43d: Status 404 returned error can't find the container with id 59a59cededd04f91caf8df7613a00969384ba89338f295e8431a1857917bd43d May 27 21:39:32.247162 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:32.247123 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"6910b497ad2de5108b244594f27bf376147d5b3950bffe8b4e33cb187f33e8d6"} May 27 21:39:32.248373 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:32.248344 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"59a59cededd04f91caf8df7613a00969384ba89338f295e8431a1857917bd43d"} May 27 21:39:32.250521 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:32.250497 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtsvn" event={"ID":"f9ec7979-06ac-45bb-9217-7f510c3a4466","Type":"ContainerStarted","Data":"16c6d06e6f5c192e34ba41f54027250954cd9627b183bda1301372fb3ab13fa1"} May 27 21:39:32.250642 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:32.250526 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtsvn" event={"ID":"f9ec7979-06ac-45bb-9217-7f510c3a4466","Type":"ContainerStarted","Data":"a0eb8800c78600cc76f738dacbfadee43f20cdd526c5572e30e669a7cbe22c6d"} May 27 21:39:32.281944 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:32.281879 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gtsvn" podStartSLOduration=2.373243207 podStartE2EDuration="3.281867404s" podCreationTimestamp="2026-05-27 21:39:29 +0000 UTC" firstStartedPulling="2026-05-27 21:39:30.155332886 +0000 UTC m=+82.010403744" lastFinishedPulling="2026-05-27 21:39:31.063957083 +0000 UTC m=+82.919027941" observedRunningTime="2026-05-27 21:39:32.27877907 +0000 UTC m=+84.133849951" watchObservedRunningTime="2026-05-27 21:39:32.281867404 +0000 UTC m=+84.136938296" May 27 21:39:33.139967 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.139933 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:39:33.142178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.142156 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.144689 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.144666 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 21:39:33.144822 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.144707 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 21:39:33.144822 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.144669 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 21:39:33.145275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.145258 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 21:39:33.145275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.145265 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 21:39:33.145417 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.145339 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 21:39:33.148719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.146112 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bdvmj\"" May 27 21:39:33.148719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.146368 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 21:39:33.154641 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.154616 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:39:33.195821 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.195794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.195956 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.195834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.195956 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.195879 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.195956 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.195945 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.196131 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.195979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdph\" (UniqueName: \"kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.196131 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.196026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.254944 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.254809 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b" exitCode=0 May 27 21:39:33.254944 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.254847 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b"} May 27 21:39:33.297265 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.297229 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.297410 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.297313 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdph\" (UniqueName: \"kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.297410 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.297345 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.297780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.297755 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.297875 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.297783 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.298030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.298001 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.298489 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.298463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.298674 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.298647 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.298767 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.298734 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.300442 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.300422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.300679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.300657 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.308873 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.308850 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdph\" (UniqueName: \"kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph\") pod \"console-d85dc7f6f-c7jx9\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.455966 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.455927 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:33.891374 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.891346 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:39:33.897453 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:33.897402 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0522386_728d_40bd_ae0c_ee6299f1d621.slice/crio-913bcbf8a8f87056885cc6c36c3311e08df2e11c88347b4894318c970c3c81ba WatchSource:0}: Error finding container 913bcbf8a8f87056885cc6c36c3311e08df2e11c88347b4894318c970c3c81ba: Status 404 returned error can't find the container with id 913bcbf8a8f87056885cc6c36c3311e08df2e11c88347b4894318c970c3c81ba May 27 21:39:33.968219 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.967415 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp"] May 27 21:39:33.970963 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.970945 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:33.973165 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.973143 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 27 21:39:33.973256 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.973206 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-hcrgm\"" May 27 21:39:33.977548 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:33.977526 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp"] May 27 21:39:34.004846 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.004822 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81cd9965-3190-4f8d-9466-641bbea3177a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4qxmp\" (UID: \"81cd9965-3190-4f8d-9466-641bbea3177a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:34.105378 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.105294 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81cd9965-3190-4f8d-9466-641bbea3177a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4qxmp\" (UID: \"81cd9965-3190-4f8d-9466-641bbea3177a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:34.108134 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.108109 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/81cd9965-3190-4f8d-9466-641bbea3177a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4qxmp\" (UID: \"81cd9965-3190-4f8d-9466-641bbea3177a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:34.259813 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.259778 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"ccefbf15b654dd7018086a625a0ac0f2686ef298d5f9a372ca26fc3c427abfca"} May 27 21:39:34.260190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.259818 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"2dcfab24ed780594cb054b8c765dc8f1c8a192d0015de7e166f8d7e4e2d7fcb8"} May 27 21:39:34.260190 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.259833 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"5961b017365065d7935d96bebfbbbaa51f27bad55a7e5f83cda470e07e9b1d5a"} May 27 21:39:34.260980 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.260950 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85dc7f6f-c7jx9" event={"ID":"e0522386-728d-40bd-ae0c-ee6299f1d621","Type":"ContainerStarted","Data":"913bcbf8a8f87056885cc6c36c3311e08df2e11c88347b4894318c970c3c81ba"} May 27 21:39:34.290086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.290067 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:34.462323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:34.462288 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp"] May 27 21:39:34.464668 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:34.464633 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cd9965_3190_4f8d_9466_641bbea3177a.slice/crio-8db0d6cb958b58350763f8198a15907732489498c12ebfd6ad12c8728cfc60e1 WatchSource:0}: Error finding container 8db0d6cb958b58350763f8198a15907732489498c12ebfd6ad12c8728cfc60e1: Status 404 returned error can't find the container with id 8db0d6cb958b58350763f8198a15907732489498c12ebfd6ad12c8728cfc60e1 May 27 21:39:35.268433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:35.268401 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"de8e6b8d724f51a98355052f39fcca02578573422cae2ce1e1f923dcc6b73ab5"} May 27 21:39:35.268433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:35.268439 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"c4bdd49b2407e0aaa3440fe4b1f0078edea071af236ca3469b9a0233041b429c"} May 27 21:39:35.272463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:35.272438 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" event={"ID":"81cd9965-3190-4f8d-9466-641bbea3177a","Type":"ContainerStarted","Data":"8db0d6cb958b58350763f8198a15907732489498c12ebfd6ad12c8728cfc60e1"} May 27 21:39:37.180170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.180145 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:39:37.281983 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.281877 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763"} May 27 21:39:37.281983 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.281953 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4"} May 27 21:39:37.283280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.283256 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" event={"ID":"81cd9965-3190-4f8d-9466-641bbea3177a","Type":"ContainerStarted","Data":"25fe438e6b2c08a08aab614b482bd3be3a1cf03bb0ccc3b55ddfa20cdceff419"} May 27 21:39:37.283590 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.283568 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:37.291011 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.290961 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" event={"ID":"da9e2bda-a969-47c0-9f11-9aa0ecc54f98","Type":"ContainerStarted","Data":"0a9e28ce0461491e95f577a82bc29c5e83a2a1a37cabc4d9d9dab60749a2ff70"} May 27 21:39:37.291296 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.291275 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:37.291573 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.291551 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" May 27 21:39:37.292780 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.292521 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85dc7f6f-c7jx9" event={"ID":"e0522386-728d-40bd-ae0c-ee6299f1d621","Type":"ContainerStarted","Data":"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417"} May 27 21:39:37.306582 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.306530 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4qxmp" podStartSLOduration=1.709754674 podStartE2EDuration="4.306517769s" podCreationTimestamp="2026-05-27 21:39:33 +0000 UTC" firstStartedPulling="2026-05-27 21:39:34.467118585 +0000 UTC m=+86.322189444" lastFinishedPulling="2026-05-27 21:39:37.063881665 +0000 UTC m=+88.918952539" observedRunningTime="2026-05-27 21:39:37.304643422 +0000 UTC m=+89.159714303" watchObservedRunningTime="2026-05-27 21:39:37.306517769 +0000 UTC m=+89.161588684" May 27 21:39:37.329575 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.329536 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" podStartSLOduration=2.97308805 podStartE2EDuration="6.329522856s" podCreationTimestamp="2026-05-27 21:39:31 +0000 UTC" firstStartedPulling="2026-05-27 21:39:31.740118071 +0000 UTC m=+83.595188930" lastFinishedPulling="2026-05-27 21:39:35.096552873 +0000 UTC m=+86.951623736" observedRunningTime="2026-05-27 21:39:37.328202983 +0000 UTC m=+89.183273877" watchObservedRunningTime="2026-05-27 21:39:37.329522856 +0000 UTC m=+89.184593736" May 27 21:39:37.348379 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.348321 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d85dc7f6f-c7jx9" podStartSLOduration=1.179301563 podStartE2EDuration="4.348303667s" podCreationTimestamp="2026-05-27 21:39:33 +0000 UTC" firstStartedPulling="2026-05-27 21:39:33.900048298 +0000 UTC m=+85.755119157" lastFinishedPulling="2026-05-27 21:39:37.069050392 +0000 UTC m=+88.924121261" observedRunningTime="2026-05-27 21:39:37.347319379 +0000 UTC m=+89.202390261" watchObservedRunningTime="2026-05-27 21:39:37.348303667 +0000 UTC m=+89.203374548" May 27 21:39:37.954078 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:37.954039 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:39:38.298262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.298168 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d"} May 27 21:39:38.298262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.298217 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665"} May 27 21:39:38.298262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.298228 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4"} May 27 21:39:38.298262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.298237 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerStarted","Data":"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73"} May 27 21:39:38.303683 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.303660 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dcb5c7694-9lc9z" May 27 21:39:38.330686 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:38.330643 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6174186600000002 podStartE2EDuration="8.330631683s" podCreationTimestamp="2026-05-27 21:39:30 +0000 UTC" firstStartedPulling="2026-05-27 21:39:31.349122781 +0000 UTC m=+83.204193644" lastFinishedPulling="2026-05-27 21:39:37.062335792 +0000 UTC m=+88.917406667" observedRunningTime="2026-05-27 21:39:38.327914167 +0000 UTC m=+90.182985048" watchObservedRunningTime="2026-05-27 21:39:38.330631683 +0000 UTC m=+90.185702567" May 27 21:39:41.130693 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.130658 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:39:41.133312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.133294 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.140431 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.140402 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 21:39:41.143522 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.143501 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:39:41.170409 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170379 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170511 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170511 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170436 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lcq\" (UniqueName: \"kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.170705 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.170602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.271823 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.271793 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.271950 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.271825 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.271950 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.271851 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lcq\" (UniqueName: \"kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272023 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.271999 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272065 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.272050 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272110 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.272080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272110 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.272106 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272541 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.272519 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.272968 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.272946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.273156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.273131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.273231 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.273139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.274415 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.274392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.274486 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.274395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.287059 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.287033 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lcq\" (UniqueName: \"kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq\") pod \"console-6d5f967c95-m55tr\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.443496 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.443471 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:41.571421 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:41.571361 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:39:41.573541 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:39:41.573518 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d37d5cf_5396_462e_8c27_5f6d55d9a4cc.slice/crio-57d5f8fde996dc19805ead1f641165ac12186ac0567e70a46465cd9fd1c01773 WatchSource:0}: Error finding container 57d5f8fde996dc19805ead1f641165ac12186ac0567e70a46465cd9fd1c01773: Status 404 returned error can't find the container with id 57d5f8fde996dc19805ead1f641165ac12186ac0567e70a46465cd9fd1c01773 May 27 21:39:42.312524 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:42.312490 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f967c95-m55tr" event={"ID":"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc","Type":"ContainerStarted","Data":"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a"} May 27 21:39:42.312524 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:42.312522 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f967c95-m55tr" event={"ID":"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc","Type":"ContainerStarted","Data":"57d5f8fde996dc19805ead1f641165ac12186ac0567e70a46465cd9fd1c01773"} May 27 21:39:42.338365 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:42.338324 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d5f967c95-m55tr" podStartSLOduration=1.338307587 podStartE2EDuration="1.338307587s" podCreationTimestamp="2026-05-27 21:39:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:42.337271192 +0000 UTC m=+94.192342073" watchObservedRunningTime="2026-05-27 21:39:42.338307587 +0000 UTC m=+94.193378467" May 27 21:39:43.457081 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:43.457045 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:43.457081 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:43.457085 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:43.461749 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:43.461730 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:44.324006 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:44.323976 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:39:45.166811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:45.166777 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2mk6t" May 27 21:39:51.444432 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:51.444399 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:51.444829 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:51.444451 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:51.449432 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:51.449407 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:52.348737 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:52.348707 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:39:52.404391 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:39:52.404362 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:40:02.975574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:02.975533 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" podUID="4bb857ea-667c-4806-825b-74a2ebb6d124" containerName="registry" containerID="cri-o://3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367" gracePeriod=30 May 27 21:40:03.214038 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.214014 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:40:03.349249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349168 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349217 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6tzd\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349241 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349491 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349309 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349491 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349338 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349491 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349363 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349491 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349390 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349491 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349484 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca\") pod \"4bb857ea-667c-4806-825b-74a2ebb6d124\" (UID: \"4bb857ea-667c-4806-825b-74a2ebb6d124\") " May 27 21:40:03.349728 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349644 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:03.349961 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.349792 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-certificates\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.350244 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.350082 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:03.352178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.352063 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:03.352178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.352125 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:03.352378 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.352266 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:03.352430 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.352376 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:03.352430 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.352382 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd" (OuterVolumeSpecName: "kube-api-access-j6tzd") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "kube-api-access-j6tzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:03.357808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.357783 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4bb857ea-667c-4806-825b-74a2ebb6d124" (UID: "4bb857ea-667c-4806-825b-74a2ebb6d124"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:40:03.376509 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.376477 2555 generic.go:358] "Generic (PLEG): container finished" podID="4bb857ea-667c-4806-825b-74a2ebb6d124" containerID="3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367" exitCode=0 May 27 21:40:03.376628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.376536 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" May 27 21:40:03.376628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.376564 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" event={"ID":"4bb857ea-667c-4806-825b-74a2ebb6d124","Type":"ContainerDied","Data":"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367"} May 27 21:40:03.376628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.376609 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd5d8c848-7sls7" event={"ID":"4bb857ea-667c-4806-825b-74a2ebb6d124","Type":"ContainerDied","Data":"9874540ef407f6b71d4d720c26d750ee8b637a1eacc7aee78566dd5b644a3e5c"} May 27 21:40:03.376791 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.376627 2555 scope.go:117] "RemoveContainer" containerID="3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367" May 27 21:40:03.385540 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.385521 2555 scope.go:117] "RemoveContainer" containerID="3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367" May 27 21:40:03.385808 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:03.385788 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367\": container with ID starting with 3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367 not found: ID does not exist" containerID="3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367" May 27 21:40:03.385855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.385816 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367"} err="failed to get container status \"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367\": rpc error: code = NotFound desc = could not find container \"3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367\": container with ID starting with 3a832f6196bc5266484fd368ebfe78efebcd9c2ec859a75927af6e1be222f367 not found: ID does not exist" May 27 21:40:03.402785 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.402762 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:40:03.409819 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.409799 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cd5d8c848-7sls7"] May 27 21:40:03.451141 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451121 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6tzd\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-kube-api-access-j6tzd\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451141 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bb857ea-667c-4806-825b-74a2ebb6d124-ca-trust-extracted\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451153 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-installation-pull-secrets\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451163 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bb857ea-667c-4806-825b-74a2ebb6d124-image-registry-private-configuration\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451173 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-registry-tls\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451181 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bb857ea-667c-4806-825b-74a2ebb6d124-bound-sa-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:03.451216 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:03.451188 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bb857ea-667c-4806-825b-74a2ebb6d124-trusted-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:04.757125 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:04.757092 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb857ea-667c-4806-825b-74a2ebb6d124" path="/var/lib/kubelet/pods/4bb857ea-667c-4806-825b-74a2ebb6d124/volumes" May 27 21:40:13.404471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:13.404428 2555 generic.go:358] "Generic (PLEG): container finished" podID="3884e3c2-e17e-4070-b9a4-be170e789e70" containerID="e77c23e39d6ca68444b8446dcb195c3466ffd462d9f0ff224c5a8007854b5bc1" exitCode=0 May 27 21:40:13.404855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:13.404504 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" event={"ID":"3884e3c2-e17e-4070-b9a4-be170e789e70","Type":"ContainerDied","Data":"e77c23e39d6ca68444b8446dcb195c3466ffd462d9f0ff224c5a8007854b5bc1"} May 27 21:40:13.404855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:13.404816 2555 scope.go:117] "RemoveContainer" containerID="e77c23e39d6ca68444b8446dcb195c3466ffd462d9f0ff224c5a8007854b5bc1" May 27 21:40:14.408957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:14.408921 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bx4lk" event={"ID":"3884e3c2-e17e-4070-b9a4-be170e789e70","Type":"ContainerStarted","Data":"a04863be51c87fa67bba4f89cb1357127c1d7c8639b738725b6ef267775eb764"} May 27 21:40:17.430987 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.430948 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d85dc7f6f-c7jx9" podUID="e0522386-728d-40bd-ae0c-ee6299f1d621" containerName="console" containerID="cri-o://b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417" gracePeriod=15 May 27 21:40:17.671012 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.670990 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d85dc7f6f-c7jx9_e0522386-728d-40bd-ae0c-ee6299f1d621/console/0.log" May 27 21:40:17.671113 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.671053 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:40:17.771021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.770953 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.770988 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771021 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771010 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcdph\" (UniqueName: \"kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771212 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771042 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771212 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771175 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771310 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771278 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config\") pod \"e0522386-728d-40bd-ae0c-ee6299f1d621\" (UID: \"e0522386-728d-40bd-ae0c-ee6299f1d621\") " May 27 21:40:17.771405 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771380 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:17.771467 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771405 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:17.771638 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771617 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config" (OuterVolumeSpecName: "console-config") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:17.772099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771752 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:17.772099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.771826 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:17.773377 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.773349 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:17.773482 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.773370 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:17.773482 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.773375 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph" (OuterVolumeSpecName: "kube-api-access-gcdph") pod "e0522386-728d-40bd-ae0c-ee6299f1d621" (UID: "e0522386-728d-40bd-ae0c-ee6299f1d621"). InnerVolumeSpecName "kube-api-access-gcdph". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:17.872711 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.872688 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:17.872711 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.872711 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcdph\" (UniqueName: \"kubernetes.io/projected/e0522386-728d-40bd-ae0c-ee6299f1d621-kube-api-access-gcdph\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:17.872834 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.872722 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0522386-728d-40bd-ae0c-ee6299f1d621-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:17.872834 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:17.872731 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0522386-728d-40bd-ae0c-ee6299f1d621-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:18.421434 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421406 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d85dc7f6f-c7jx9_e0522386-728d-40bd-ae0c-ee6299f1d621/console/0.log" May 27 21:40:18.421606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421449 2555 generic.go:358] "Generic (PLEG): container finished" podID="e0522386-728d-40bd-ae0c-ee6299f1d621" containerID="b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417" exitCode=2 May 27 21:40:18.421606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421480 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85dc7f6f-c7jx9" event={"ID":"e0522386-728d-40bd-ae0c-ee6299f1d621","Type":"ContainerDied","Data":"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417"} May 27 21:40:18.421606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421515 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85dc7f6f-c7jx9" May 27 21:40:18.421606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421530 2555 scope.go:117] "RemoveContainer" containerID="b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417" May 27 21:40:18.421606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.421519 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85dc7f6f-c7jx9" event={"ID":"e0522386-728d-40bd-ae0c-ee6299f1d621","Type":"ContainerDied","Data":"913bcbf8a8f87056885cc6c36c3311e08df2e11c88347b4894318c970c3c81ba"} May 27 21:40:18.429704 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.429685 2555 scope.go:117] "RemoveContainer" containerID="b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417" May 27 21:40:18.430039 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:18.430021 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417\": container with ID starting with b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417 not found: ID does not exist" containerID="b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417" May 27 21:40:18.430096 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.430048 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417"} err="failed to get container status \"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417\": rpc error: code = NotFound desc = could not find container \"b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417\": container with ID starting with b9314976043263fd32df53b351d8c28d2aca00da4617ed8dd335844c7e3ad417 not found: ID does not exist" May 27 21:40:18.443660 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.443631 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:40:18.449713 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.449694 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d85dc7f6f-c7jx9"] May 27 21:40:18.755940 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:18.755868 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0522386-728d-40bd-ae0c-ee6299f1d621" path="/var/lib/kubelet/pods/e0522386-728d-40bd-ae0c-ee6299f1d621/volumes" May 27 21:40:22.434879 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:22.434847 2555 generic.go:358] "Generic (PLEG): container finished" podID="4012efd7-2087-41c7-80b7-f9aa8d76273d" containerID="d0d2781bb92634f315e6dbe91f793e39c09b36865eae8f036ccc152ec1250f16" exitCode=0 May 27 21:40:22.435270 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:22.434923 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" event={"ID":"4012efd7-2087-41c7-80b7-f9aa8d76273d","Type":"ContainerDied","Data":"d0d2781bb92634f315e6dbe91f793e39c09b36865eae8f036ccc152ec1250f16"} May 27 21:40:22.435270 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:22.435212 2555 scope.go:117] "RemoveContainer" containerID="d0d2781bb92634f315e6dbe91f793e39c09b36865eae8f036ccc152ec1250f16" May 27 21:40:23.440282 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:23.440241 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-9fdnl" event={"ID":"4012efd7-2087-41c7-80b7-f9aa8d76273d","Type":"ContainerStarted","Data":"f4cc70dec72f740db2752f6ad84cc004a991b83414b99cc9c6ed66028c33a4b5"} May 27 21:40:28.455981 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:28.455946 2555 generic.go:358] "Generic (PLEG): container finished" podID="9d07ff76-0915-4b2b-a125-211d834818fa" containerID="b8e7d632cb5d81126e92cba49e45052efe003d4bdeca39b3a56ef7b59ea561c0" exitCode=0 May 27 21:40:28.456335 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:28.456020 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" event={"ID":"9d07ff76-0915-4b2b-a125-211d834818fa","Type":"ContainerDied","Data":"b8e7d632cb5d81126e92cba49e45052efe003d4bdeca39b3a56ef7b59ea561c0"} May 27 21:40:28.456380 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:28.456369 2555 scope.go:117] "RemoveContainer" containerID="b8e7d632cb5d81126e92cba49e45052efe003d4bdeca39b3a56ef7b59ea561c0" May 27 21:40:29.461566 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:29.461531 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8kjtr" event={"ID":"9d07ff76-0915-4b2b-a125-211d834818fa","Type":"ContainerStarted","Data":"c4c7ae936ed29a4c69b87dd1337441b8b649eed6cd7769db9e59e11879f20583"} May 27 21:40:49.695259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695221 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:49.695671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695631 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="alertmanager" containerID="cri-o://e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" gracePeriod=120 May 27 21:40:49.695750 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695697 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-metric" containerID="cri-o://3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" gracePeriod=120 May 27 21:40:49.695750 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695714 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-web" containerID="cri-o://d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" gracePeriod=120 May 27 21:40:49.695974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695732 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="config-reloader" containerID="cri-o://55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" gracePeriod=120 May 27 21:40:49.695974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695753 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy" containerID="cri-o://462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" gracePeriod=120 May 27 21:40:49.695974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:49.695778 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="prom-label-proxy" containerID="cri-o://e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" gracePeriod=120 May 27 21:40:50.528459 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528420 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" exitCode=0 May 27 21:40:50.528459 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528447 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" exitCode=0 May 27 21:40:50.528459 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528453 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" exitCode=0 May 27 21:40:50.528459 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528459 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" exitCode=0 May 27 21:40:50.528724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528497 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665"} May 27 21:40:50.528724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528530 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73"} May 27 21:40:50.528724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528543 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763"} May 27 21:40:50.528724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.528551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4"} May 27 21:40:50.943945 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:50.943920 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.038043 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.037956 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038043 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.037991 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038043 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038013 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038058 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038088 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038114 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038140 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038168 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038192 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038221 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038260 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldrcb\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038319 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038366 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config\") pod \"ebab1227-1167-444f-9a22-c3bcf0e79b32\" (UID: \"ebab1227-1167-444f-9a22-c3bcf0e79b32\") " May 27 21:40:51.038796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038563 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:51.038796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.038673 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.039061 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.039038 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:40:51.041441 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.041130 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:51.041567 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.041451 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.041724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.041693 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.042111 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.042082 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:40:51.042392 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.042360 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume" (OuterVolumeSpecName: "config-volume") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.043627 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.043599 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.043851 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.043810 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.044068 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.044047 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb" (OuterVolumeSpecName: "kube-api-access-ldrcb") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "kube-api-access-ldrcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:40:51.044417 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.044401 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out" (OuterVolumeSpecName: "config-out") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:40:51.047359 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.047178 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.055032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.055003 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config" (OuterVolumeSpecName: "web-config") pod "ebab1227-1167-444f-9a22-c3bcf0e79b32" (UID: "ebab1227-1167-444f-9a22-c3bcf0e79b32"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:40:51.139665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139641 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-main-tls\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139663 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-web-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139673 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139683 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139693 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-alertmanager-main-db\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139701 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebab1227-1167-444f-9a22-c3bcf0e79b32-config-out\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139711 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldrcb\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-kube-api-access-ldrcb\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139720 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebab1227-1167-444f-9a22-c3bcf0e79b32-metrics-client-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139730 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-cluster-tls-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139739 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139748 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebab1227-1167-444f-9a22-c3bcf0e79b32-tls-assets\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.139806 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.139757 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebab1227-1167-444f-9a22-c3bcf0e79b32-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:40:51.537139 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537108 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" exitCode=0 May 27 21:40:51.537139 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537134 2555 generic.go:358] "Generic (PLEG): container finished" podID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerID="d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" exitCode=0 May 27 21:40:51.537322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537162 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4"} May 27 21:40:51.537322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537192 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d"} May 27 21:40:51.537322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537202 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ebab1227-1167-444f-9a22-c3bcf0e79b32","Type":"ContainerDied","Data":"6910b497ad2de5108b244594f27bf376147d5b3950bffe8b4e33cb187f33e8d6"} May 27 21:40:51.537322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537216 2555 scope.go:117] "RemoveContainer" containerID="e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" May 27 21:40:51.537322 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.537251 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.545530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.545512 2555 scope.go:117] "RemoveContainer" containerID="3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" May 27 21:40:51.553532 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.553512 2555 scope.go:117] "RemoveContainer" containerID="462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" May 27 21:40:51.560435 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.560416 2555 scope.go:117] "RemoveContainer" containerID="d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" May 27 21:40:51.565099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.565078 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:51.567597 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.567581 2555 scope.go:117] "RemoveContainer" containerID="55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" May 27 21:40:51.571987 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.571964 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:51.574574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.574551 2555 scope.go:117] "RemoveContainer" containerID="e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" May 27 21:40:51.580833 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.580815 2555 scope.go:117] "RemoveContainer" containerID="6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b" May 27 21:40:51.587694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.587679 2555 scope.go:117] "RemoveContainer" containerID="e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" May 27 21:40:51.587934 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.587916 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665\": container with ID starting with e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665 not found: ID does not exist" containerID="e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" May 27 21:40:51.587984 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.587940 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665"} err="failed to get container status \"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665\": rpc error: code = NotFound desc = could not find container \"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665\": container with ID starting with e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665 not found: ID does not exist" May 27 21:40:51.587984 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.587958 2555 scope.go:117] "RemoveContainer" containerID="3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" May 27 21:40:51.588144 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.588126 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4\": container with ID starting with 3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4 not found: ID does not exist" containerID="3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" May 27 21:40:51.588206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588153 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4"} err="failed to get container status \"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4\": rpc error: code = NotFound desc = could not find container \"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4\": container with ID starting with 3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4 not found: ID does not exist" May 27 21:40:51.588206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588177 2555 scope.go:117] "RemoveContainer" containerID="462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" May 27 21:40:51.588388 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.588374 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73\": container with ID starting with 462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73 not found: ID does not exist" containerID="462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" May 27 21:40:51.588422 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588391 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73"} err="failed to get container status \"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73\": rpc error: code = NotFound desc = could not find container \"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73\": container with ID starting with 462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73 not found: ID does not exist" May 27 21:40:51.588422 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588404 2555 scope.go:117] "RemoveContainer" containerID="d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" May 27 21:40:51.588609 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.588594 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d\": container with ID starting with d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d not found: ID does not exist" containerID="d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" May 27 21:40:51.588646 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588612 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d"} err="failed to get container status \"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d\": rpc error: code = NotFound desc = could not find container \"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d\": container with ID starting with d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d not found: ID does not exist" May 27 21:40:51.588646 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588624 2555 scope.go:117] "RemoveContainer" containerID="55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" May 27 21:40:51.588801 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.588787 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763\": container with ID starting with 55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763 not found: ID does not exist" containerID="55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" May 27 21:40:51.588839 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588804 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763"} err="failed to get container status \"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763\": rpc error: code = NotFound desc = could not find container \"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763\": container with ID starting with 55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763 not found: ID does not exist" May 27 21:40:51.588839 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.588816 2555 scope.go:117] "RemoveContainer" containerID="e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" May 27 21:40:51.589048 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.589034 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4\": container with ID starting with e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4 not found: ID does not exist" containerID="e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" May 27 21:40:51.589095 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589049 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4"} err="failed to get container status \"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4\": rpc error: code = NotFound desc = could not find container \"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4\": container with ID starting with e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4 not found: ID does not exist" May 27 21:40:51.589095 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589061 2555 scope.go:117] "RemoveContainer" containerID="6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b" May 27 21:40:51.589231 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:40:51.589213 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b\": container with ID starting with 6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b not found: ID does not exist" containerID="6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b" May 27 21:40:51.589269 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589235 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b"} err="failed to get container status \"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b\": rpc error: code = NotFound desc = could not find container \"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b\": container with ID starting with 6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b not found: ID does not exist" May 27 21:40:51.589269 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589247 2555 scope.go:117] "RemoveContainer" containerID="e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665" May 27 21:40:51.589457 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589439 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665"} err="failed to get container status \"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665\": rpc error: code = NotFound desc = could not find container \"e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665\": container with ID starting with e102102bb002ef6d034234d1fb025471ff6f801804cebc76a3b5d11b2f80c665 not found: ID does not exist" May 27 21:40:51.589524 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589460 2555 scope.go:117] "RemoveContainer" containerID="3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4" May 27 21:40:51.589678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589659 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4"} err="failed to get container status \"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4\": rpc error: code = NotFound desc = could not find container \"3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4\": container with ID starting with 3be2507f4f4d763a6e3155c943d2245418bc1d205c8a46ca7f0599f7d57276c4 not found: ID does not exist" May 27 21:40:51.589726 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589679 2555 scope.go:117] "RemoveContainer" containerID="462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73" May 27 21:40:51.589916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589869 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73"} err="failed to get container status \"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73\": rpc error: code = NotFound desc = could not find container \"462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73\": container with ID starting with 462574f05084ca91911d8710bedb0f6eafd26c2b939136527ae1a4830ed0aa73 not found: ID does not exist" May 27 21:40:51.589971 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.589915 2555 scope.go:117] "RemoveContainer" containerID="d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d" May 27 21:40:51.590128 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590110 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d"} err="failed to get container status \"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d\": rpc error: code = NotFound desc = could not find container \"d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d\": container with ID starting with d437488196ec0241aa0bdef8b82c94a6d7f8969e6276826d9e151df4ed42637d not found: ID does not exist" May 27 21:40:51.590193 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590132 2555 scope.go:117] "RemoveContainer" containerID="55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763" May 27 21:40:51.590364 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590346 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763"} err="failed to get container status \"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763\": rpc error: code = NotFound desc = could not find container \"55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763\": container with ID starting with 55e2e4be63680dfa2e21a82937d690c52d340ea1ebf7db6ef231f02cd6377763 not found: ID does not exist" May 27 21:40:51.590411 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590364 2555 scope.go:117] "RemoveContainer" containerID="e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4" May 27 21:40:51.590582 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590563 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4"} err="failed to get container status \"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4\": rpc error: code = NotFound desc = could not find container \"e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4\": container with ID starting with e071be0779849790a3e1674af0517d821e9ce0afd0c35cd5b98ca0f213c449b4 not found: ID does not exist" May 27 21:40:51.590649 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590584 2555 scope.go:117] "RemoveContainer" containerID="6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b" May 27 21:40:51.590788 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.590770 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b"} err="failed to get container status \"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b\": rpc error: code = NotFound desc = could not find container \"6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b\": container with ID starting with 6bfb5e4dd06155fe940cac2f7f6ca504c23c9709f373d5d458194ad49a349f1b not found: ID does not exist" May 27 21:40:51.608587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.608565 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:51.609050 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609031 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="alertmanager" May 27 21:40:51.609098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609054 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="alertmanager" May 27 21:40:51.609098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609067 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-web" May 27 21:40:51.609098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609078 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-web" May 27 21:40:51.609098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609088 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy" May 27 21:40:51.609098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609096 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609108 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0522386-728d-40bd-ae0c-ee6299f1d621" containerName="console" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609117 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0522386-728d-40bd-ae0c-ee6299f1d621" containerName="console" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609128 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="prom-label-proxy" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609136 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="prom-label-proxy" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609150 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb857ea-667c-4806-825b-74a2ebb6d124" containerName="registry" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609158 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb857ea-667c-4806-825b-74a2ebb6d124" containerName="registry" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609168 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-metric" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609176 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-metric" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609197 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="init-config-reloader" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609205 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="init-config-reloader" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609214 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="config-reloader" May 27 21:40:51.609242 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609221 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="config-reloader" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609289 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-web" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609302 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609310 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="prom-label-proxy" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609319 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="kube-rbac-proxy-metric" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609329 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="config-reloader" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609339 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bb857ea-667c-4806-825b-74a2ebb6d124" containerName="registry" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609350 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" containerName="alertmanager" May 27 21:40:51.609568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.609360 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0522386-728d-40bd-ae0c-ee6299f1d621" containerName="console" May 27 21:40:51.612903 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.612875 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.615329 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615308 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k49l2\"" May 27 21:40:51.615529 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615513 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:40:51.615719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615699 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:40:51.615849 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615830 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:40:51.615939 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615839 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:40:51.615939 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615931 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:40:51.616025 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.615950 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:40:51.616025 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.616005 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:40:51.616261 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.616244 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:40:51.622434 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.622417 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:40:51.635226 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.635206 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:51.743820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743791 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-web-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.743972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-config-out\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.743972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.743972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.743972 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.743990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khq44\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-kube-api-access-khq44\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744029 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744053 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744156 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.744323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.744217 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844745 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844679 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844745 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844718 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844745 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844747 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844779 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khq44\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-kube-api-access-khq44\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844818 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844842 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844880 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.844970 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844936 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.844996 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.845032 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.845063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.845092 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-web-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.845129 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-config-out\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.845429 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.845191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.846415 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.846071 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.846415 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.846275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382615b2-b805-4171-a47f-3dc675cc0fc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848010 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.847983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848108 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/382615b2-b805-4171-a47f-3dc675cc0fc3-config-out\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848108 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848437 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848527 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848631 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.848796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.848777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.849147 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.849126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.850122 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.850101 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/382615b2-b805-4171-a47f-3dc675cc0fc3-web-config\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.856123 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.856095 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khq44\" (UniqueName: \"kubernetes.io/projected/382615b2-b805-4171-a47f-3dc675cc0fc3-kube-api-access-khq44\") pod \"alertmanager-main-0\" (UID: \"382615b2-b805-4171-a47f-3dc675cc0fc3\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:51.922466 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:51.922443 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:40:52.057928 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:52.057860 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:40:52.061282 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:40:52.061252 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382615b2_b805_4171_a47f_3dc675cc0fc3.slice/crio-784aa37f42d7a3c9b9e368f18b271bea2d8ba09fe4ab98e855dc469220c6871b WatchSource:0}: Error finding container 784aa37f42d7a3c9b9e368f18b271bea2d8ba09fe4ab98e855dc469220c6871b: Status 404 returned error can't find the container with id 784aa37f42d7a3c9b9e368f18b271bea2d8ba09fe4ab98e855dc469220c6871b May 27 21:40:52.541702 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:52.541667 2555 generic.go:358] "Generic (PLEG): container finished" podID="382615b2-b805-4171-a47f-3dc675cc0fc3" containerID="25dbf5973a2b51071ae0693b5b2d834c04e09d916de5467e3e340fef6426f383" exitCode=0 May 27 21:40:52.541869 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:52.541755 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerDied","Data":"25dbf5973a2b51071ae0693b5b2d834c04e09d916de5467e3e340fef6426f383"} May 27 21:40:52.541869 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:52.541791 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"784aa37f42d7a3c9b9e368f18b271bea2d8ba09fe4ab98e855dc469220c6871b"} May 27 21:40:52.757194 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:52.757169 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebab1227-1167-444f-9a22-c3bcf0e79b32" path="/var/lib/kubelet/pods/ebab1227-1167-444f-9a22-c3bcf0e79b32/volumes" May 27 21:40:53.548306 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548266 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"0fe8fdb652d3c56cad519cc5103d88b600d19704066e2e01974787107c90753b"} May 27 21:40:53.548306 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548310 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"08de6dc230fa10aa72b51c67e723c11c23182087b594522a64cb1ffc143b9546"} May 27 21:40:53.548691 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548325 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"ff6e11493ee8955d3f5bf07471a756790bd2365f1cdb12267737be8405aad362"} May 27 21:40:53.548691 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548341 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"95be05d7b5a857ce1ed31205e9548e5c07b38f51c64aeada0a761ea2220994e2"} May 27 21:40:53.548691 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548354 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"41059933478a9ea05fbe6c1aeabeb779423bf5011a12e820f7e092a8bfa86935"} May 27 21:40:53.548691 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.548366 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"382615b2-b805-4171-a47f-3dc675cc0fc3","Type":"ContainerStarted","Data":"60fd516ba9087ed235a11d4e68e1283acc8cae611c07ae68dd12c36ef931f412"} May 27 21:40:53.615760 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.615711 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.615697405 podStartE2EDuration="2.615697405s" podCreationTimestamp="2026-05-27 21:40:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:40:53.611216445 +0000 UTC m=+165.466287336" watchObservedRunningTime="2026-05-27 21:40:53.615697405 +0000 UTC m=+165.470768286" May 27 21:40:53.693488 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.693450 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-595b8f8cd-wtjp9"] May 27 21:40:53.695949 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.695928 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.700809 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.700785 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 21:40:53.701062 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.701046 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 21:40:53.701260 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.701235 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qdrpj\"" May 27 21:40:53.701669 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.701649 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 21:40:53.701799 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.701676 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 21:40:53.702179 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.702155 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 21:40:53.711332 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.711313 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 21:40:53.720035 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.720014 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-595b8f8cd-wtjp9"] May 27 21:40:53.762598 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmfc\" (UniqueName: \"kubernetes.io/projected/061fab31-abcc-40f1-8261-4e909830c152-kube-api-access-phmfc\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762690 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762760 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762760 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-federate-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-metrics-client-ca\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762812 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-telemeter-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.762882 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.762843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-serving-certs-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863731 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863670 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phmfc\" (UniqueName: \"kubernetes.io/projected/061fab31-abcc-40f1-8261-4e909830c152-kube-api-access-phmfc\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863731 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863935 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863755 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863935 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863796 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863935 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863815 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-federate-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.863935 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.863850 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-metrics-client-ca\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.864127 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.864032 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-telemeter-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.864127 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.864095 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-serving-certs-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.864819 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.864791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-metrics-client-ca\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.865141 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.865111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-serving-certs-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.865235 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.865173 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fab31-abcc-40f1-8261-4e909830c152-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.866489 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.866454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.866617 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.866599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-federate-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.866667 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.866620 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-secret-telemeter-client\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.866667 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.866634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/061fab31-abcc-40f1-8261-4e909830c152-telemeter-client-tls\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:53.891908 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:53.883421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmfc\" (UniqueName: \"kubernetes.io/projected/061fab31-abcc-40f1-8261-4e909830c152-kube-api-access-phmfc\") pod \"telemeter-client-595b8f8cd-wtjp9\" (UID: \"061fab31-abcc-40f1-8261-4e909830c152\") " pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:54.005876 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:54.005850 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" May 27 21:40:54.138140 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:54.138065 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-595b8f8cd-wtjp9"] May 27 21:40:54.140944 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:40:54.140915 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061fab31_abcc_40f1_8261_4e909830c152.slice/crio-8d87c44b8bc5356781d9c3d78306d427a9de99bc5c4cf5c3abe71241fffd4e0d WatchSource:0}: Error finding container 8d87c44b8bc5356781d9c3d78306d427a9de99bc5c4cf5c3abe71241fffd4e0d: Status 404 returned error can't find the container with id 8d87c44b8bc5356781d9c3d78306d427a9de99bc5c4cf5c3abe71241fffd4e0d May 27 21:40:54.554608 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:54.554568 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" event={"ID":"061fab31-abcc-40f1-8261-4e909830c152","Type":"ContainerStarted","Data":"8d87c44b8bc5356781d9c3d78306d427a9de99bc5c4cf5c3abe71241fffd4e0d"} May 27 21:40:56.564438 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:56.564403 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" event={"ID":"061fab31-abcc-40f1-8261-4e909830c152","Type":"ContainerStarted","Data":"60c09a8ed90236e84a837e6a8cb6092f290ff26d5575e6e5b3efc5a0bb69b1b8"} May 27 21:40:56.564796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:56.564445 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" event={"ID":"061fab31-abcc-40f1-8261-4e909830c152","Type":"ContainerStarted","Data":"7e738af25d8a6148b5c95f7f45227d1f6d78fc28fae26b22d64298db54c1aa90"} May 27 21:40:56.564796 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:56.564454 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" event={"ID":"061fab31-abcc-40f1-8261-4e909830c152","Type":"ContainerStarted","Data":"84a21ee5b0d6803fed9d0bd7280d6e21516a2cdbffd0ed638c340da98e3a64db"} May 27 21:40:56.594705 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:56.594648 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-595b8f8cd-wtjp9" podStartSLOduration=1.62375755 podStartE2EDuration="3.594629199s" podCreationTimestamp="2026-05-27 21:40:53 +0000 UTC" firstStartedPulling="2026-05-27 21:40:54.142663642 +0000 UTC m=+165.997734500" lastFinishedPulling="2026-05-27 21:40:56.113535287 +0000 UTC m=+167.968606149" observedRunningTime="2026-05-27 21:40:56.590833777 +0000 UTC m=+168.445904657" watchObservedRunningTime="2026-05-27 21:40:56.594629199 +0000 UTC m=+168.449700228" May 27 21:40:57.429695 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.429664 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:40:57.433570 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.433546 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.446203 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.446176 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:40:57.492754 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.492874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.492874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.492874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.493020 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.493020 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.492991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk8wk\" (UniqueName: \"kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.493095 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.493025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.593716 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.593680 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.593728 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk8wk\" (UniqueName: \"kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.593869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.593975 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594035 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594071 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594119 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594686 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594659 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594771 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594919 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.594994 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.594971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.596492 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.596473 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.596568 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.596523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.604984 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.604965 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk8wk\" (UniqueName: \"kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk\") pod \"console-64769db48-l6zqh\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.743974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.743906 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64769db48-l6zqh" May 27 21:40:57.878823 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:57.878792 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:40:57.881305 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:40:57.881267 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda735c9b7_c4ef_4551_a110_2f5dce19bc0f.slice/crio-2564e6ab91d355cf8b65838cc7ba90a47a3d55cf625f45c3cf1b20f9d5f15fff WatchSource:0}: Error finding container 2564e6ab91d355cf8b65838cc7ba90a47a3d55cf625f45c3cf1b20f9d5f15fff: Status 404 returned error can't find the container with id 2564e6ab91d355cf8b65838cc7ba90a47a3d55cf625f45c3cf1b20f9d5f15fff May 27 21:40:58.574880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:58.574843 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64769db48-l6zqh" event={"ID":"a735c9b7-c4ef-4551-a110-2f5dce19bc0f","Type":"ContainerStarted","Data":"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c"} May 27 21:40:58.574880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:58.574882 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64769db48-l6zqh" event={"ID":"a735c9b7-c4ef-4551-a110-2f5dce19bc0f","Type":"ContainerStarted","Data":"2564e6ab91d355cf8b65838cc7ba90a47a3d55cf625f45c3cf1b20f9d5f15fff"} May 27 21:40:58.597229 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:40:58.597035 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64769db48-l6zqh" podStartSLOduration=1.597020133 podStartE2EDuration="1.597020133s" podCreationTimestamp="2026-05-27 21:40:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:40:58.596718756 +0000 UTC m=+170.451789638" watchObservedRunningTime="2026-05-27 21:40:58.597020133 +0000 UTC m=+170.452091015" May 27 21:41:07.744627 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:07.744584 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64769db48-l6zqh" May 27 21:41:07.744627 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:07.744637 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64769db48-l6zqh" May 27 21:41:07.749476 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:07.749453 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64769db48-l6zqh" May 27 21:41:08.610178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:08.610150 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64769db48-l6zqh" May 27 21:41:08.681364 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:08.679948 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:41:33.708909 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.708843 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d5f967c95-m55tr" podUID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" containerName="console" containerID="cri-o://741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a" gracePeriod=15 May 27 21:41:33.955698 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.955676 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d5f967c95-m55tr_6d37d5cf-5396-462e-8c27-5f6d55d9a4cc/console/0.log" May 27 21:41:33.955801 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.955737 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:41:33.993940 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.993868 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.993940 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.993927 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5lcq\" (UniqueName: \"kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.993953 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994003 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994025 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994047 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994071 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config\") pod \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\" (UID: \"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc\") " May 27 21:41:33.994375 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994349 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:41:33.994446 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994417 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:41:33.994507 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994484 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config" (OuterVolumeSpecName: "console-config") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:41:33.994553 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.994504 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:41:33.996410 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.996361 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:41:33.996537 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.996515 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:41:33.996630 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:33.996609 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq" (OuterVolumeSpecName: "kube-api-access-t5lcq") pod "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" (UID: "6d37d5cf-5396-462e-8c27-5f6d55d9a4cc"). InnerVolumeSpecName "kube-api-access-t5lcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:41:34.095301 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095270 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095301 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095298 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5lcq\" (UniqueName: \"kubernetes.io/projected/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-kube-api-access-t5lcq\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095310 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095321 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095330 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095338 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.095449 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.095347 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:41:34.683094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683067 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d5f967c95-m55tr_6d37d5cf-5396-462e-8c27-5f6d55d9a4cc/console/0.log" May 27 21:41:34.683255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683110 2555 generic.go:358] "Generic (PLEG): container finished" podID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" containerID="741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a" exitCode=2 May 27 21:41:34.683255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683142 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f967c95-m55tr" event={"ID":"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc","Type":"ContainerDied","Data":"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a"} May 27 21:41:34.683255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683189 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f967c95-m55tr" event={"ID":"6d37d5cf-5396-462e-8c27-5f6d55d9a4cc","Type":"ContainerDied","Data":"57d5f8fde996dc19805ead1f641165ac12186ac0567e70a46465cd9fd1c01773"} May 27 21:41:34.683255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683196 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f967c95-m55tr" May 27 21:41:34.683255 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.683212 2555 scope.go:117] "RemoveContainer" containerID="741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a" May 27 21:41:34.691928 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.691906 2555 scope.go:117] "RemoveContainer" containerID="741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a" May 27 21:41:34.692199 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:41:34.692181 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a\": container with ID starting with 741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a not found: ID does not exist" containerID="741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a" May 27 21:41:34.692253 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.692207 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a"} err="failed to get container status \"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a\": rpc error: code = NotFound desc = could not find container \"741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a\": container with ID starting with 741b25ada798ca59fe187a7315600582a0b29baf3a6dc022adca2d6caae5044a not found: ID does not exist" May 27 21:41:34.705924 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.705883 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:41:34.710611 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.710582 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d5f967c95-m55tr"] May 27 21:41:34.757085 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:41:34.757065 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" path="/var/lib/kubelet/pods/6d37d5cf-5396-462e-8c27-5f6d55d9a4cc/volumes" May 27 21:42:13.300084 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.300047 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:42:13.301121 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.301095 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" containerName="console" May 27 21:42:13.301259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.301248 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" containerName="console" May 27 21:42:13.301453 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.301441 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d37d5cf-5396-462e-8c27-5f6d55d9a4cc" containerName="console" May 27 21:42:13.306186 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.306159 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.315123 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.315093 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:42:13.409135 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ks8\" (UniqueName: \"kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409289 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409145 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409289 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409374 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409374 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409374 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.409480 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.409389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.509834 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.509805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510038 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.509845 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510137 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510111 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510200 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510181 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510243 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45ks8\" (UniqueName: \"kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510411 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510297 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510411 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510333 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510757 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510883 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510975 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510937 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.510975 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.510948 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.513393 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.513365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.513393 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.513374 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.521450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.521432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ks8\" (UniqueName: \"kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8\") pod \"console-59cd5574ff-rgh4r\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.617652 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.617592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:13.748350 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.748324 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:42:13.753084 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:42:13.752999 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa3509f_3143_4786_b728_3c5cf1354fb3.slice/crio-a1fa41c23a4523f25de804cd1cd5deb872f163e3ecc10826dcc07c35d0513e81 WatchSource:0}: Error finding container a1fa41c23a4523f25de804cd1cd5deb872f163e3ecc10826dcc07c35d0513e81: Status 404 returned error can't find the container with id a1fa41c23a4523f25de804cd1cd5deb872f163e3ecc10826dcc07c35d0513e81 May 27 21:42:13.805990 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:13.805962 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd5574ff-rgh4r" event={"ID":"faa3509f-3143-4786-b728-3c5cf1354fb3","Type":"ContainerStarted","Data":"a1fa41c23a4523f25de804cd1cd5deb872f163e3ecc10826dcc07c35d0513e81"} May 27 21:42:14.810646 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:14.810614 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd5574ff-rgh4r" event={"ID":"faa3509f-3143-4786-b728-3c5cf1354fb3","Type":"ContainerStarted","Data":"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30"} May 27 21:42:14.832124 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:14.832078 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59cd5574ff-rgh4r" podStartSLOduration=1.832066036 podStartE2EDuration="1.832066036s" podCreationTimestamp="2026-05-27 21:42:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:42:14.830719481 +0000 UTC m=+246.685790362" watchObservedRunningTime="2026-05-27 21:42:14.832066036 +0000 UTC m=+246.687136916" May 27 21:42:23.618802 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:23.618770 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:23.619175 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:23.618813 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:23.623351 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:23.623329 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:23.846181 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:23.846154 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:42:23.901086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:23.900997 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:42:48.923141 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:48.923083 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64769db48-l6zqh" podUID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" containerName="console" containerID="cri-o://05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c" gracePeriod=15 May 27 21:42:49.164454 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.164433 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64769db48-l6zqh_a735c9b7-c4ef-4551-a110-2f5dce19bc0f/console/0.log" May 27 21:42:49.164558 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.164495 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64769db48-l6zqh" May 27 21:42:49.194086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194013 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194063 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk8wk\" (UniqueName: \"kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194114 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194141 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194212 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194275 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194252 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194493 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194290 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca\") pod \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\" (UID: \"a735c9b7-c4ef-4551-a110-2f5dce19bc0f\") " May 27 21:42:49.194493 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194432 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:42:49.194732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194709 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.194821 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194768 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:42:49.195056 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.194841 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config" (OuterVolumeSpecName: "console-config") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:42:49.195247 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.195221 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:42:49.196533 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.196497 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:42:49.196624 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.196570 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk" (OuterVolumeSpecName: "kube-api-access-tk8wk") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "kube-api-access-tk8wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:42:49.196624 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.196572 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a735c9b7-c4ef-4551-a110-2f5dce19bc0f" (UID: "a735c9b7-c4ef-4551-a110-2f5dce19bc0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:42:49.296126 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296099 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.296126 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296125 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.296274 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296174 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.296274 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296187 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.296274 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296197 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.296274 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.296205 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk8wk\" (UniqueName: \"kubernetes.io/projected/a735c9b7-c4ef-4551-a110-2f5dce19bc0f-kube-api-access-tk8wk\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:42:49.919455 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919426 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64769db48-l6zqh_a735c9b7-c4ef-4551-a110-2f5dce19bc0f/console/0.log" May 27 21:42:49.919616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919467 2555 generic.go:358] "Generic (PLEG): container finished" podID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" containerID="05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c" exitCode=2 May 27 21:42:49.919616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919505 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64769db48-l6zqh" event={"ID":"a735c9b7-c4ef-4551-a110-2f5dce19bc0f","Type":"ContainerDied","Data":"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c"} May 27 21:42:49.919616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919524 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64769db48-l6zqh" May 27 21:42:49.919616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919548 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64769db48-l6zqh" event={"ID":"a735c9b7-c4ef-4551-a110-2f5dce19bc0f","Type":"ContainerDied","Data":"2564e6ab91d355cf8b65838cc7ba90a47a3d55cf625f45c3cf1b20f9d5f15fff"} May 27 21:42:49.919616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.919565 2555 scope.go:117] "RemoveContainer" containerID="05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c" May 27 21:42:49.928406 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.928228 2555 scope.go:117] "RemoveContainer" containerID="05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c" May 27 21:42:49.928621 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:42:49.928469 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c\": container with ID starting with 05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c not found: ID does not exist" containerID="05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c" May 27 21:42:49.928621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.928492 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c"} err="failed to get container status \"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c\": rpc error: code = NotFound desc = could not find container \"05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c\": container with ID starting with 05ef3545c3be1bb247deb2af0a04d8334d4834d1f2a52b89e875b82dac6d8b6c not found: ID does not exist" May 27 21:42:49.941744 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.941722 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:42:49.945743 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:49.945725 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64769db48-l6zqh"] May 27 21:42:50.756803 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:42:50.756768 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" path="/var/lib/kubelet/pods/a735c9b7-c4ef-4551-a110-2f5dce19bc0f/volumes" May 27 21:43:08.664739 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:08.664703 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:43:08.665774 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:08.665749 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:43:08.672667 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:08.672645 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:43:08.673601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:08.673582 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:43:08.675711 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:08.675694 2555 kubelet.go:1628] "Image garbage collection succeeded" May 27 21:43:11.775240 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.775206 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b"] May 27 21:43:11.777256 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.775539 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" containerName="console" May 27 21:43:11.777256 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.775549 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" containerName="console" May 27 21:43:11.777256 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.775605 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a735c9b7-c4ef-4551-a110-2f5dce19bc0f" containerName="console" May 27 21:43:11.778195 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.778178 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.780466 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.780441 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:43:11.780592 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.780442 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:43:11.780764 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.780748 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:43:11.787508 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.787482 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b"] May 27 21:43:11.870158 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.870128 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.870294 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.870161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5cph\" (UniqueName: \"kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.870294 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.870243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.970601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.970564 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.970601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.970607 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5cph\" (UniqueName: \"kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.970742 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.970644 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.971015 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.970999 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.971058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.971002 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:11.990247 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:11.990227 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5cph\" (UniqueName: \"kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:12.087995 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:12.087941 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:12.224312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:12.224281 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b"] May 27 21:43:12.227497 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:43:12.227471 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f2ecbd_12ce_4f29_b40e_94f7f72cd587.slice/crio-99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6 WatchSource:0}: Error finding container 99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6: Status 404 returned error can't find the container with id 99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6 May 27 21:43:12.229870 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:12.229847 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:43:12.988400 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:12.988365 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" event={"ID":"79f2ecbd-12ce-4f29-b40e-94f7f72cd587","Type":"ContainerStarted","Data":"99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6"} May 27 21:43:21.012372 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:21.012335 2555 generic.go:358] "Generic (PLEG): container finished" podID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerID="eb6214f41de776d8d33d2effc8117409aaf1f9356cbf81614170e9c41c361f68" exitCode=0 May 27 21:43:21.012752 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:21.012420 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" event={"ID":"79f2ecbd-12ce-4f29-b40e-94f7f72cd587","Type":"ContainerDied","Data":"eb6214f41de776d8d33d2effc8117409aaf1f9356cbf81614170e9c41c361f68"} May 27 21:43:24.023443 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:24.023402 2555 generic.go:358] "Generic (PLEG): container finished" podID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerID="6e492636ce0cadb1a61b8e3ab4ea9eea6ca388a2a8ef1104afbf42161f6b955d" exitCode=0 May 27 21:43:24.023783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:24.023468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" event={"ID":"79f2ecbd-12ce-4f29-b40e-94f7f72cd587","Type":"ContainerDied","Data":"6e492636ce0cadb1a61b8e3ab4ea9eea6ca388a2a8ef1104afbf42161f6b955d"} May 27 21:43:31.048548 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:31.048510 2555 generic.go:358] "Generic (PLEG): container finished" podID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerID="be419dfe44bc901b8e2139b1bf150c99402970502fb4cd0da6f4660e791bccc0" exitCode=0 May 27 21:43:31.048927 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:31.048593 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" event={"ID":"79f2ecbd-12ce-4f29-b40e-94f7f72cd587","Type":"ContainerDied","Data":"be419dfe44bc901b8e2139b1bf150c99402970502fb4cd0da6f4660e791bccc0"} May 27 21:43:32.173959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.173932 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:32.252735 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.252703 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util\") pod \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " May 27 21:43:32.252930 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.252755 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5cph\" (UniqueName: \"kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph\") pod \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " May 27 21:43:32.252930 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.252795 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle\") pod \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\" (UID: \"79f2ecbd-12ce-4f29-b40e-94f7f72cd587\") " May 27 21:43:32.253471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.253446 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle" (OuterVolumeSpecName: "bundle") pod "79f2ecbd-12ce-4f29-b40e-94f7f72cd587" (UID: "79f2ecbd-12ce-4f29-b40e-94f7f72cd587"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:43:32.255173 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.255144 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph" (OuterVolumeSpecName: "kube-api-access-b5cph") pod "79f2ecbd-12ce-4f29-b40e-94f7f72cd587" (UID: "79f2ecbd-12ce-4f29-b40e-94f7f72cd587"). InnerVolumeSpecName "kube-api-access-b5cph". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:43:32.258169 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.258140 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util" (OuterVolumeSpecName: "util") pod "79f2ecbd-12ce-4f29-b40e-94f7f72cd587" (UID: "79f2ecbd-12ce-4f29-b40e-94f7f72cd587"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:43:32.353542 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.353480 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:32.353542 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.353505 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5cph\" (UniqueName: \"kubernetes.io/projected/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-kube-api-access-b5cph\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:32.353542 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:32.353521 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f2ecbd-12ce-4f29-b40e-94f7f72cd587-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:33.056241 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:33.056160 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" event={"ID":"79f2ecbd-12ce-4f29-b40e-94f7f72cd587","Type":"ContainerDied","Data":"99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6"} May 27 21:43:33.056241 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:33.056209 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99af4f9e5b0de89cc88b49478fc9dc3b7a91b6129ab86f3053ad2ec65ac492f6" May 27 21:43:33.056241 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:33.056179 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsg94b" May 27 21:43:39.775784 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.775747 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw"] May 27 21:43:39.776215 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776197 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="util" May 27 21:43:39.776267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776219 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="util" May 27 21:43:39.776267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776236 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="pull" May 27 21:43:39.776267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776245 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="pull" May 27 21:43:39.776267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776256 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="extract" May 27 21:43:39.776267 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776265 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="extract" May 27 21:43:39.776417 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.776332 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="79f2ecbd-12ce-4f29-b40e-94f7f72cd587" containerName="extract" May 27 21:43:39.806697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.806668 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw"] May 27 21:43:39.806841 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.806701 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:39.808877 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.808857 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 21:43:39.808877 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.808875 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 21:43:39.809076 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.808925 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b5n2r\"" May 27 21:43:39.916014 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.915989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwwt\" (UniqueName: \"kubernetes.io/projected/07face25-d871-4982-9b6a-2f936709e527-kube-api-access-lhwwt\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:39.916160 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:39.916042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07face25-d871-4982-9b6a-2f936709e527-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.016494 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.016471 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07face25-d871-4982-9b6a-2f936709e527-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.016645 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.016552 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwwt\" (UniqueName: \"kubernetes.io/projected/07face25-d871-4982-9b6a-2f936709e527-kube-api-access-lhwwt\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.016871 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.016856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07face25-d871-4982-9b6a-2f936709e527-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.026142 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.026086 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwwt\" (UniqueName: \"kubernetes.io/projected/07face25-d871-4982-9b6a-2f936709e527-kube-api-access-lhwwt\") pod \"cert-manager-operator-controller-manager-54b9655956-jcpbw\" (UID: \"07face25-d871-4982-9b6a-2f936709e527\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.116319 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.116297 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" May 27 21:43:40.256380 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:40.256349 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw"] May 27 21:43:40.258683 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:43:40.258648 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07face25_d871_4982_9b6a_2f936709e527.slice/crio-279326f03e3979af11463c57b703123e4dea3c1cfaed53e33fa8651f96ad6acc WatchSource:0}: Error finding container 279326f03e3979af11463c57b703123e4dea3c1cfaed53e33fa8651f96ad6acc: Status 404 returned error can't find the container with id 279326f03e3979af11463c57b703123e4dea3c1cfaed53e33fa8651f96ad6acc May 27 21:43:41.080549 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:41.080506 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" event={"ID":"07face25-d871-4982-9b6a-2f936709e527","Type":"ContainerStarted","Data":"279326f03e3979af11463c57b703123e4dea3c1cfaed53e33fa8651f96ad6acc"} May 27 21:43:43.088249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:43.088209 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" event={"ID":"07face25-d871-4982-9b6a-2f936709e527","Type":"ContainerStarted","Data":"f2b447c60a140a833962d91b8ebe1dbd0c9d970979d7722834adaeda2ca6d287"} May 27 21:43:43.111135 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:43.111004 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jcpbw" podStartSLOduration=2.001130876 podStartE2EDuration="4.110989028s" podCreationTimestamp="2026-05-27 21:43:39 +0000 UTC" firstStartedPulling="2026-05-27 21:43:40.26140064 +0000 UTC m=+332.116471503" lastFinishedPulling="2026-05-27 21:43:42.371258793 +0000 UTC m=+334.226329655" observedRunningTime="2026-05-27 21:43:43.109430049 +0000 UTC m=+334.964500940" watchObservedRunningTime="2026-05-27 21:43:43.110989028 +0000 UTC m=+334.966059910" May 27 21:43:44.137936 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.137903 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp"] May 27 21:43:44.140715 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.140698 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.142940 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.142914 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:43:44.143072 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.143050 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:43:44.143266 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.143252 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:43:44.152400 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.152379 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp"] May 27 21:43:44.254334 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.254304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.254462 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.254358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s548z\" (UniqueName: \"kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.254462 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.254438 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.355624 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.355593 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s548z\" (UniqueName: \"kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.355751 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.355633 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.355751 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.355684 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.356000 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.355986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.356061 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.356045 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.369618 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.369596 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s548z\" (UniqueName: \"kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.449497 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.449473 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:44.590103 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:44.590039 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp"] May 27 21:43:44.592244 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:43:44.592214 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2f0628_6344_4605_9b99_bcc8a666598a.slice/crio-f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c WatchSource:0}: Error finding container f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c: Status 404 returned error can't find the container with id f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c May 27 21:43:45.096695 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:45.096659 2555 generic.go:358] "Generic (PLEG): container finished" podID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerID="29c69dd981a80007a97aaa975df4e9f6f00b1ea01edc46368add2d90dd4bcfa0" exitCode=0 May 27 21:43:45.096874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:45.096731 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" event={"ID":"7b2f0628-6344-4605-9b99-bcc8a666598a","Type":"ContainerDied","Data":"29c69dd981a80007a97aaa975df4e9f6f00b1ea01edc46368add2d90dd4bcfa0"} May 27 21:43:45.096874 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:45.096752 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" event={"ID":"7b2f0628-6344-4605-9b99-bcc8a666598a","Type":"ContainerStarted","Data":"f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c"} May 27 21:43:48.108099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.108066 2555 generic.go:358] "Generic (PLEG): container finished" podID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerID="c642a5766825911781d88e28b0560e84b6d47e5fb38494a56ecd2cae208edbdf" exitCode=0 May 27 21:43:48.108464 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.108161 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" event={"ID":"7b2f0628-6344-4605-9b99-bcc8a666598a","Type":"ContainerDied","Data":"c642a5766825911781d88e28b0560e84b6d47e5fb38494a56ecd2cae208edbdf"} May 27 21:43:48.596948 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.596912 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z4fk4"] May 27 21:43:48.599258 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.599243 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.601964 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.601934 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 21:43:48.602069 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.602043 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nhnf7\"" May 27 21:43:48.602118 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.602061 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 21:43:48.610772 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.610748 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z4fk4"] May 27 21:43:48.694714 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.694683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.694854 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.694728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ddgl\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-kube-api-access-6ddgl\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.795938 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.795912 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.796064 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.795949 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ddgl\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-kube-api-access-6ddgl\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.805878 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.805855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.806067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.806047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ddgl\" (UniqueName: \"kubernetes.io/projected/1ca74f75-9942-4315-bcd5-7a39ccf4076a-kube-api-access-6ddgl\") pod \"cert-manager-cainjector-68b757865b-z4fk4\" (UID: \"1ca74f75-9942-4315-bcd5-7a39ccf4076a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:48.920142 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:48.920120 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" May 27 21:43:49.048248 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:49.048213 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z4fk4"] May 27 21:43:49.051780 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:43:49.051749 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ca74f75_9942_4315_bcd5_7a39ccf4076a.slice/crio-5b6a083a9a9aa231b7867057632a41d77ca74b36dfd6c402affe40163295c659 WatchSource:0}: Error finding container 5b6a083a9a9aa231b7867057632a41d77ca74b36dfd6c402affe40163295c659: Status 404 returned error can't find the container with id 5b6a083a9a9aa231b7867057632a41d77ca74b36dfd6c402affe40163295c659 May 27 21:43:49.113459 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:49.113429 2555 generic.go:358] "Generic (PLEG): container finished" podID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerID="a295ca675d0741fb2dcb89b274bf798179edcd845e7eaf8bba3ec4dfbd881cd9" exitCode=0 May 27 21:43:49.113815 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:49.113500 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" event={"ID":"7b2f0628-6344-4605-9b99-bcc8a666598a","Type":"ContainerDied","Data":"a295ca675d0741fb2dcb89b274bf798179edcd845e7eaf8bba3ec4dfbd881cd9"} May 27 21:43:49.114501 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:49.114475 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" event={"ID":"1ca74f75-9942-4315-bcd5-7a39ccf4076a","Type":"ContainerStarted","Data":"5b6a083a9a9aa231b7867057632a41d77ca74b36dfd6c402affe40163295c659"} May 27 21:43:50.265923 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.265872 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:50.410051 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.410024 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s548z\" (UniqueName: \"kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z\") pod \"7b2f0628-6344-4605-9b99-bcc8a666598a\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " May 27 21:43:50.410232 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.410066 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util\") pod \"7b2f0628-6344-4605-9b99-bcc8a666598a\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " May 27 21:43:50.410232 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.410113 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle\") pod \"7b2f0628-6344-4605-9b99-bcc8a666598a\" (UID: \"7b2f0628-6344-4605-9b99-bcc8a666598a\") " May 27 21:43:50.410587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.410561 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle" (OuterVolumeSpecName: "bundle") pod "7b2f0628-6344-4605-9b99-bcc8a666598a" (UID: "7b2f0628-6344-4605-9b99-bcc8a666598a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:43:50.413271 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.413243 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z" (OuterVolumeSpecName: "kube-api-access-s548z") pod "7b2f0628-6344-4605-9b99-bcc8a666598a" (UID: "7b2f0628-6344-4605-9b99-bcc8a666598a"). InnerVolumeSpecName "kube-api-access-s548z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:43:50.417906 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.417863 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util" (OuterVolumeSpecName: "util") pod "7b2f0628-6344-4605-9b99-bcc8a666598a" (UID: "7b2f0628-6344-4605-9b99-bcc8a666598a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:43:50.511500 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.511466 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s548z\" (UniqueName: \"kubernetes.io/projected/7b2f0628-6344-4605-9b99-bcc8a666598a-kube-api-access-s548z\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:50.511500 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.511499 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:50.511694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:50.511512 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b2f0628-6344-4605-9b99-bcc8a666598a-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:43:51.124277 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:51.124143 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" event={"ID":"7b2f0628-6344-4605-9b99-bcc8a666598a","Type":"ContainerDied","Data":"f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c"} May 27 21:43:51.124277 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:51.124198 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f21cc24a1144612e012785e72af65c4dbcdc3a3c39e7592439ea17a4c1fe342c" May 27 21:43:51.124577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:51.124373 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdnpzp" May 27 21:43:52.129290 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:52.129251 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" event={"ID":"1ca74f75-9942-4315-bcd5-7a39ccf4076a","Type":"ContainerStarted","Data":"5cb96a4091dd7d8b19ee160bbe26110fdda6ba9f5435089f7688e64a33fbf1ba"} May 27 21:43:52.149953 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:52.149910 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-z4fk4" podStartSLOduration=1.854862027 podStartE2EDuration="4.149873286s" podCreationTimestamp="2026-05-27 21:43:48 +0000 UTC" firstStartedPulling="2026-05-27 21:43:49.053695103 +0000 UTC m=+340.908765965" lastFinishedPulling="2026-05-27 21:43:51.348706363 +0000 UTC m=+343.203777224" observedRunningTime="2026-05-27 21:43:52.14746595 +0000 UTC m=+344.002536831" watchObservedRunningTime="2026-05-27 21:43:52.149873286 +0000 UTC m=+344.004944166" May 27 21:43:56.369153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369069 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6d7r7"] May 27 21:43:56.369583 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369556 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="util" May 27 21:43:56.369583 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369574 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="util" May 27 21:43:56.369694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369628 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="extract" May 27 21:43:56.369694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369639 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="extract" May 27 21:43:56.369694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369653 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="pull" May 27 21:43:56.369694 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369662 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="pull" May 27 21:43:56.369877 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.369750 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b2f0628-6344-4605-9b99-bcc8a666598a" containerName="extract" May 27 21:43:56.372759 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.372739 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.374843 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.374823 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ngj78\"" May 27 21:43:56.383104 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.383080 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6d7r7"] May 27 21:43:56.463713 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.463684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-bound-sa-token\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.463824 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.463723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scs8x\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-kube-api-access-scs8x\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.564861 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.564835 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scs8x\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-kube-api-access-scs8x\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.564986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.564933 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-bound-sa-token\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.574196 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.574166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-bound-sa-token\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.574196 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.574174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scs8x\" (UniqueName: \"kubernetes.io/projected/f952e31b-78c7-473f-8f25-a980989dbba5-kube-api-access-scs8x\") pod \"cert-manager-79c8d999ff-6d7r7\" (UID: \"f952e31b-78c7-473f-8f25-a980989dbba5\") " pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.682124 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.682101 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6d7r7" May 27 21:43:56.813587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:56.813562 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6d7r7"] May 27 21:43:56.815507 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:43:56.815480 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf952e31b_78c7_473f_8f25_a980989dbba5.slice/crio-dc6612186e1c6fd33c8864d8a14466d0621401f9156f568b60c4634b9e1e976f WatchSource:0}: Error finding container dc6612186e1c6fd33c8864d8a14466d0621401f9156f568b60c4634b9e1e976f: Status 404 returned error can't find the container with id dc6612186e1c6fd33c8864d8a14466d0621401f9156f568b60c4634b9e1e976f May 27 21:43:57.148191 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:57.148100 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6d7r7" event={"ID":"f952e31b-78c7-473f-8f25-a980989dbba5","Type":"ContainerStarted","Data":"9f76433445c84ffcfb95201f56a5f1c3e5217cb2a8276ad3623e496f005d153a"} May 27 21:43:57.148191 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:57.148139 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6d7r7" event={"ID":"f952e31b-78c7-473f-8f25-a980989dbba5","Type":"ContainerStarted","Data":"dc6612186e1c6fd33c8864d8a14466d0621401f9156f568b60c4634b9e1e976f"} May 27 21:43:57.165853 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:43:57.165808 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-6d7r7" podStartSLOduration=1.165796257 podStartE2EDuration="1.165796257s" podCreationTimestamp="2026-05-27 21:43:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:43:57.165026089 +0000 UTC m=+349.020096974" watchObservedRunningTime="2026-05-27 21:43:57.165796257 +0000 UTC m=+349.020867137" May 27 21:44:04.299631 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.299597 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr"] May 27 21:44:04.303478 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.303456 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.305771 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.305746 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:44:04.305876 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.305805 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:44:04.306134 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.306118 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:44:04.312196 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.312171 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr"] May 27 21:44:04.434880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.434850 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.435032 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.434984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.435088 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.435029 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m29tp\" (UniqueName: \"kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.536222 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.536191 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.536362 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.536234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m29tp\" (UniqueName: \"kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.536362 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.536258 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.536617 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.536595 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.536685 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.536603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.545678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.545658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m29tp\" (UniqueName: \"kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.613774 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.613726 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:04.745129 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:04.745091 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr"] May 27 21:44:04.747284 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:04.747252 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9b86ef_d294_46ac_9687_f001229abff6.slice/crio-de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e WatchSource:0}: Error finding container de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e: Status 404 returned error can't find the container with id de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e May 27 21:44:05.175529 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:05.175492 2555 generic.go:358] "Generic (PLEG): container finished" podID="7a9b86ef-d294-46ac-9687-f001229abff6" containerID="9fff0738e8884305651a4be96ebd10845086ac6f62b48e89966e794a968226fb" exitCode=0 May 27 21:44:05.175678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:05.175534 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" event={"ID":"7a9b86ef-d294-46ac-9687-f001229abff6","Type":"ContainerDied","Data":"9fff0738e8884305651a4be96ebd10845086ac6f62b48e89966e794a968226fb"} May 27 21:44:05.175678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:05.175561 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" event={"ID":"7a9b86ef-d294-46ac-9687-f001229abff6","Type":"ContainerStarted","Data":"de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e"} May 27 21:44:06.180039 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:06.180004 2555 generic.go:358] "Generic (PLEG): container finished" podID="7a9b86ef-d294-46ac-9687-f001229abff6" containerID="7ca7a15af171f1587cc0107f32691987071dcaa1f14a38e3de8df0a90f268b71" exitCode=0 May 27 21:44:06.180378 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:06.180080 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" event={"ID":"7a9b86ef-d294-46ac-9687-f001229abff6","Type":"ContainerDied","Data":"7ca7a15af171f1587cc0107f32691987071dcaa1f14a38e3de8df0a90f268b71"} May 27 21:44:07.185919 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:07.185870 2555 generic.go:358] "Generic (PLEG): container finished" podID="7a9b86ef-d294-46ac-9687-f001229abff6" containerID="6c9d3226702a0687ecfd6675e5034ee6a11431fa90bd980d3f5dec7a0a2bb1f7" exitCode=0 May 27 21:44:07.185919 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:07.185921 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" event={"ID":"7a9b86ef-d294-46ac-9687-f001229abff6","Type":"ContainerDied","Data":"6c9d3226702a0687ecfd6675e5034ee6a11431fa90bd980d3f5dec7a0a2bb1f7"} May 27 21:44:08.315847 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.315822 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:08.471662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.471590 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m29tp\" (UniqueName: \"kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp\") pod \"7a9b86ef-d294-46ac-9687-f001229abff6\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " May 27 21:44:08.471787 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.471662 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util\") pod \"7a9b86ef-d294-46ac-9687-f001229abff6\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " May 27 21:44:08.471787 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.471726 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle\") pod \"7a9b86ef-d294-46ac-9687-f001229abff6\" (UID: \"7a9b86ef-d294-46ac-9687-f001229abff6\") " May 27 21:44:08.472523 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.472496 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle" (OuterVolumeSpecName: "bundle") pod "7a9b86ef-d294-46ac-9687-f001229abff6" (UID: "7a9b86ef-d294-46ac-9687-f001229abff6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:08.473810 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.473787 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp" (OuterVolumeSpecName: "kube-api-access-m29tp") pod "7a9b86ef-d294-46ac-9687-f001229abff6" (UID: "7a9b86ef-d294-46ac-9687-f001229abff6"). InnerVolumeSpecName "kube-api-access-m29tp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:44:08.477546 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.477515 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util" (OuterVolumeSpecName: "util") pod "7a9b86ef-d294-46ac-9687-f001229abff6" (UID: "7a9b86ef-d294-46ac-9687-f001229abff6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:08.573153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.573128 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:08.573153 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.573152 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9b86ef-d294-46ac-9687-f001229abff6-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:08.573280 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:08.573162 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m29tp\" (UniqueName: \"kubernetes.io/projected/7a9b86ef-d294-46ac-9687-f001229abff6-kube-api-access-m29tp\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:09.194438 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:09.194411 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" May 27 21:44:09.194601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:09.194414 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qfwwr" event={"ID":"7a9b86ef-d294-46ac-9687-f001229abff6","Type":"ContainerDied","Data":"de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e"} May 27 21:44:09.194601 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:09.194528 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de872d16a8921e089f2dde945747240d0ba9c335b2f3e21439e51eee77a7ae2e" May 27 21:44:14.797038 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.796999 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz"] May 27 21:44:14.797477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797452 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="pull" May 27 21:44:14.797600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797498 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="pull" May 27 21:44:14.797600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797513 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="extract" May 27 21:44:14.797600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797522 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="extract" May 27 21:44:14.797600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797556 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="util" May 27 21:44:14.797600 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797562 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="util" May 27 21:44:14.797838 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.797652 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a9b86ef-d294-46ac-9687-f001229abff6" containerName="extract" May 27 21:44:14.800729 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.800710 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.802794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.802765 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:44:14.802920 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.802845 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:44:14.802920 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.802778 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:44:14.810688 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.810658 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.810864 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.810844 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.811060 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.811038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj8qg\" (UniqueName: \"kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.814108 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.814080 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz"] May 27 21:44:14.911844 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.911809 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.911844 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.911846 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.912023 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.911875 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj8qg\" (UniqueName: \"kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.912169 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.912149 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.912209 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.912187 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:14.920674 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:14.920639 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj8qg\" (UniqueName: \"kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:15.111405 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:15.111332 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:15.256578 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:15.256542 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz"] May 27 21:44:15.259858 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:15.259826 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27945312_1fee_48e1_8f93_fa204a1e11bc.slice/crio-3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2 WatchSource:0}: Error finding container 3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2: Status 404 returned error can't find the container with id 3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2 May 27 21:44:16.220863 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.220775 2555 generic.go:358] "Generic (PLEG): container finished" podID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerID="9e77312414f3377955b0d7e6522264ede20ed8f11db63fc84730f32715016ad9" exitCode=0 May 27 21:44:16.221248 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.220865 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" event={"ID":"27945312-1fee-48e1-8f93-fa204a1e11bc","Type":"ContainerDied","Data":"9e77312414f3377955b0d7e6522264ede20ed8f11db63fc84730f32715016ad9"} May 27 21:44:16.221248 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.220918 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" event={"ID":"27945312-1fee-48e1-8f93-fa204a1e11bc","Type":"ContainerStarted","Data":"3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2"} May 27 21:44:16.704845 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.704813 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw"] May 27 21:44:16.707385 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.707359 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.715122 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.715095 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-587pf\"" May 27 21:44:16.715262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.715237 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 21:44:16.716083 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.716064 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 21:44:16.716178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.716069 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 21:44:16.716379 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.716358 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 21:44:16.726294 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.726269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.726404 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.726308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-798d2\" (UniqueName: \"kubernetes.io/projected/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-kube-api-access-798d2\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.726404 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.726339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.742623 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.742589 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw"] May 27 21:44:16.827166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.827137 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.827252 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.827173 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-798d2\" (UniqueName: \"kubernetes.io/projected/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-kube-api-access-798d2\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.827252 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.827197 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.829477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.829450 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.829559 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.829501 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:16.842546 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:16.842522 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-798d2\" (UniqueName: \"kubernetes.io/projected/5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5-kube-api-access-798d2\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw\" (UID: \"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:17.020488 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:17.020414 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:17.188520 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:17.188484 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw"] May 27 21:44:17.188677 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:17.188651 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c30ae91_c8ff_4c80_99ea_5f39a21ac5b5.slice/crio-8751bc8b8ebd4a453dcfe593f3c0f27024a2cf55ab0f0a7a3b5833663eb9a7e7 WatchSource:0}: Error finding container 8751bc8b8ebd4a453dcfe593f3c0f27024a2cf55ab0f0a7a3b5833663eb9a7e7: Status 404 returned error can't find the container with id 8751bc8b8ebd4a453dcfe593f3c0f27024a2cf55ab0f0a7a3b5833663eb9a7e7 May 27 21:44:17.226111 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:17.226087 2555 generic.go:358] "Generic (PLEG): container finished" podID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerID="63986b96458ea786fe66d91b7ac67dd358d0a6fe4159633b334152f4ecc3f7a9" exitCode=0 May 27 21:44:17.226420 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:17.226149 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" event={"ID":"27945312-1fee-48e1-8f93-fa204a1e11bc","Type":"ContainerDied","Data":"63986b96458ea786fe66d91b7ac67dd358d0a6fe4159633b334152f4ecc3f7a9"} May 27 21:44:17.227475 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:17.227453 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" event={"ID":"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5","Type":"ContainerStarted","Data":"8751bc8b8ebd4a453dcfe593f3c0f27024a2cf55ab0f0a7a3b5833663eb9a7e7"} May 27 21:44:18.234899 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:18.234858 2555 generic.go:358] "Generic (PLEG): container finished" podID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerID="4e93bb1a5da5deb6a913538dc1756f823e07bc766f787c4cc42cd827b795ee12" exitCode=0 May 27 21:44:18.235323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:18.234948 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" event={"ID":"27945312-1fee-48e1-8f93-fa204a1e11bc","Type":"ContainerDied","Data":"4e93bb1a5da5deb6a913538dc1756f823e07bc766f787c4cc42cd827b795ee12"} May 27 21:44:19.561433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.561409 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:19.656576 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.656547 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj8qg\" (UniqueName: \"kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg\") pod \"27945312-1fee-48e1-8f93-fa204a1e11bc\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " May 27 21:44:19.656664 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.656588 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util\") pod \"27945312-1fee-48e1-8f93-fa204a1e11bc\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " May 27 21:44:19.656664 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.656637 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle\") pod \"27945312-1fee-48e1-8f93-fa204a1e11bc\" (UID: \"27945312-1fee-48e1-8f93-fa204a1e11bc\") " May 27 21:44:19.657412 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.657378 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle" (OuterVolumeSpecName: "bundle") pod "27945312-1fee-48e1-8f93-fa204a1e11bc" (UID: "27945312-1fee-48e1-8f93-fa204a1e11bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:19.658596 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.658573 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg" (OuterVolumeSpecName: "kube-api-access-tj8qg") pod "27945312-1fee-48e1-8f93-fa204a1e11bc" (UID: "27945312-1fee-48e1-8f93-fa204a1e11bc"). InnerVolumeSpecName "kube-api-access-tj8qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:44:19.663826 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.663803 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util" (OuterVolumeSpecName: "util") pod "27945312-1fee-48e1-8f93-fa204a1e11bc" (UID: "27945312-1fee-48e1-8f93-fa204a1e11bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:19.757241 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.757209 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj8qg\" (UniqueName: \"kubernetes.io/projected/27945312-1fee-48e1-8f93-fa204a1e11bc-kube-api-access-tj8qg\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:19.757241 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.757240 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:19.757416 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:19.757252 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27945312-1fee-48e1-8f93-fa204a1e11bc-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:20.244784 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.244750 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" event={"ID":"27945312-1fee-48e1-8f93-fa204a1e11bc","Type":"ContainerDied","Data":"3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2"} May 27 21:44:20.244784 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.244786 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3677e72e700f2c07ce07f56ab8522da8d82726d17c75069b2d64f8323bd77aa2" May 27 21:44:20.245088 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.244812 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c96wzmz" May 27 21:44:20.246338 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.246304 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" event={"ID":"5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5","Type":"ContainerStarted","Data":"30f5a28980adb3b4006b2cd0dc141db4944af2058649199da255346a0da1928b"} May 27 21:44:20.246489 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.246416 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:20.275717 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:20.275669 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" podStartSLOduration=1.85824599 podStartE2EDuration="4.275659697s" podCreationTimestamp="2026-05-27 21:44:16 +0000 UTC" firstStartedPulling="2026-05-27 21:44:17.19057153 +0000 UTC m=+369.045642391" lastFinishedPulling="2026-05-27 21:44:19.607985237 +0000 UTC m=+371.463056098" observedRunningTime="2026-05-27 21:44:20.272829488 +0000 UTC m=+372.127900368" watchObservedRunningTime="2026-05-27 21:44:20.275659697 +0000 UTC m=+372.130730577" May 27 21:44:31.252701 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:31.252673 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw" May 27 21:44:34.072305 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072270 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6"] May 27 21:44:34.072650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072611 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="extract" May 27 21:44:34.072650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072621 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="extract" May 27 21:44:34.072650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072634 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="util" May 27 21:44:34.072650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072640 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="util" May 27 21:44:34.072650 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072651 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="pull" May 27 21:44:34.072811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072657 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="pull" May 27 21:44:34.072811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.072712 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="27945312-1fee-48e1-8f93-fa204a1e11bc" containerName="extract" May 27 21:44:34.075301 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.075280 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.082467 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.082240 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:44:34.082467 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.082252 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:44:34.100113 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.100083 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6"] May 27 21:44:34.114165 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.114140 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:44:34.174097 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.174062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.174233 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.174112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hs4\" (UniqueName: \"kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.174233 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.174137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.275254 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.275217 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.275403 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.275270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88hs4\" (UniqueName: \"kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.275403 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.275386 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.275638 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.275617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.275719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.275699 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.294850 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.294826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hs4\" (UniqueName: \"kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.385671 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.385606 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:34.639448 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:34.639374 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6"] May 27 21:44:34.651632 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:34.651602 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0528ce7d_dce8_4dbe_bb5b_075ae1d33653.slice/crio-817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3 WatchSource:0}: Error finding container 817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3: Status 404 returned error can't find the container with id 817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3 May 27 21:44:35.238770 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.238738 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z"] May 27 21:44:35.241099 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.241079 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.244176 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:35.244144 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-c9xxr\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c9xxr\"" type="*v1.Secret" May 27 21:44:35.244265 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.244173 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 21:44:35.244762 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.244739 2555 status_manager.go:895] "Failed to get status for pod" podUID="f1f77b95-e958-4ff1-b69f-0b40bb97886e" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" err="pods \"kube-auth-proxy-6ffdb65d85-49z6z\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:44:35.245109 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.245094 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 21:44:35.272391 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.272367 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z"] May 27 21:44:35.283651 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.283594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.283725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.283671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tmp\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.283777 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.283721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vr2k\" (UniqueName: \"kubernetes.io/projected/f1f77b95-e958-4ff1-b69f-0b40bb97886e-kube-api-access-5vr2k\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.306506 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.306469 2555 generic.go:358] "Generic (PLEG): container finished" podID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerID="4a44d47894a2f2d6c110861c81e9e46bc36e49224324cc574340911bf622c9dc" exitCode=0 May 27 21:44:35.306608 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.306532 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" event={"ID":"0528ce7d-dce8-4dbe-bb5b-075ae1d33653","Type":"ContainerDied","Data":"4a44d47894a2f2d6c110861c81e9e46bc36e49224324cc574340911bf622c9dc"} May 27 21:44:35.306608 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.306568 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" event={"ID":"0528ce7d-dce8-4dbe-bb5b-075ae1d33653","Type":"ContainerStarted","Data":"817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3"} May 27 21:44:35.385251 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.385222 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.385396 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.385257 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tmp\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.385396 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.385308 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vr2k\" (UniqueName: \"kubernetes.io/projected/f1f77b95-e958-4ff1-b69f-0b40bb97886e-kube-api-access-5vr2k\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.387682 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.387656 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tmp\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.387913 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.387874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f77b95-e958-4ff1-b69f-0b40bb97886e-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:35.405732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:35.405707 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vr2k\" (UniqueName: \"kubernetes.io/projected/f1f77b95-e958-4ff1-b69f-0b40bb97886e-kube-api-access-5vr2k\") pod \"kube-auth-proxy-6ffdb65d85-49z6z\" (UID: \"f1f77b95-e958-4ff1-b69f-0b40bb97886e\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:36.311851 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.311818 2555 generic.go:358] "Generic (PLEG): container finished" podID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerID="e42dbe6f6833c057abf8ab535e71d95ddcc04e885af8fdc05c92c9fd917f3321" exitCode=0 May 27 21:44:36.312188 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.311877 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" event={"ID":"0528ce7d-dce8-4dbe-bb5b-075ae1d33653","Type":"ContainerDied","Data":"e42dbe6f6833c057abf8ab535e71d95ddcc04e885af8fdc05c92c9fd917f3321"} May 27 21:44:36.551971 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.551942 2555 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" secret="" err="failed to sync secret cache: timed out waiting for the condition" May 27 21:44:36.552070 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.552004 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" May 27 21:44:36.697410 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.697382 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z"] May 27 21:44:36.699254 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:36.699225 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f77b95_e958_4ff1_b69f_0b40bb97886e.slice/crio-fbb736eb01ea520e354c5d20ec1cbdfcd02a538203abb1c9a593a2f422fb8c1c WatchSource:0}: Error finding container fbb736eb01ea520e354c5d20ec1cbdfcd02a538203abb1c9a593a2f422fb8c1c: Status 404 returned error can't find the container with id fbb736eb01ea520e354c5d20ec1cbdfcd02a538203abb1c9a593a2f422fb8c1c May 27 21:44:36.749603 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:36.749577 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c9xxr\"" May 27 21:44:37.318345 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:37.318290 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" event={"ID":"f1f77b95-e958-4ff1-b69f-0b40bb97886e","Type":"ContainerStarted","Data":"fbb736eb01ea520e354c5d20ec1cbdfcd02a538203abb1c9a593a2f422fb8c1c"} May 27 21:44:37.321139 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:37.321110 2555 generic.go:358] "Generic (PLEG): container finished" podID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerID="c14114c868f6a34f36cd3b4f134fb7cdb4a06fdbe081dc01e8e1d59ef2b5685f" exitCode=0 May 27 21:44:37.321288 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:37.321158 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" event={"ID":"0528ce7d-dce8-4dbe-bb5b-075ae1d33653","Type":"ContainerDied","Data":"c14114c868f6a34f36cd3b4f134fb7cdb4a06fdbe081dc01e8e1d59ef2b5685f"} May 27 21:44:39.178016 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.177991 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:39.205485 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205461 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rfvj8"] May 27 21:44:39.205817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205805 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="util" May 27 21:44:39.205872 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205818 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="util" May 27 21:44:39.205872 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205828 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="extract" May 27 21:44:39.205872 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205835 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="extract" May 27 21:44:39.205872 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205841 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="pull" May 27 21:44:39.205872 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205846 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="pull" May 27 21:44:39.206079 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.205924 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="0528ce7d-dce8-4dbe-bb5b-075ae1d33653" containerName="extract" May 27 21:44:39.208987 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.208970 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.211307 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.211283 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 27 21:44:39.211414 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.211330 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8hzwd\"" May 27 21:44:39.217974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.217955 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rfvj8"] May 27 21:44:39.222472 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.222454 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88hs4\" (UniqueName: \"kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4\") pod \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " May 27 21:44:39.222587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.222544 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util\") pod \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " May 27 21:44:39.222587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.222569 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle\") pod \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\" (UID: \"0528ce7d-dce8-4dbe-bb5b-075ae1d33653\") " May 27 21:44:39.223765 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.223735 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle" (OuterVolumeSpecName: "bundle") pod "0528ce7d-dce8-4dbe-bb5b-075ae1d33653" (UID: "0528ce7d-dce8-4dbe-bb5b-075ae1d33653"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:39.224662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.224638 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4" (OuterVolumeSpecName: "kube-api-access-88hs4") pod "0528ce7d-dce8-4dbe-bb5b-075ae1d33653" (UID: "0528ce7d-dce8-4dbe-bb5b-075ae1d33653"). InnerVolumeSpecName "kube-api-access-88hs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:44:39.232911 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.231436 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util" (OuterVolumeSpecName: "util") pod "0528ce7d-dce8-4dbe-bb5b-075ae1d33653" (UID: "0528ce7d-dce8-4dbe-bb5b-075ae1d33653"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:39.323326 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.323292 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9djz\" (UniqueName: \"kubernetes.io/projected/a26a1b96-b53f-4cf0-816a-91a0f669050e-kube-api-access-r9djz\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.323428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.323407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.323477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.323466 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:39.323508 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.323477 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:39.323508 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.323486 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88hs4\" (UniqueName: \"kubernetes.io/projected/0528ce7d-dce8-4dbe-bb5b-075ae1d33653-kube-api-access-88hs4\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:39.330539 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.330506 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" event={"ID":"f1f77b95-e958-4ff1-b69f-0b40bb97886e","Type":"ContainerStarted","Data":"658b84a798c5035195734b2e52a10dbcc929386cbc50749a0995815c7902a741"} May 27 21:44:39.332247 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.332227 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" event={"ID":"0528ce7d-dce8-4dbe-bb5b-075ae1d33653","Type":"ContainerDied","Data":"817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3"} May 27 21:44:39.332335 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.332251 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="817151fb4544571e87b7289b8eca56f7133ccd3393494e48414dc4e48fcc24c3" May 27 21:44:39.332335 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.332317 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835wcbg6" May 27 21:44:39.349420 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.349371 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-49z6z" podStartSLOduration=1.8310488569999999 podStartE2EDuration="4.349357305s" podCreationTimestamp="2026-05-27 21:44:35 +0000 UTC" firstStartedPulling="2026-05-27 21:44:36.700933749 +0000 UTC m=+388.556004608" lastFinishedPulling="2026-05-27 21:44:39.219242188 +0000 UTC m=+391.074313056" observedRunningTime="2026-05-27 21:44:39.347878407 +0000 UTC m=+391.202949287" watchObservedRunningTime="2026-05-27 21:44:39.349357305 +0000 UTC m=+391.204428187" May 27 21:44:39.424476 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.424411 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.424590 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.424476 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9djz\" (UniqueName: \"kubernetes.io/projected/a26a1b96-b53f-4cf0-816a-91a0f669050e-kube-api-access-r9djz\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.424590 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:39.424553 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 27 21:44:39.424676 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:39.424607 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert podName:a26a1b96-b53f-4cf0-816a-91a0f669050e nodeName:}" failed. No retries permitted until 2026-05-27 21:44:39.924592431 +0000 UTC m=+391.779663291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert") pod "odh-model-controller-858dbf95b8-rfvj8" (UID: "a26a1b96-b53f-4cf0-816a-91a0f669050e") : secret "odh-model-controller-webhook-cert" not found May 27 21:44:39.433944 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.433918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9djz\" (UniqueName: \"kubernetes.io/projected/a26a1b96-b53f-4cf0-816a-91a0f669050e-kube-api-access-r9djz\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.928844 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.928813 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:39.931287 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:39.931267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a1b96-b53f-4cf0-816a-91a0f669050e-cert\") pod \"odh-model-controller-858dbf95b8-rfvj8\" (UID: \"a26a1b96-b53f-4cf0-816a-91a0f669050e\") " pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:40.122416 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:40.122365 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:40.254065 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:40.254040 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rfvj8"] May 27 21:44:40.255611 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:40.255580 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26a1b96_b53f_4cf0_816a_91a0f669050e.slice/crio-f765cb861466b8048e7a1132033b420e2f06a65f6e203ed7df04889f053fcaee WatchSource:0}: Error finding container f765cb861466b8048e7a1132033b420e2f06a65f6e203ed7df04889f053fcaee: Status 404 returned error can't find the container with id f765cb861466b8048e7a1132033b420e2f06a65f6e203ed7df04889f053fcaee May 27 21:44:40.337544 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:40.337515 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" event={"ID":"a26a1b96-b53f-4cf0-816a-91a0f669050e","Type":"ContainerStarted","Data":"f765cb861466b8048e7a1132033b420e2f06a65f6e203ed7df04889f053fcaee"} May 27 21:44:43.351788 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:43.351709 2555 generic.go:358] "Generic (PLEG): container finished" podID="a26a1b96-b53f-4cf0-816a-91a0f669050e" containerID="fd837e25a17586f0e66bdade5c366e829669b93e7ae87adf7efbef0fd2ac5d88" exitCode=1 May 27 21:44:43.352157 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:43.351798 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" event={"ID":"a26a1b96-b53f-4cf0-816a-91a0f669050e","Type":"ContainerDied","Data":"fd837e25a17586f0e66bdade5c366e829669b93e7ae87adf7efbef0fd2ac5d88"} May 27 21:44:43.352157 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:43.352030 2555 scope.go:117] "RemoveContainer" containerID="fd837e25a17586f0e66bdade5c366e829669b93e7ae87adf7efbef0fd2ac5d88" May 27 21:44:44.357743 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.357712 2555 generic.go:358] "Generic (PLEG): container finished" podID="a26a1b96-b53f-4cf0-816a-91a0f669050e" containerID="f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855" exitCode=1 May 27 21:44:44.358161 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.357756 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" event={"ID":"a26a1b96-b53f-4cf0-816a-91a0f669050e","Type":"ContainerDied","Data":"f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855"} May 27 21:44:44.358161 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.357791 2555 scope.go:117] "RemoveContainer" containerID="fd837e25a17586f0e66bdade5c366e829669b93e7ae87adf7efbef0fd2ac5d88" May 27 21:44:44.358161 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.358065 2555 scope.go:117] "RemoveContainer" containerID="f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855" May 27 21:44:44.358289 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:44.358256 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rfvj8_opendatahub(a26a1b96-b53f-4cf0-816a-91a0f669050e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" podUID="a26a1b96-b53f-4cf0-816a-91a0f669050e" May 27 21:44:44.707203 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.707173 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pfd4d"] May 27 21:44:44.711946 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.711917 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:44.714185 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.714148 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 27 21:44:44.714312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.714220 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-74qdv\"" May 27 21:44:44.725279 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.725253 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pfd4d"] May 27 21:44:44.776264 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.776240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:44.776395 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.776286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxm6w\" (UniqueName: \"kubernetes.io/projected/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-kube-api-access-vxm6w\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:44.876941 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.876876 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:44.877119 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.876967 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxm6w\" (UniqueName: \"kubernetes.io/projected/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-kube-api-access-vxm6w\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:44.877119 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:44.877040 2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 27 21:44:44.877119 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:44.877120 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert podName:0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0 nodeName:}" failed. No retries permitted until 2026-05-27 21:44:45.377094798 +0000 UTC m=+397.232165658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert") pod "kserve-controller-manager-856948b99f-pfd4d" (UID: "0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0") : secret "kserve-webhook-server-cert" not found May 27 21:44:44.888419 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:44.888389 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxm6w\" (UniqueName: \"kubernetes.io/projected/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-kube-api-access-vxm6w\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:45.362574 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:45.362539 2555 scope.go:117] "RemoveContainer" containerID="f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855" May 27 21:44:45.363060 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:45.362775 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rfvj8_opendatahub(a26a1b96-b53f-4cf0-816a-91a0f669050e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" podUID="a26a1b96-b53f-4cf0-816a-91a0f669050e" May 27 21:44:45.380320 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:45.380289 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:45.383092 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:45.383068 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0-cert\") pod \"kserve-controller-manager-856948b99f-pfd4d\" (UID: \"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0\") " pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:45.622511 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:45.622432 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:45.758749 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:45.758719 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-pfd4d"] May 27 21:44:45.761947 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:45.761917 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d18b7cc_2dda_4f1a_9af1_ea72e2d358d0.slice/crio-768a675ccbdd5093298065943094e8a5c7180f9d04ce7fd31a9d7fcf7e71f5fc WatchSource:0}: Error finding container 768a675ccbdd5093298065943094e8a5c7180f9d04ce7fd31a9d7fcf7e71f5fc: Status 404 returned error can't find the container with id 768a675ccbdd5093298065943094e8a5c7180f9d04ce7fd31a9d7fcf7e71f5fc May 27 21:44:46.367170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:46.367131 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" event={"ID":"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0","Type":"ContainerStarted","Data":"768a675ccbdd5093298065943094e8a5c7180f9d04ce7fd31a9d7fcf7e71f5fc"} May 27 21:44:48.647741 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.647701 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb"] May 27 21:44:48.651648 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.651625 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.658152 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.658130 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:44:48.660181 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.660160 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:44:48.667629 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.667612 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrjrs\"" May 27 21:44:48.685033 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.685012 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb"] May 27 21:44:48.708951 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.708925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.709073 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.709009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.709137 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.709124 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xds\" (UniqueName: \"kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.810450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.810416 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.810613 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.810490 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.810613 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.810550 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xds\" (UniqueName: \"kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.810850 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.810829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.810931 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.810912 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.826445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.826424 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xds\" (UniqueName: \"kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:48.961392 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:48.961354 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:49.604158 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:49.604131 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb"] May 27 21:44:49.606359 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:49.606329 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d4e18a_6311_4eeb_a972_ac7309319cc3.slice/crio-0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551 WatchSource:0}: Error finding container 0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551: Status 404 returned error can't find the container with id 0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551 May 27 21:44:50.122560 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.122472 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:44:50.123023 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.122989 2555 scope.go:117] "RemoveContainer" containerID="f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855" May 27 21:44:50.123222 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:44:50.123200 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rfvj8_opendatahub(a26a1b96-b53f-4cf0-816a-91a0f669050e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" podUID="a26a1b96-b53f-4cf0-816a-91a0f669050e" May 27 21:44:50.186662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.186631 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd"] May 27 21:44:50.190206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.190187 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.192626 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.192602 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 27 21:44:50.192728 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.192602 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 27 21:44:50.192728 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.192607 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jctlf\"" May 27 21:44:50.202588 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.202559 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd"] May 27 21:44:50.322599 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.322567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrt5\" (UniqueName: \"kubernetes.io/projected/9406a62b-bd24-4832-9604-fbfdfd0cc19a-kube-api-access-bsrt5\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.322758 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.322686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9406a62b-bd24-4832-9604-fbfdfd0cc19a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.384950 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.384836 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" event={"ID":"0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0","Type":"ContainerStarted","Data":"042fa22d54de0d6a6808cd66d009641b24f668f1356da507aa0a70e9e78a2f57"} May 27 21:44:50.385091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.384999 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:44:50.386226 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.386194 2555 generic.go:358] "Generic (PLEG): container finished" podID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerID="33b8c3c5b4c8ab73b6325d8744317e9fc0753283a976f2d34360e6de02f63235" exitCode=0 May 27 21:44:50.386356 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.386338 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" event={"ID":"92d4e18a-6311-4eeb-a972-ac7309319cc3","Type":"ContainerDied","Data":"33b8c3c5b4c8ab73b6325d8744317e9fc0753283a976f2d34360e6de02f63235"} May 27 21:44:50.386432 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.386362 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" event={"ID":"92d4e18a-6311-4eeb-a972-ac7309319cc3","Type":"ContainerStarted","Data":"0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551"} May 27 21:44:50.404327 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.404280 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" podStartSLOduration=2.656807535 podStartE2EDuration="6.404266423s" podCreationTimestamp="2026-05-27 21:44:44 +0000 UTC" firstStartedPulling="2026-05-27 21:44:45.763215046 +0000 UTC m=+397.618285908" lastFinishedPulling="2026-05-27 21:44:49.510673937 +0000 UTC m=+401.365744796" observedRunningTime="2026-05-27 21:44:50.40338218 +0000 UTC m=+402.258453062" watchObservedRunningTime="2026-05-27 21:44:50.404266423 +0000 UTC m=+402.259337305" May 27 21:44:50.424091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.424063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9406a62b-bd24-4832-9604-fbfdfd0cc19a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.424175 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.424133 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrt5\" (UniqueName: \"kubernetes.io/projected/9406a62b-bd24-4832-9604-fbfdfd0cc19a-kube-api-access-bsrt5\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.426652 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.426626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9406a62b-bd24-4832-9604-fbfdfd0cc19a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.434036 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.434013 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrt5\" (UniqueName: \"kubernetes.io/projected/9406a62b-bd24-4832-9604-fbfdfd0cc19a-kube-api-access-bsrt5\") pod \"servicemesh-operator3-55f49c5f94-qqjrd\" (UID: \"9406a62b-bd24-4832-9604-fbfdfd0cc19a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.501569 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.501536 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:44:50.631721 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:50.631690 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd"] May 27 21:44:50.632955 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:44:50.632928 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9406a62b_bd24_4832_9604_fbfdfd0cc19a.slice/crio-7034a552acb285db5b7012744c50d814cfe1124d74c486df8ae86042d43ba467 WatchSource:0}: Error finding container 7034a552acb285db5b7012744c50d814cfe1124d74c486df8ae86042d43ba467: Status 404 returned error can't find the container with id 7034a552acb285db5b7012744c50d814cfe1124d74c486df8ae86042d43ba467 May 27 21:44:51.397094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:51.397008 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" event={"ID":"9406a62b-bd24-4832-9604-fbfdfd0cc19a","Type":"ContainerStarted","Data":"7034a552acb285db5b7012744c50d814cfe1124d74c486df8ae86042d43ba467"} May 27 21:44:51.399964 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:51.399929 2555 generic.go:358] "Generic (PLEG): container finished" podID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerID="c1d4c32d9ef8ef2ae11b702f2612b1bce357e6077fb02e86f99101350b01f0e9" exitCode=0 May 27 21:44:51.400088 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:51.400005 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" event={"ID":"92d4e18a-6311-4eeb-a972-ac7309319cc3","Type":"ContainerDied","Data":"c1d4c32d9ef8ef2ae11b702f2612b1bce357e6077fb02e86f99101350b01f0e9"} May 27 21:44:52.406627 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:52.406586 2555 generic.go:358] "Generic (PLEG): container finished" podID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerID="87f6a42b5330ae9e4aefd79cfdf3fbb5e342245c4815b32805d39f449faaebc2" exitCode=0 May 27 21:44:52.407202 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:52.406672 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" event={"ID":"92d4e18a-6311-4eeb-a972-ac7309319cc3","Type":"ContainerDied","Data":"87f6a42b5330ae9e4aefd79cfdf3fbb5e342245c4815b32805d39f449faaebc2"} May 27 21:44:53.411746 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.411709 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" event={"ID":"9406a62b-bd24-4832-9604-fbfdfd0cc19a","Type":"ContainerStarted","Data":"ce58f52c015eaae8709c84f67bb8303e1eba9364936fce0ebb12df35f11dadb8"} May 27 21:44:53.437553 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.437491 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" podStartSLOduration=0.761516349 podStartE2EDuration="3.437472166s" podCreationTimestamp="2026-05-27 21:44:50 +0000 UTC" firstStartedPulling="2026-05-27 21:44:50.635510722 +0000 UTC m=+402.490581584" lastFinishedPulling="2026-05-27 21:44:53.311466531 +0000 UTC m=+405.166537401" observedRunningTime="2026-05-27 21:44:53.434504772 +0000 UTC m=+405.289575653" watchObservedRunningTime="2026-05-27 21:44:53.437472166 +0000 UTC m=+405.292543048" May 27 21:44:53.577151 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.577121 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:53.654714 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.654686 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9xds\" (UniqueName: \"kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds\") pod \"92d4e18a-6311-4eeb-a972-ac7309319cc3\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " May 27 21:44:53.654882 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.654752 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle\") pod \"92d4e18a-6311-4eeb-a972-ac7309319cc3\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " May 27 21:44:53.654882 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.654776 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util\") pod \"92d4e18a-6311-4eeb-a972-ac7309319cc3\" (UID: \"92d4e18a-6311-4eeb-a972-ac7309319cc3\") " May 27 21:44:53.655580 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.655558 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle" (OuterVolumeSpecName: "bundle") pod "92d4e18a-6311-4eeb-a972-ac7309319cc3" (UID: "92d4e18a-6311-4eeb-a972-ac7309319cc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:53.657543 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.657505 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds" (OuterVolumeSpecName: "kube-api-access-n9xds") pod "92d4e18a-6311-4eeb-a972-ac7309319cc3" (UID: "92d4e18a-6311-4eeb-a972-ac7309319cc3"). InnerVolumeSpecName "kube-api-access-n9xds". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:44:53.659968 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.659947 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util" (OuterVolumeSpecName: "util") pod "92d4e18a-6311-4eeb-a972-ac7309319cc3" (UID: "92d4e18a-6311-4eeb-a972-ac7309319cc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:44:53.756202 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.756180 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:53.756202 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.756201 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d4e18a-6311-4eeb-a972-ac7309319cc3-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:53.756327 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:53.756211 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9xds\" (UniqueName: \"kubernetes.io/projected/92d4e18a-6311-4eeb-a972-ac7309319cc3-kube-api-access-n9xds\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:44:54.417210 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:54.417182 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" May 27 21:44:54.417210 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:54.417185 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abxzzb" event={"ID":"92d4e18a-6311-4eeb-a972-ac7309319cc3","Type":"ContainerDied","Data":"0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551"} May 27 21:44:54.417599 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:54.417227 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cafc166d9518dd0b0fd65ec20f52ed4a6bd94e86a7ffc44fe9942fd84a55551" May 27 21:44:54.417599 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:44:54.417267 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:45:00.122986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.122949 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:45:00.123358 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.123325 2555 scope.go:117] "RemoveContainer" containerID="f0c2b3f56d3b810762071737228463be104a8eb03b0b973faa31a89b9892a855" May 27 21:45:00.335873 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.335839 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x"] May 27 21:45:00.336279 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336264 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="extract" May 27 21:45:00.336339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336284 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="extract" May 27 21:45:00.336339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336303 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="pull" May 27 21:45:00.336339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336309 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="pull" May 27 21:45:00.336339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336322 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="util" May 27 21:45:00.336339 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336328 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="util" May 27 21:45:00.336488 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.336394 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="92d4e18a-6311-4eeb-a972-ac7309319cc3" containerName="extract" May 27 21:45:00.339516 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.339487 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.342397 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.342298 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gfnwh\"" May 27 21:45:00.342728 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.342712 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 21:45:00.343112 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.343092 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 27 21:45:00.343305 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.343126 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 27 21:45:00.343411 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.343141 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 27 21:45:00.345386 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.345363 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x"] May 27 21:45:00.410094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410094 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410222 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410152 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7tw\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-kube-api-access-sg7tw\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410222 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410333 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.410441 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.410345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511448 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511409 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511448 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511453 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511489 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511518 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511546 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511586 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.511697 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.511637 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7tw\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-kube-api-access-sg7tw\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.512564 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.512503 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.514378 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.514331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.515128 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.515102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.515245 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.515130 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.515245 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.515112 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.521022 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.520994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7tw\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-kube-api-access-sg7tw\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.521445 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.521424 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd7c3727-b031-4d35-90ea-f9eeb76c0e3b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lw59x\" (UID: \"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.651482 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.651445 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:00.806017 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:00.805985 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x"] May 27 21:45:01.446525 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:01.446486 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" event={"ID":"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b","Type":"ContainerStarted","Data":"791b6d2c15d5a7ea9b40da13b073a9dba2af735c4c0dee25fd34b22f349310c6"} May 27 21:45:01.448266 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:01.448233 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" event={"ID":"a26a1b96-b53f-4cf0-816a-91a0f669050e","Type":"ContainerStarted","Data":"652721d6dc61f3940e691be30439abadecfdfe3e253f6c8c268285f2e391b364"} May 27 21:45:01.448460 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:01.448441 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:45:01.466276 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:01.466226 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" podStartSLOduration=2.315469516 podStartE2EDuration="22.466208424s" podCreationTimestamp="2026-05-27 21:44:39 +0000 UTC" firstStartedPulling="2026-05-27 21:44:40.256972075 +0000 UTC m=+392.112042937" lastFinishedPulling="2026-05-27 21:45:00.407710983 +0000 UTC m=+412.262781845" observedRunningTime="2026-05-27 21:45:01.46571254 +0000 UTC m=+413.320783424" watchObservedRunningTime="2026-05-27 21:45:01.466208424 +0000 UTC m=+413.321279308" May 27 21:45:03.574706 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:03.574659 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 27 21:45:03.575101 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:03.574738 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 27 21:45:04.464986 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:04.464946 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" event={"ID":"bd7c3727-b031-4d35-90ea-f9eeb76c0e3b","Type":"ContainerStarted","Data":"acec450b2390eeeb2fe3f0dd4470d1ae32b01aefb63d8de41ea6e8b9ed26d7e6"} May 27 21:45:04.465182 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:04.465158 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:04.466704 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:04.466670 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-lw59x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 27 21:45:04.466804 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:04.466735 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" podUID="bd7c3727-b031-4d35-90ea-f9eeb76c0e3b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 21:45:04.488540 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:04.488490 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" podStartSLOduration=1.721530918 podStartE2EDuration="4.488478369s" podCreationTimestamp="2026-05-27 21:45:00 +0000 UTC" firstStartedPulling="2026-05-27 21:45:00.807416075 +0000 UTC m=+412.662486952" lastFinishedPulling="2026-05-27 21:45:03.57436354 +0000 UTC m=+415.429434403" observedRunningTime="2026-05-27 21:45:04.487470487 +0000 UTC m=+416.342541363" watchObservedRunningTime="2026-05-27 21:45:04.488478369 +0000 UTC m=+416.343549250" May 27 21:45:05.423412 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:05.423377 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qqjrd" May 27 21:45:05.471802 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:05.471767 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lw59x" May 27 21:45:12.456360 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:12.456319 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-rfvj8" May 27 21:45:21.406010 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:21.405981 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-pfd4d" May 27 21:45:50.375621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.375586 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k"] May 27 21:45:50.388822 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.388789 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k"] May 27 21:45:50.389155 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.388932 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.391376 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.391352 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:45:50.391639 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.391620 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:45:50.391732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.391626 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btx95\"" May 27 21:45:50.531882 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.531846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv5zc\" (UniqueName: \"kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.532058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.531924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.532058 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.531959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.632854 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.632776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv5zc\" (UniqueName: \"kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.632854 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.632835 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.633035 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.632919 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.633298 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.633279 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.633335 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.633302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.642549 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.642518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv5zc\" (UniqueName: \"kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.699427 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.699405 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:50.806146 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.806104 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh"] May 27 21:45:50.811390 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.811368 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:50.818213 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.818182 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh"] May 27 21:45:50.832840 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.832821 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k"] May 27 21:45:50.835689 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:45:50.835662 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e1f06c_8b12_4a18_b7f5_82e96ba41c3a.slice/crio-d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d WatchSource:0}: Error finding container d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d: Status 404 returned error can't find the container with id d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d May 27 21:45:50.935178 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.935135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:50.935319 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.935240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvstg\" (UniqueName: \"kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:50.935319 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:50.935283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.036013 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.035975 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvstg\" (UniqueName: \"kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.036196 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.036033 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.036196 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.036073 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.036386 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.036364 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.036450 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.036371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.046836 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.046807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvstg\" (UniqueName: \"kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.123782 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.123755 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:51.214534 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.214506 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl"] May 27 21:45:51.220959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.220932 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.230976 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.230760 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl"] May 27 21:45:51.260250 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.260226 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh"] May 27 21:45:51.262818 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:45:51.262786 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278aa1af_1fb5_483b_a8b4_24659c03b89a.slice/crio-a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08 WatchSource:0}: Error finding container a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08: Status 404 returned error can't find the container with id a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08 May 27 21:45:51.339472 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.339441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.339577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.339508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.339619 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.339582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzr9w\" (UniqueName: \"kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.440610 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.440548 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.440981 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.440660 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzr9w\" (UniqueName: \"kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.440981 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.440706 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.440981 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.440941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.441090 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.441032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.450761 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.450741 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzr9w\" (UniqueName: \"kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.534758 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.534737 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:51.582978 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.582778 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5"] May 27 21:45:51.588239 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.588215 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.595327 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.595300 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5"] May 27 21:45:51.653730 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.653692 2555 generic.go:358] "Generic (PLEG): container finished" podID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerID="b16d211431cbd3c2f3188545fafd836dccd4185bf0247b584732d3e9a77afab2" exitCode=0 May 27 21:45:51.653916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.653758 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" event={"ID":"278aa1af-1fb5-483b-a8b4-24659c03b89a","Type":"ContainerDied","Data":"b16d211431cbd3c2f3188545fafd836dccd4185bf0247b584732d3e9a77afab2"} May 27 21:45:51.653916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.653801 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" event={"ID":"278aa1af-1fb5-483b-a8b4-24659c03b89a","Type":"ContainerStarted","Data":"a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08"} May 27 21:45:51.655528 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.655494 2555 generic.go:358] "Generic (PLEG): container finished" podID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerID="16bc40c567b44b4de54bf845a7f6031d9f6d4702faf804465ed228ef676c8688" exitCode=0 May 27 21:45:51.655643 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.655591 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" event={"ID":"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a","Type":"ContainerDied","Data":"16bc40c567b44b4de54bf845a7f6031d9f6d4702faf804465ed228ef676c8688"} May 27 21:45:51.655643 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.655621 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" event={"ID":"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a","Type":"ContainerStarted","Data":"d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d"} May 27 21:45:51.672939 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.672916 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl"] May 27 21:45:51.674212 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:45:51.674186 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab26de4_6c1a_4cb1_a7aa_5734eb459a31.slice/crio-adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27 WatchSource:0}: Error finding container adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27: Status 404 returned error can't find the container with id adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27 May 27 21:45:51.744019 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.743993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.744149 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.744034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.744149 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.744063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dtl\" (UniqueName: \"kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.844732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.844703 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.844839 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.844738 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.844839 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.844765 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72dtl\" (UniqueName: \"kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.845065 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.845044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.845138 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.845104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.855068 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.855045 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dtl\" (UniqueName: \"kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:51.902064 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:51.902043 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:52.035015 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.034991 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5"] May 27 21:45:52.036636 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:45:52.036606 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c70663_2035_4612_834f_a1c277d35bda.slice/crio-da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208 WatchSource:0}: Error finding container da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208: Status 404 returned error can't find the container with id da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208 May 27 21:45:52.660621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.660584 2555 generic.go:358] "Generic (PLEG): container finished" podID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerID="fac5889aca678800d20f9086af3916e84a0900bab0a26f841fe32fcb13c50a22" exitCode=0 May 27 21:45:52.661013 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.660663 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" event={"ID":"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a","Type":"ContainerDied","Data":"fac5889aca678800d20f9086af3916e84a0900bab0a26f841fe32fcb13c50a22"} May 27 21:45:52.662038 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.662016 2555 generic.go:358] "Generic (PLEG): container finished" podID="02c70663-2035-4612-834f-a1c277d35bda" containerID="930f7568a39951b0bdd53b6e8bfca25f3d3a1f21d9f223eb71f8cf17a498f5aa" exitCode=0 May 27 21:45:52.662138 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.662094 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" event={"ID":"02c70663-2035-4612-834f-a1c277d35bda","Type":"ContainerDied","Data":"930f7568a39951b0bdd53b6e8bfca25f3d3a1f21d9f223eb71f8cf17a498f5aa"} May 27 21:45:52.662138 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.662125 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" event={"ID":"02c70663-2035-4612-834f-a1c277d35bda","Type":"ContainerStarted","Data":"da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208"} May 27 21:45:52.663402 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.663382 2555 generic.go:358] "Generic (PLEG): container finished" podID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerID="f6856abc755108b58b80def45e944fdf10e30e7f3665b9c22b85cae6d22a0304" exitCode=0 May 27 21:45:52.663402 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.663419 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" event={"ID":"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31","Type":"ContainerDied","Data":"f6856abc755108b58b80def45e944fdf10e30e7f3665b9c22b85cae6d22a0304"} May 27 21:45:52.663557 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:52.663443 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" event={"ID":"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31","Type":"ContainerStarted","Data":"adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27"} May 27 21:45:53.674903 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.674860 2555 generic.go:358] "Generic (PLEG): container finished" podID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerID="f2e47564a1e66351171f0da37c5df656a953d2603679f60451a5799d5109a120" exitCode=0 May 27 21:45:53.675265 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.674943 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" event={"ID":"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31","Type":"ContainerDied","Data":"f2e47564a1e66351171f0da37c5df656a953d2603679f60451a5799d5109a120"} May 27 21:45:53.676707 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.676680 2555 generic.go:358] "Generic (PLEG): container finished" podID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerID="0bc84e743c5023558b1852a2a56177ce81d820e9b1ba99d793c132a3fdcb927f" exitCode=0 May 27 21:45:53.676824 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.676781 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" event={"ID":"278aa1af-1fb5-483b-a8b4-24659c03b89a","Type":"ContainerDied","Data":"0bc84e743c5023558b1852a2a56177ce81d820e9b1ba99d793c132a3fdcb927f"} May 27 21:45:53.681881 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.681853 2555 generic.go:358] "Generic (PLEG): container finished" podID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerID="9d042ac49acefe1cdb1ffe5fde08528b60592a9f91646d8d637696e3a3fd56a9" exitCode=0 May 27 21:45:53.682098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.682075 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" event={"ID":"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a","Type":"ContainerDied","Data":"9d042ac49acefe1cdb1ffe5fde08528b60592a9f91646d8d637696e3a3fd56a9"} May 27 21:45:53.684139 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.684119 2555 generic.go:358] "Generic (PLEG): container finished" podID="02c70663-2035-4612-834f-a1c277d35bda" containerID="1d52c104e3040a48bdf60843f8d45ee856d05877991ceb1b1e82f523fb2c9602" exitCode=0 May 27 21:45:53.684231 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:53.684198 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" event={"ID":"02c70663-2035-4612-834f-a1c277d35bda","Type":"ContainerDied","Data":"1d52c104e3040a48bdf60843f8d45ee856d05877991ceb1b1e82f523fb2c9602"} May 27 21:45:54.689873 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.689836 2555 generic.go:358] "Generic (PLEG): container finished" podID="02c70663-2035-4612-834f-a1c277d35bda" containerID="e17a3319be668e051e08af90ebb8f13890d6fce9d9a929ee81cdbd0510c7bdc7" exitCode=0 May 27 21:45:54.690268 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.689923 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" event={"ID":"02c70663-2035-4612-834f-a1c277d35bda","Type":"ContainerDied","Data":"e17a3319be668e051e08af90ebb8f13890d6fce9d9a929ee81cdbd0510c7bdc7"} May 27 21:45:54.691706 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.691685 2555 generic.go:358] "Generic (PLEG): container finished" podID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerID="54959a5fda20dfa3ce85ac87350d1bccad073227f41b37142e58a4294a376f21" exitCode=0 May 27 21:45:54.691811 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.691762 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" event={"ID":"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31","Type":"ContainerDied","Data":"54959a5fda20dfa3ce85ac87350d1bccad073227f41b37142e58a4294a376f21"} May 27 21:45:54.693370 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.693352 2555 generic.go:358] "Generic (PLEG): container finished" podID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerID="eaedfefbe2a04575d740516bc3fcfaa175a7ad723895c54610c43d2763d9c9b5" exitCode=0 May 27 21:45:54.693436 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.693421 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" event={"ID":"278aa1af-1fb5-483b-a8b4-24659c03b89a","Type":"ContainerDied","Data":"eaedfefbe2a04575d740516bc3fcfaa175a7ad723895c54610c43d2763d9c9b5"} May 27 21:45:54.822506 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.822474 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:54.972436 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.972407 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle\") pod \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " May 27 21:45:54.972436 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.972441 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util\") pod \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " May 27 21:45:54.972665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.972487 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv5zc\" (UniqueName: \"kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc\") pod \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\" (UID: \"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a\") " May 27 21:45:54.972933 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.972867 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle" (OuterVolumeSpecName: "bundle") pod "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" (UID: "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:54.974821 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.974798 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc" (OuterVolumeSpecName: "kube-api-access-dv5zc") pod "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" (UID: "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a"). InnerVolumeSpecName "kube-api-access-dv5zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:45:54.977206 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:54.977188 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util" (OuterVolumeSpecName: "util") pod "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" (UID: "b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.073240 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.073216 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:55.073240 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.073238 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:55.073381 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.073248 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv5zc\" (UniqueName: \"kubernetes.io/projected/b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a-kube-api-access-dv5zc\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:55.699541 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.699508 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" May 27 21:45:55.699541 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.699523 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k" event={"ID":"b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a","Type":"ContainerDied","Data":"d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d"} May 27 21:45:55.699969 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.699558 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d30f30bf8f42078344dfe45d5bf932d889e8a1984ab0538c175e945afe4c400d" May 27 21:45:55.838199 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.838170 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:55.885955 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.885926 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:55.890277 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.890260 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:55.981772 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981709 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvstg\" (UniqueName: \"kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg\") pod \"278aa1af-1fb5-483b-a8b4-24659c03b89a\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " May 27 21:45:55.981772 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981748 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dtl\" (UniqueName: \"kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl\") pod \"02c70663-2035-4612-834f-a1c277d35bda\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " May 27 21:45:55.981957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981773 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle\") pod \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " May 27 21:45:55.981957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981800 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzr9w\" (UniqueName: \"kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w\") pod \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " May 27 21:45:55.981957 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981943 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util\") pod \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\" (UID: \"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31\") " May 27 21:45:55.982067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.981980 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util\") pod \"02c70663-2035-4612-834f-a1c277d35bda\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " May 27 21:45:55.982067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.982037 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle\") pod \"278aa1af-1fb5-483b-a8b4-24659c03b89a\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " May 27 21:45:55.982067 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.982064 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util\") pod \"278aa1af-1fb5-483b-a8b4-24659c03b89a\" (UID: \"278aa1af-1fb5-483b-a8b4-24659c03b89a\") " May 27 21:45:55.982209 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.982136 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle\") pod \"02c70663-2035-4612-834f-a1c277d35bda\" (UID: \"02c70663-2035-4612-834f-a1c277d35bda\") " May 27 21:45:55.982711 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.982686 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle" (OuterVolumeSpecName: "bundle") pod "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" (UID: "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.983103 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.983078 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle" (OuterVolumeSpecName: "bundle") pod "02c70663-2035-4612-834f-a1c277d35bda" (UID: "02c70663-2035-4612-834f-a1c277d35bda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.983484 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.983458 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle" (OuterVolumeSpecName: "bundle") pod "278aa1af-1fb5-483b-a8b4-24659c03b89a" (UID: "278aa1af-1fb5-483b-a8b4-24659c03b89a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.984375 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.984353 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg" (OuterVolumeSpecName: "kube-api-access-jvstg") pod "278aa1af-1fb5-483b-a8b4-24659c03b89a" (UID: "278aa1af-1fb5-483b-a8b4-24659c03b89a"). InnerVolumeSpecName "kube-api-access-jvstg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:45:55.984534 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.984508 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl" (OuterVolumeSpecName: "kube-api-access-72dtl") pod "02c70663-2035-4612-834f-a1c277d35bda" (UID: "02c70663-2035-4612-834f-a1c277d35bda"). InnerVolumeSpecName "kube-api-access-72dtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:45:55.984534 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.984508 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w" (OuterVolumeSpecName: "kube-api-access-bzr9w") pod "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" (UID: "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31"). InnerVolumeSpecName "kube-api-access-bzr9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:45:55.988204 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.988157 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util" (OuterVolumeSpecName: "util") pod "02c70663-2035-4612-834f-a1c277d35bda" (UID: "02c70663-2035-4612-834f-a1c277d35bda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.988663 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.988644 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util" (OuterVolumeSpecName: "util") pod "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" (UID: "6ab26de4-6c1a-4cb1-a7aa-5734eb459a31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:55.988728 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:55.988711 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util" (OuterVolumeSpecName: "util") pod "278aa1af-1fb5-483b-a8b4-24659c03b89a" (UID: "278aa1af-1fb5-483b-a8b4-24659c03b89a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:45:56.083238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083202 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvstg\" (UniqueName: \"kubernetes.io/projected/278aa1af-1fb5-483b-a8b4-24659c03b89a-kube-api-access-jvstg\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083232 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dtl\" (UniqueName: \"kubernetes.io/projected/02c70663-2035-4612-834f-a1c277d35bda-kube-api-access-72dtl\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083246 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083262 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzr9w\" (UniqueName: \"kubernetes.io/projected/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-kube-api-access-bzr9w\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083274 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ab26de4-6c1a-4cb1-a7aa-5734eb459a31-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083285 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083295 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083306 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/278aa1af-1fb5-483b-a8b4-24659c03b89a-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.083428 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.083316 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02c70663-2035-4612-834f-a1c277d35bda-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:45:56.705130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.705091 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" event={"ID":"02c70663-2035-4612-834f-a1c277d35bda","Type":"ContainerDied","Data":"da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208"} May 27 21:45:56.705130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.705113 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5" May 27 21:45:56.705130 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.705132 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da2d0db4e6b3889d7386c8a8293ace46de447004603fcfb4b1dc780f6a9c2208" May 27 21:45:56.706813 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.706791 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" May 27 21:45:56.706974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.706788 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl" event={"ID":"6ab26de4-6c1a-4cb1-a7aa-5734eb459a31","Type":"ContainerDied","Data":"adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27"} May 27 21:45:56.706974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.706917 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adafc26242b31e9330190d423bb424a6b130df9b3e3cc5f0d7d25c3e5af82e27" May 27 21:45:56.708686 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.708667 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" event={"ID":"278aa1af-1fb5-483b-a8b4-24659c03b89a","Type":"ContainerDied","Data":"a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08"} May 27 21:45:56.708794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.708689 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a75ff262a52c7294d4d008689bebc2314aee3fa7c6b341507057a561e3198b08" May 27 21:45:56.708794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:56.708703 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh" May 27 21:45:59.084934 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.084859 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-686db78d7b-v587m"] May 27 21:45:59.085387 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085369 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="util" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085390 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="util" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085398 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="extract" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085404 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="extract" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085418 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="pull" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085423 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="pull" May 27 21:45:59.085440 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085438 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085444 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085449 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085454 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085461 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085466 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085472 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085476 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="util" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085482 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085487 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085491 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085496 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085503 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085507 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085513 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085518 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085526 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085531 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="pull" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085589 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="278aa1af-1fb5-483b-a8b4-24659c03b89a" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085598 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085606 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="02c70663-2035-4612-834f-a1c277d35bda" containerName="extract" May 27 21:45:59.085628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.085613 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ab26de4-6c1a-4cb1-a7aa-5734eb459a31" containerName="extract" May 27 21:45:59.088623 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.088607 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.097989 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.097968 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686db78d7b-v587m"] May 27 21:45:59.207471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-service-ca\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207630 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-oauth-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207630 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9v28\" (UniqueName: \"kubernetes.io/projected/096b4f70-729c-44d3-8fca-329b206d77a2-kube-api-access-p9v28\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207630 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-console-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207630 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-trusted-ca-bundle\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.207794 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.207680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-oauth-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308105 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308078 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-service-ca\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308240 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308112 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-oauth-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308240 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308131 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9v28\" (UniqueName: \"kubernetes.io/projected/096b4f70-729c-44d3-8fca-329b206d77a2-kube-api-access-p9v28\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308345 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308327 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-console-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308393 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308379 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308456 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308444 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-trusted-ca-bundle\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308514 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308470 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-oauth-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308771 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-service-ca\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.308862 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.308767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-oauth-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.309050 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.309005 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-console-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.309218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.309199 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096b4f70-729c-44d3-8fca-329b206d77a2-trusted-ca-bundle\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.311530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.311510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-serving-cert\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.311623 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.311517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/096b4f70-729c-44d3-8fca-329b206d77a2-console-oauth-config\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.317703 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.317681 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9v28\" (UniqueName: \"kubernetes.io/projected/096b4f70-729c-44d3-8fca-329b206d77a2-kube-api-access-p9v28\") pod \"console-686db78d7b-v587m\" (UID: \"096b4f70-729c-44d3-8fca-329b206d77a2\") " pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.401443 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.401348 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686db78d7b-v587m" May 27 21:45:59.541074 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.541046 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686db78d7b-v587m"] May 27 21:45:59.542523 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:45:59.542499 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096b4f70_729c_44d3_8fca_329b206d77a2.slice/crio-093bb8b420e896dcc0550d1a7d77363b6bf5bb8eafecfa0f2ff9daef58a68002 WatchSource:0}: Error finding container 093bb8b420e896dcc0550d1a7d77363b6bf5bb8eafecfa0f2ff9daef58a68002: Status 404 returned error can't find the container with id 093bb8b420e896dcc0550d1a7d77363b6bf5bb8eafecfa0f2ff9daef58a68002 May 27 21:45:59.721724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.721691 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686db78d7b-v587m" event={"ID":"096b4f70-729c-44d3-8fca-329b206d77a2","Type":"ContainerStarted","Data":"e01aff4cabb44f015b3faca3f54c9e32fa6b83f9495ae7ec7c0b6ba5099e8661"} May 27 21:45:59.721724 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.721727 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686db78d7b-v587m" event={"ID":"096b4f70-729c-44d3-8fca-329b206d77a2","Type":"ContainerStarted","Data":"093bb8b420e896dcc0550d1a7d77363b6bf5bb8eafecfa0f2ff9daef58a68002"} May 27 21:45:59.742147 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:45:59.742105 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-686db78d7b-v587m" podStartSLOduration=0.742092075 podStartE2EDuration="742.092075ms" podCreationTimestamp="2026-05-27 21:45:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:45:59.74078873 +0000 UTC m=+471.595859610" watchObservedRunningTime="2026-05-27 21:45:59.742092075 +0000 UTC m=+471.597162957" May 27 21:46:09.402477 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:09.402443 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686db78d7b-v587m" May 27 21:46:09.402927 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:09.402487 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686db78d7b-v587m" May 27 21:46:09.406954 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:09.406936 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686db78d7b-v587m" May 27 21:46:09.767563 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:09.767536 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686db78d7b-v587m" May 27 21:46:09.835081 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:09.835043 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:46:10.180164 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.180132 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb"] May 27 21:46:10.184936 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.184909 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:10.187507 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.187462 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d2knk\"" May 27 21:46:10.187629 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.187541 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:46:10.187731 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.187714 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:46:10.195154 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.195128 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb"] May 27 21:46:10.300080 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.300045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsqj\" (UniqueName: \"kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj\") pod \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" (UID: \"ae50f5e2-8414-4765-bb2c-1297818bcbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:10.401033 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.401001 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsqj\" (UniqueName: \"kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj\") pod \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" (UID: \"ae50f5e2-8414-4765-bb2c-1297818bcbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:10.415557 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.415532 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsqj\" (UniqueName: \"kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj\") pod \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" (UID: \"ae50f5e2-8414-4765-bb2c-1297818bcbfb\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:10.500537 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.500453 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:10.643740 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:10.643708 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae50f5e2_8414_4765_bb2c_1297818bcbfb.slice/crio-d19ba377fd0b03fb93de1e4c8488a2dd193fdcda3e0aa55474ab696f30ea6c5f WatchSource:0}: Error finding container d19ba377fd0b03fb93de1e4c8488a2dd193fdcda3e0aa55474ab696f30ea6c5f: Status 404 returned error can't find the container with id d19ba377fd0b03fb93de1e4c8488a2dd193fdcda3e0aa55474ab696f30ea6c5f May 27 21:46:10.644168 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.644142 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb"] May 27 21:46:10.768939 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:10.768848 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" event={"ID":"ae50f5e2-8414-4765-bb2c-1297818bcbfb","Type":"ContainerStarted","Data":"d19ba377fd0b03fb93de1e4c8488a2dd193fdcda3e0aa55474ab696f30ea6c5f"} May 27 21:46:12.778259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:12.778218 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" event={"ID":"ae50f5e2-8414-4765-bb2c-1297818bcbfb","Type":"ContainerStarted","Data":"d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5"} May 27 21:46:12.778259 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:12.778268 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:12.802947 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:12.802869 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" podStartSLOduration=0.874834597 podStartE2EDuration="2.802853055s" podCreationTimestamp="2026-05-27 21:46:10 +0000 UTC" firstStartedPulling="2026-05-27 21:46:10.645599032 +0000 UTC m=+482.500669895" lastFinishedPulling="2026-05-27 21:46:12.573617495 +0000 UTC m=+484.428688353" observedRunningTime="2026-05-27 21:46:12.798991706 +0000 UTC m=+484.654062587" watchObservedRunningTime="2026-05-27 21:46:12.802853055 +0000 UTC m=+484.657923954" May 27 21:46:17.539047 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.539006 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6"] May 27 21:46:17.542911 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.542875 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:17.554432 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.554412 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 27 21:46:17.556579 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.556561 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wrf65\"" May 27 21:46:17.565027 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.565007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdqp\" (UniqueName: \"kubernetes.io/projected/cf5357e9-b108-487f-aaec-ee4f27878346-kube-api-access-zfdqp\") pod \"dns-operator-controller-manager-648d5c98bc-lpjw6\" (UID: \"cf5357e9-b108-487f-aaec-ee4f27878346\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:17.609941 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.609918 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6"] May 27 21:46:17.665807 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.665778 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdqp\" (UniqueName: \"kubernetes.io/projected/cf5357e9-b108-487f-aaec-ee4f27878346-kube-api-access-zfdqp\") pod \"dns-operator-controller-manager-648d5c98bc-lpjw6\" (UID: \"cf5357e9-b108-487f-aaec-ee4f27878346\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:17.694181 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.694155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdqp\" (UniqueName: \"kubernetes.io/projected/cf5357e9-b108-487f-aaec-ee4f27878346-kube-api-access-zfdqp\") pod \"dns-operator-controller-manager-648d5c98bc-lpjw6\" (UID: \"cf5357e9-b108-487f-aaec-ee4f27878346\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:17.853575 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.853504 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:17.998993 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:17.998968 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6"] May 27 21:46:18.000466 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:18.000443 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5357e9_b108_487f_aaec_ee4f27878346.slice/crio-337c5db1cfd0f8c443433336e4c4abfeb591f7b9bc0170de188bc9b0e0254aa5 WatchSource:0}: Error finding container 337c5db1cfd0f8c443433336e4c4abfeb591f7b9bc0170de188bc9b0e0254aa5: Status 404 returned error can't find the container with id 337c5db1cfd0f8c443433336e4c4abfeb591f7b9bc0170de188bc9b0e0254aa5 May 27 21:46:18.802854 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:18.802823 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" event={"ID":"cf5357e9-b108-487f-aaec-ee4f27878346","Type":"ContainerStarted","Data":"337c5db1cfd0f8c443433336e4c4abfeb591f7b9bc0170de188bc9b0e0254aa5"} May 27 21:46:20.812084 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:20.812046 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" event={"ID":"cf5357e9-b108-487f-aaec-ee4f27878346","Type":"ContainerStarted","Data":"49ab89c278f3662efb24c07b09d98392c260749526a08137012886ed0a1ba792"} May 27 21:46:20.812442 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:20.812127 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:20.835953 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:20.835902 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" podStartSLOduration=1.442541895 podStartE2EDuration="3.835872505s" podCreationTimestamp="2026-05-27 21:46:17 +0000 UTC" firstStartedPulling="2026-05-27 21:46:18.002532906 +0000 UTC m=+489.857603765" lastFinishedPulling="2026-05-27 21:46:20.395863514 +0000 UTC m=+492.250934375" observedRunningTime="2026-05-27 21:46:20.833795087 +0000 UTC m=+492.688865968" watchObservedRunningTime="2026-05-27 21:46:20.835872505 +0000 UTC m=+492.690943385" May 27 21:46:23.784444 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:23.784416 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:31.818525 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:31.818494 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-lpjw6" May 27 21:46:33.637598 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.637567 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv"] May 27 21:46:33.641234 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.641217 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.643572 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.643553 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z9phv\"" May 27 21:46:33.657403 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.657381 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv"] May 27 21:46:33.716707 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.716671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.716867 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.716781 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkpcz\" (UniqueName: \"kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.817523 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.817490 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkpcz\" (UniqueName: \"kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.817684 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.817605 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.818015 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.817996 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.827576 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.827547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkpcz\" (UniqueName: \"kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:33.951592 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:33.951559 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:34.101343 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:34.101313 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv"] May 27 21:46:34.104784 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:34.104753 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5013f6f_e204_4ecd_9c6a_befde4f510ea.slice/crio-cd79a09ff071ddc9a691924219fded102d8c7f888d421b3c28f55537e0a046a9 WatchSource:0}: Error finding container cd79a09ff071ddc9a691924219fded102d8c7f888d421b3c28f55537e0a046a9: Status 404 returned error can't find the container with id cd79a09ff071ddc9a691924219fded102d8c7f888d421b3c28f55537e0a046a9 May 27 21:46:34.859561 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:34.859479 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59cd5574ff-rgh4r" podUID="faa3509f-3143-4786-b728-3c5cf1354fb3" containerName="console" containerID="cri-o://c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30" gracePeriod=15 May 27 21:46:34.876234 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:34.876194 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" event={"ID":"f5013f6f-e204-4ecd-9c6a-befde4f510ea","Type":"ContainerStarted","Data":"cd79a09ff071ddc9a691924219fded102d8c7f888d421b3c28f55537e0a046a9"} May 27 21:46:35.079678 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.079643 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv"] May 27 21:46:35.089712 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.089497 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv"] May 27 21:46:35.116922 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.114711 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:46:35.119945 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.119917 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb"] May 27 21:46:35.120212 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.120183 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" containerName="manager" containerID="cri-o://d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5" gracePeriod=2 May 27 21:46:35.120326 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.120191 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.121742 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.121554 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb"] May 27 21:46:35.123969 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.123824 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.131597 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.131574 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:46:35.146326 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.146299 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q"] May 27 21:46:35.147109 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.147091 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" containerName="manager" May 27 21:46:35.147238 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.147225 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" containerName="manager" May 27 21:46:35.147669 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.147654 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" containerName="manager" May 27 21:46:35.150587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.150550 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.151942 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.151925 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.153783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.153752 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.164706 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.164677 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q"] May 27 21:46:35.233772 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.233729 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.233931 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.233786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghx6r\" (UniqueName: \"kubernetes.io/projected/192c3091-6231-4c0a-b187-d60936e26036-kube-api-access-ghx6r\") pod \"limitador-operator-controller-manager-85c4996f8c-6lh7q\" (UID: \"192c3091-6231-4c0a-b187-d60936e26036\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.233931 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.233818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfct9\" (UniqueName: \"kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.254709 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.254684 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59cd5574ff-rgh4r_faa3509f-3143-4786-b728-3c5cf1354fb3/console/0.log" May 27 21:46:35.254865 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.254764 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:46:35.285308 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.285141 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.335226 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335190 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45ks8\" (UniqueName: \"kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335226 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335237 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335465 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335264 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335465 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335298 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335465 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335333 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335465 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335357 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335465 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335434 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert\") pod \"faa3509f-3143-4786-b728-3c5cf1354fb3\" (UID: \"faa3509f-3143-4786-b728-3c5cf1354fb3\") " May 27 21:46:35.335725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335578 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.335725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335612 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghx6r\" (UniqueName: \"kubernetes.io/projected/192c3091-6231-4c0a-b187-d60936e26036-kube-api-access-ghx6r\") pod \"limitador-operator-controller-manager-85c4996f8c-6lh7q\" (UID: \"192c3091-6231-4c0a-b187-d60936e26036\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.335725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335631 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfct9\" (UniqueName: \"kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.335725 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335676 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:46:35.335984 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.335833 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.336433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.336054 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config" (OuterVolumeSpecName: "console-config") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:46:35.336433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.336393 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:46:35.336433 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.336417 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:46:35.336641 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.336600 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.338065 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.338037 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8" (OuterVolumeSpecName: "kube-api-access-45ks8") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "kube-api-access-45ks8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:46:35.338166 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.338066 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:46:35.339755 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.339723 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "faa3509f-3143-4786-b728-3c5cf1354fb3" (UID: "faa3509f-3143-4786-b728-3c5cf1354fb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:46:35.345355 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.345330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfct9\" (UniqueName: \"kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.345355 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.345345 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghx6r\" (UniqueName: \"kubernetes.io/projected/192c3091-6231-4c0a-b187-d60936e26036-kube-api-access-ghx6r\") pod \"limitador-operator-controller-manager-85c4996f8c-6lh7q\" (UID: \"192c3091-6231-4c0a-b187-d60936e26036\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.372249 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.372187 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:35.374120 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.374095 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.436762 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.436732 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjsqj\" (UniqueName: \"kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj\") pod \"ae50f5e2-8414-4765-bb2c-1297818bcbfb\" (UID: \"ae50f5e2-8414-4765-bb2c-1297818bcbfb\") " May 27 21:46:35.437143 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437115 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45ks8\" (UniqueName: \"kubernetes.io/projected/faa3509f-3143-4786-b728-3c5cf1354fb3-kube-api-access-45ks8\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.437143 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437140 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.437340 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437149 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.437340 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437161 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.437340 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437169 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faa3509f-3143-4786-b728-3c5cf1354fb3-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.437340 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.437178 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faa3509f-3143-4786-b728-3c5cf1354fb3-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.439098 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.439073 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj" (OuterVolumeSpecName: "kube-api-access-pjsqj") pod "ae50f5e2-8414-4765-bb2c-1297818bcbfb" (UID: "ae50f5e2-8414-4765-bb2c-1297818bcbfb"). InnerVolumeSpecName "kube-api-access-pjsqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:46:35.494205 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.494168 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:35.512037 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.512006 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.538838 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.538805 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjsqj\" (UniqueName: \"kubernetes.io/projected/ae50f5e2-8414-4765-bb2c-1297818bcbfb-kube-api-access-pjsqj\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:35.658836 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.658696 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:46:35.662778 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:35.662727 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67c64f6_b606_469b_9192_c9dc7ba33b82.slice/crio-2f624b25b7871108092faf9a50dcf9a119ea10c4964a0a289cfcea30c4e90466 WatchSource:0}: Error finding container 2f624b25b7871108092faf9a50dcf9a119ea10c4964a0a289cfcea30c4e90466: Status 404 returned error can't find the container with id 2f624b25b7871108092faf9a50dcf9a119ea10c4964a0a289cfcea30c4e90466 May 27 21:46:35.692810 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.692783 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q"] May 27 21:46:35.692958 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:35.692829 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192c3091_6231_4c0a_b187_d60936e26036.slice/crio-4bf4a0d956cd54dc2d96d5251a4fa5282f2bdd67b0079b0f006bc319eefbcfdc WatchSource:0}: Error finding container 4bf4a0d956cd54dc2d96d5251a4fa5282f2bdd67b0079b0f006bc319eefbcfdc: Status 404 returned error can't find the container with id 4bf4a0d956cd54dc2d96d5251a4fa5282f2bdd67b0079b0f006bc319eefbcfdc May 27 21:46:35.883603 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.883561 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" event={"ID":"192c3091-6231-4c0a-b187-d60936e26036","Type":"ContainerStarted","Data":"468d7f79036e8153e67b6ad7bc8d8602173f2ebe9555d9450f154fa3f5581ca7"} May 27 21:46:35.884054 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.883611 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" event={"ID":"192c3091-6231-4c0a-b187-d60936e26036","Type":"ContainerStarted","Data":"4bf4a0d956cd54dc2d96d5251a4fa5282f2bdd67b0079b0f006bc319eefbcfdc"} May 27 21:46:35.884054 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.883715 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:35.885086 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885065 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59cd5574ff-rgh4r_faa3509f-3143-4786-b728-3c5cf1354fb3/console/0.log" May 27 21:46:35.885228 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885105 2555 generic.go:358] "Generic (PLEG): container finished" podID="faa3509f-3143-4786-b728-3c5cf1354fb3" containerID="c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30" exitCode=2 May 27 21:46:35.885295 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885237 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd5574ff-rgh4r" May 27 21:46:35.885377 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885350 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd5574ff-rgh4r" event={"ID":"faa3509f-3143-4786-b728-3c5cf1354fb3","Type":"ContainerDied","Data":"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30"} May 27 21:46:35.885443 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885395 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd5574ff-rgh4r" event={"ID":"faa3509f-3143-4786-b728-3c5cf1354fb3","Type":"ContainerDied","Data":"a1fa41c23a4523f25de804cd1cd5deb872f163e3ecc10826dcc07c35d0513e81"} May 27 21:46:35.885443 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.885418 2555 scope.go:117] "RemoveContainer" containerID="c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30" May 27 21:46:35.886798 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.886599 2555 generic.go:358] "Generic (PLEG): container finished" podID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" containerID="d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5" exitCode=0 May 27 21:46:35.886798 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.886656 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" May 27 21:46:35.888517 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.888491 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" event={"ID":"d67c64f6-b606-469b-9192-c9dc7ba33b82","Type":"ContainerStarted","Data":"2f624b25b7871108092faf9a50dcf9a119ea10c4964a0a289cfcea30c4e90466"} May 27 21:46:35.898013 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.897990 2555 scope.go:117] "RemoveContainer" containerID="c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30" May 27 21:46:35.898635 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:46:35.898510 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30\": container with ID starting with c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30 not found: ID does not exist" containerID="c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30" May 27 21:46:35.898635 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.898544 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30"} err="failed to get container status \"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30\": rpc error: code = NotFound desc = could not find container \"c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30\": container with ID starting with c7576b658a8c901b946dc7e0eb2657080a55f316c12d31d93030c1f22a2fce30 not found: ID does not exist" May 27 21:46:35.898635 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.898567 2555 scope.go:117] "RemoveContainer" containerID="d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5" May 27 21:46:35.908689 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.908638 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.908880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.908864 2555 scope.go:117] "RemoveContainer" containerID="d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5" May 27 21:46:35.909145 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:46:35.909115 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5\": container with ID starting with d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5 not found: ID does not exist" containerID="d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5" May 27 21:46:35.909185 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.909153 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5"} err="failed to get container status \"d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5\": rpc error: code = NotFound desc = could not find container \"d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5\": container with ID starting with d36b62f02cf9a2b70c66f1494b2d6085922819a57e46852bbc5a19c4b9b65ca5 not found: ID does not exist" May 27 21:46:35.909220 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.909156 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" podStartSLOduration=0.909143788 podStartE2EDuration="909.143788ms" podCreationTimestamp="2026-05-27 21:46:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:46:35.905692822 +0000 UTC m=+507.760763705" watchObservedRunningTime="2026-05-27 21:46:35.909143788 +0000 UTC m=+507.764214668" May 27 21:46:35.935680 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.935650 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:46:35.940173 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.940140 2555 status_manager.go:895] "Failed to get status for pod" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lb4cb" err="pods \"limitador-operator-controller-manager-85c4996f8c-lb4cb\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:35.944422 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:35.944392 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cd5574ff-rgh4r"] May 27 21:46:36.758237 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:36.758205 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae50f5e2-8414-4765-bb2c-1297818bcbfb" path="/var/lib/kubelet/pods/ae50f5e2-8414-4765-bb2c-1297818bcbfb/volumes" May 27 21:46:36.758606 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:36.758591 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa3509f-3143-4786-b728-3c5cf1354fb3" path="/var/lib/kubelet/pods/faa3509f-3143-4786-b728-3c5cf1354fb3/volumes" May 27 21:46:38.907408 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:38.907299 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" event={"ID":"d67c64f6-b606-469b-9192-c9dc7ba33b82","Type":"ContainerStarted","Data":"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86"} May 27 21:46:38.907408 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:38.907352 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:38.908841 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:38.908792 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" containerName="manager" containerID="cri-o://e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616" gracePeriod=2 May 27 21:46:38.936271 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:38.936226 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" podStartSLOduration=1.095002025 podStartE2EDuration="3.936211237s" podCreationTimestamp="2026-05-27 21:46:35 +0000 UTC" firstStartedPulling="2026-05-27 21:46:35.66542741 +0000 UTC m=+507.520498284" lastFinishedPulling="2026-05-27 21:46:38.506636635 +0000 UTC m=+510.361707496" observedRunningTime="2026-05-27 21:46:38.933631223 +0000 UTC m=+510.788702098" watchObservedRunningTime="2026-05-27 21:46:38.936211237 +0000 UTC m=+510.791282119" May 27 21:46:38.936902 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:38.936859 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:39.149103 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.149080 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:39.151362 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.151336 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:39.274663 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.274635 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkpcz\" (UniqueName: \"kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz\") pod \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " May 27 21:46:39.274816 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.274715 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume\") pod \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\" (UID: \"f5013f6f-e204-4ecd-9c6a-befde4f510ea\") " May 27 21:46:39.275017 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.274990 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f5013f6f-e204-4ecd-9c6a-befde4f510ea" (UID: "f5013f6f-e204-4ecd-9c6a-befde4f510ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:46:39.276789 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.276763 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz" (OuterVolumeSpecName: "kube-api-access-hkpcz") pod "f5013f6f-e204-4ecd-9c6a-befde4f510ea" (UID: "f5013f6f-e204-4ecd-9c6a-befde4f510ea"). InnerVolumeSpecName "kube-api-access-hkpcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:46:39.375836 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.375807 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5013f6f-e204-4ecd-9c6a-befde4f510ea-extensions-socket-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:39.375836 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.375834 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkpcz\" (UniqueName: \"kubernetes.io/projected/f5013f6f-e204-4ecd-9c6a-befde4f510ea-kube-api-access-hkpcz\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:46:39.914493 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.914460 2555 generic.go:358] "Generic (PLEG): container finished" podID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" containerID="e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616" exitCode=2 May 27 21:46:39.914959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.914514 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" May 27 21:46:39.914959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.914554 2555 scope.go:117] "RemoveContainer" containerID="e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616" May 27 21:46:39.916393 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.916370 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:39.924163 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.924130 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-ms5cv\" is forbidden: User \"system:node:ip-10-0-140-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-70.ec2.internal' and this object" May 27 21:46:39.924616 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.924601 2555 scope.go:117] "RemoveContainer" containerID="e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616" May 27 21:46:39.924883 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:46:39.924865 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616\": container with ID starting with e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616 not found: ID does not exist" containerID="e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616" May 27 21:46:39.924974 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:39.924922 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616"} err="failed to get container status \"e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616\": rpc error: code = NotFound desc = could not find container \"e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616\": container with ID starting with e5ba914c6c076ded49e6d529f6a719b55140b95ad8f1502998d8853d92c75616 not found: ID does not exist" May 27 21:46:40.757932 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:40.757875 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" path="/var/lib/kubelet/pods/f5013f6f-e204-4ecd-9c6a-befde4f510ea/volumes" May 27 21:46:46.897604 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:46.897570 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6lh7q" May 27 21:46:49.917365 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:49.917333 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:46:50.231088 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231060 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb"] May 27 21:46:50.231498 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231485 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" containerName="manager" May 27 21:46:50.231555 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231501 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" containerName="manager" May 27 21:46:50.231555 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231519 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa3509f-3143-4786-b728-3c5cf1354fb3" containerName="console" May 27 21:46:50.231555 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231525 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa3509f-3143-4786-b728-3c5cf1354fb3" containerName="console" May 27 21:46:50.231665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231584 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="faa3509f-3143-4786-b728-3c5cf1354fb3" containerName="console" May 27 21:46:50.231665 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.231593 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5013f6f-e204-4ecd-9c6a-befde4f510ea" containerName="manager" May 27 21:46:50.236091 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.236076 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.255028 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.254995 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb"] May 27 21:46:50.369880 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.369842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14047c34-6141-4064-bc70-4d687e46d63f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.370070 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.369965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kmh\" (UniqueName: \"kubernetes.io/projected/14047c34-6141-4064-bc70-4d687e46d63f-kube-api-access-x5kmh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.470855 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.470766 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14047c34-6141-4064-bc70-4d687e46d63f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.471043 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.470857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kmh\" (UniqueName: \"kubernetes.io/projected/14047c34-6141-4064-bc70-4d687e46d63f-kube-api-access-x5kmh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.471188 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.471166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14047c34-6141-4064-bc70-4d687e46d63f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.491155 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.491119 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kmh\" (UniqueName: \"kubernetes.io/projected/14047c34-6141-4064-bc70-4d687e46d63f-kube-api-access-x5kmh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7c4qb\" (UID: \"14047c34-6141-4064-bc70-4d687e46d63f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.546679 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.546648 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.691213 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.691188 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb"] May 27 21:46:50.693625 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:46:50.693595 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14047c34_6141_4064_bc70_4d687e46d63f.slice/crio-f5e075f14bf6f89a2daa0777eddd77d27484ee46d752d4abc0a8a7c123e3ab52 WatchSource:0}: Error finding container f5e075f14bf6f89a2daa0777eddd77d27484ee46d752d4abc0a8a7c123e3ab52: Status 404 returned error can't find the container with id f5e075f14bf6f89a2daa0777eddd77d27484ee46d752d4abc0a8a7c123e3ab52 May 27 21:46:50.963959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.963920 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" event={"ID":"14047c34-6141-4064-bc70-4d687e46d63f","Type":"ContainerStarted","Data":"13d6d9b3ec55e79ce87288ac8c2467cd4adf3b1c0e8331ec7f84b85ddcbc36f1"} May 27 21:46:50.963959 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.963962 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" event={"ID":"14047c34-6141-4064-bc70-4d687e46d63f","Type":"ContainerStarted","Data":"f5e075f14bf6f89a2daa0777eddd77d27484ee46d752d4abc0a8a7c123e3ab52"} May 27 21:46:50.964347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.964036 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:46:50.992404 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:46:50.992290 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" podStartSLOduration=0.992276669 podStartE2EDuration="992.276669ms" podCreationTimestamp="2026-05-27 21:46:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:46:50.99075517 +0000 UTC m=+522.845826052" watchObservedRunningTime="2026-05-27 21:46:50.992276669 +0000 UTC m=+522.847347547" May 27 21:47:01.970087 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:01.970010 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7c4qb" May 27 21:47:02.046813 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.046781 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:47:02.047052 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.047031 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" podUID="d67c64f6-b606-469b-9192-c9dc7ba33b82" containerName="manager" containerID="cri-o://78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86" gracePeriod=10 May 27 21:47:02.300960 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.300934 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:47:02.368295 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.368268 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfct9\" (UniqueName: \"kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9\") pod \"d67c64f6-b606-469b-9192-c9dc7ba33b82\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " May 27 21:47:02.368468 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.368318 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume\") pod \"d67c64f6-b606-469b-9192-c9dc7ba33b82\" (UID: \"d67c64f6-b606-469b-9192-c9dc7ba33b82\") " May 27 21:47:02.369039 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.369010 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d67c64f6-b606-469b-9192-c9dc7ba33b82" (UID: "d67c64f6-b606-469b-9192-c9dc7ba33b82"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:47:02.370508 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.370476 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9" (OuterVolumeSpecName: "kube-api-access-qfct9") pod "d67c64f6-b606-469b-9192-c9dc7ba33b82" (UID: "d67c64f6-b606-469b-9192-c9dc7ba33b82"). InnerVolumeSpecName "kube-api-access-qfct9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:47:02.469926 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.469878 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfct9\" (UniqueName: \"kubernetes.io/projected/d67c64f6-b606-469b-9192-c9dc7ba33b82-kube-api-access-qfct9\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:47:02.469926 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:02.469921 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d67c64f6-b606-469b-9192-c9dc7ba33b82-extensions-socket-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\"" May 27 21:47:03.014160 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.014126 2555 generic.go:358] "Generic (PLEG): container finished" podID="d67c64f6-b606-469b-9192-c9dc7ba33b82" containerID="78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86" exitCode=0 May 27 21:47:03.014628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.014196 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" event={"ID":"d67c64f6-b606-469b-9192-c9dc7ba33b82","Type":"ContainerDied","Data":"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86"} May 27 21:47:03.014628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.014214 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" May 27 21:47:03.014628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.014262 2555 scope.go:117] "RemoveContainer" containerID="78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86" May 27 21:47:03.014628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.014247 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs" event={"ID":"d67c64f6-b606-469b-9192-c9dc7ba33b82","Type":"ContainerDied","Data":"2f624b25b7871108092faf9a50dcf9a119ea10c4964a0a289cfcea30c4e90466"} May 27 21:47:03.023916 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.023865 2555 scope.go:117] "RemoveContainer" containerID="78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86" May 27 21:47:03.024164 ip-10-0-140-70 kubenswrapper[2555]: E0527 21:47:03.024146 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86\": container with ID starting with 78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86 not found: ID does not exist" containerID="78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86" May 27 21:47:03.024220 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.024176 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86"} err="failed to get container status \"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86\": rpc error: code = NotFound desc = could not find container \"78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86\": container with ID starting with 78df93223369bebc2e4e7c5131006e8b287138f5e86c7a3d54147a6d77c55d86 not found: ID does not exist" May 27 21:47:03.042172 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.042147 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:47:03.044692 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:03.044672 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gw7gs"] May 27 21:47:04.758030 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:04.758000 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67c64f6-b606-469b-9192-c9dc7ba33b82" path="/var/lib/kubelet/pods/d67c64f6-b606-469b-9192-c9dc7ba33b82/volumes" May 27 21:47:22.073634 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.073596 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:47:22.074133 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.074070 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67c64f6-b606-469b-9192-c9dc7ba33b82" containerName="manager" May 27 21:47:22.074133 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.074084 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67c64f6-b606-469b-9192-c9dc7ba33b82" containerName="manager" May 27 21:47:22.074211 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.074155 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d67c64f6-b606-469b-9192-c9dc7ba33b82" containerName="manager" May 27 21:47:22.079497 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.079478 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.081621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.081599 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 21:47:22.081743 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.081608 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btx95\"" May 27 21:47:22.086010 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.085988 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:47:22.112996 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.112971 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:47:22.135662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.135635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jnq\" (UniqueName: \"kubernetes.io/projected/c9213177-b41a-4965-b615-c24a2f841c08-kube-api-access-f2jnq\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.135783 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.135755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9213177-b41a-4965-b615-c24a2f841c08-config-file\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.236759 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.236730 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9213177-b41a-4965-b615-c24a2f841c08-config-file\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.236885 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.236774 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jnq\" (UniqueName: \"kubernetes.io/projected/c9213177-b41a-4965-b615-c24a2f841c08-kube-api-access-f2jnq\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.237325 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.237305 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9213177-b41a-4965-b615-c24a2f841c08-config-file\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.246366 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.246341 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jnq\" (UniqueName: \"kubernetes.io/projected/c9213177-b41a-4965-b615-c24a2f841c08-kube-api-access-f2jnq\") pod \"limitador-limitador-78c99df468-kn99d\" (UID: \"c9213177-b41a-4965-b615-c24a2f841c08\") " pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.392165 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.392088 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:22.529323 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:22.529289 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:47:22.530564 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:47:22.530539 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9213177_b41a_4965_b615_c24a2f841c08.slice/crio-77441157ee93e6f193d0296ffa84eecc915bd5898b482908ff2f6a0ca44b3b4c WatchSource:0}: Error finding container 77441157ee93e6f193d0296ffa84eecc915bd5898b482908ff2f6a0ca44b3b4c: Status 404 returned error can't find the container with id 77441157ee93e6f193d0296ffa84eecc915bd5898b482908ff2f6a0ca44b3b4c May 27 21:47:23.099832 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:23.099792 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" event={"ID":"c9213177-b41a-4965-b615-c24a2f841c08","Type":"ContainerStarted","Data":"77441157ee93e6f193d0296ffa84eecc915bd5898b482908ff2f6a0ca44b3b4c"} May 27 21:47:26.114621 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:26.114581 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" event={"ID":"c9213177-b41a-4965-b615-c24a2f841c08","Type":"ContainerStarted","Data":"6508000560a558272ee772888966d7596ae241c2d933bf6726882db6bc17f464"} May 27 21:47:26.115014 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:26.114651 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:47:26.134337 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:26.134285 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" podStartSLOduration=1.5320984869999998 podStartE2EDuration="4.134272833s" podCreationTimestamp="2026-05-27 21:47:22 +0000 UTC" firstStartedPulling="2026-05-27 21:47:22.532270195 +0000 UTC m=+554.387341057" lastFinishedPulling="2026-05-27 21:47:25.134444542 +0000 UTC m=+556.989515403" observedRunningTime="2026-05-27 21:47:26.131417992 +0000 UTC m=+557.986488872" watchObservedRunningTime="2026-05-27 21:47:26.134272833 +0000 UTC m=+557.989343716" May 27 21:47:37.120236 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:47:37.120207 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-kn99d" May 27 21:48:08.703407 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:48:08.703378 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:48:08.703936 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:48:08.703381 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:48:08.711145 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:48:08.711116 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:48:08.711266 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:48:08.711231 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7fvn_07a02c27-6211-4b29-a358-6a6ecf9150f6/ovn-acl-logging/0.log" May 27 21:48:34.913648 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:48:34.913565 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:02.523526 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:02.523493 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:04.076293 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:04.076260 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:14.262533 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:14.262498 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:27.061575 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:27.061541 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:51.769097 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:51.769066 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:49:59.458539 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:49:59.458455 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-kn99d"] May 27 21:51:46.098759 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:46.098681 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-pfd4d_0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0/manager/0.log" May 27 21:51:46.458569 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:46.458543 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rfvj8_a26a1b96-b53f-4cf0-816a-91a0f669050e/manager/2.log" May 27 21:51:46.838750 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:46.838656 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw_5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5/manager/0.log" May 27 21:51:47.758485 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.758459 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/util/0.log" May 27 21:51:47.770225 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.770205 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/pull/0.log" May 27 21:51:47.779942 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.779922 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/extract/0.log" May 27 21:51:47.893619 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.893594 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/util/0.log" May 27 21:51:47.900663 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.900644 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/pull/0.log" May 27 21:51:47.907738 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:47.907713 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/extract/0.log" May 27 21:51:48.025615 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.025554 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/extract/0.log" May 27 21:51:48.033581 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.033561 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/util/0.log" May 27 21:51:48.043211 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.043192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/pull/0.log" May 27 21:51:48.154003 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.153980 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/util/0.log" May 27 21:51:48.160732 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.160715 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/pull/0.log" May 27 21:51:48.167652 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.167634 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/extract/0.log" May 27 21:51:48.522655 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.522620 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-lpjw6_cf5357e9-b108-487f-aaec-ee4f27878346/manager/0.log" May 27 21:51:48.886996 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:48.886911 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7c4qb_14047c34-6141-4064-bc70-4d687e46d63f/manager/0.log" May 27 21:51:49.002218 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:49.002187 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-kn99d_c9213177-b41a-4965-b615-c24a2f841c08/limitador/0.log" May 27 21:51:49.114197 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:49.114170 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6lh7q_192c3091-6231-4c0a-b187-d60936e26036/manager/0.log" May 27 21:51:49.574817 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:49.574778 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lw59x_bd7c3727-b031-4d35-90ea-f9eeb76c0e3b/discovery/0.log" May 27 21:51:49.688104 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:49.688074 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ffdb65d85-49z6z_f1f77b95-e958-4ff1-b69f-0b40bb97886e/kube-auth-proxy/0.log" May 27 21:51:50.147662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:50.147634 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7586c8f6db-w2mxm_c9fba3ab-1440-4a8b-b779-73ad3617c6c7/router/0.log" May 27 21:51:55.078820 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.078783 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4k6x8/must-gather-lzhv2"] May 27 21:51:55.082501 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.082482 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.084566 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.084539 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4k6x8\"/\"kube-root-ca.crt\"" May 27 21:51:55.084685 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.084614 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4k6x8\"/\"openshift-service-ca.crt\"" May 27 21:51:55.084741 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.084617 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4k6x8\"/\"default-dockercfg-d2xxg\"" May 27 21:51:55.093405 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.093380 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/must-gather-lzhv2"] May 27 21:51:55.167622 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.167587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c0c7f17-123c-4759-96ea-cd3373679e3a-must-gather-output\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.167753 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.167705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjps\" (UniqueName: \"kubernetes.io/projected/5c0c7f17-123c-4759-96ea-cd3373679e3a-kube-api-access-5hjps\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.268919 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.268859 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjps\" (UniqueName: \"kubernetes.io/projected/5c0c7f17-123c-4759-96ea-cd3373679e3a-kube-api-access-5hjps\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.269070 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.268963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c0c7f17-123c-4759-96ea-cd3373679e3a-must-gather-output\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.269293 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.269274 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c0c7f17-123c-4759-96ea-cd3373679e3a-must-gather-output\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.287463 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.287441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjps\" (UniqueName: \"kubernetes.io/projected/5c0c7f17-123c-4759-96ea-cd3373679e3a-kube-api-access-5hjps\") pod \"must-gather-lzhv2\" (UID: \"5c0c7f17-123c-4759-96ea-cd3373679e3a\") " pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.393308 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.393253 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" May 27 21:51:55.530749 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.530724 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/must-gather-lzhv2"] May 27 21:51:55.532020 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:51:55.531986 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c0c7f17_123c_4759_96ea_cd3373679e3a.slice/crio-48c142007c1ceba4f065a9d1a9f9b52c9f46b0b5869698d907ad813fcea117f4 WatchSource:0}: Error finding container 48c142007c1ceba4f065a9d1a9f9b52c9f46b0b5869698d907ad813fcea117f4: Status 404 returned error can't find the container with id 48c142007c1ceba4f065a9d1a9f9b52c9f46b0b5869698d907ad813fcea117f4 May 27 21:51:55.533703 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:55.533686 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:51:56.238808 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:56.238771 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" event={"ID":"5c0c7f17-123c-4759-96ea-cd3373679e3a","Type":"ContainerStarted","Data":"48c142007c1ceba4f065a9d1a9f9b52c9f46b0b5869698d907ad813fcea117f4"} May 27 21:51:57.245997 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:57.245957 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" event={"ID":"5c0c7f17-123c-4759-96ea-cd3373679e3a","Type":"ContainerStarted","Data":"6b692e55c62ad6fa2e9458eb970013bb10e6b256c084d1d2d3b2890c9a808cea"} May 27 21:51:57.246381 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:57.246014 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" event={"ID":"5c0c7f17-123c-4759-96ea-cd3373679e3a","Type":"ContainerStarted","Data":"4b6262d7a4174546c9f1e3b7702bd556b9522d6d4f679c8273a369e97c3dd39f"} May 27 21:51:57.262799 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:57.262733 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4k6x8/must-gather-lzhv2" podStartSLOduration=1.548675053 podStartE2EDuration="2.262715881s" podCreationTimestamp="2026-05-27 21:51:55 +0000 UTC" firstStartedPulling="2026-05-27 21:51:55.533811595 +0000 UTC m=+827.388882453" lastFinishedPulling="2026-05-27 21:51:56.247852406 +0000 UTC m=+828.102923281" observedRunningTime="2026-05-27 21:51:57.261669676 +0000 UTC m=+829.116740558" watchObservedRunningTime="2026-05-27 21:51:57.262715881 +0000 UTC m=+829.117786763" May 27 21:51:58.104649 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:58.104616 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gwgnw_5f6ddb62-9360-49e6-a006-bb42108963e1/global-pull-secret-syncer/0.log" May 27 21:51:58.237330 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:58.237297 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kkwqp_e3127c91-bc61-488f-9396-e68f583a06dc/konnectivity-agent/0.log" May 27 21:51:58.348492 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:51:58.348453 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-70.ec2.internal_03aa378766e5aa14d378fa47bd1c4273/haproxy/0.log" May 27 21:52:01.896316 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:01.896273 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/extract/0.log" May 27 21:52:01.923472 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:01.923391 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/util/0.log" May 27 21:52:01.951837 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:01.951687 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbb8k_b9e1f06c-8b12-4a18-b7f5-82e96ba41c3a/pull/0.log" May 27 21:52:01.983521 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:01.983492 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/extract/0.log" May 27 21:52:02.010925 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.010881 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/util/0.log" May 27 21:52:02.049328 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.049176 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02wrtl_6ab26de4-6c1a-4cb1-a7aa-5734eb459a31/pull/0.log" May 27 21:52:02.088083 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.088043 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/extract/0.log" May 27 21:52:02.115338 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.115307 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/util/0.log" May 27 21:52:02.140326 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.140282 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n2wzh_278aa1af-1fb5-483b-a8b4-24659c03b89a/pull/0.log" May 27 21:52:02.170546 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.170515 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/extract/0.log" May 27 21:52:02.198577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.198494 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/util/0.log" May 27 21:52:02.231577 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.231550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hhkb5_02c70663-2035-4612-834f-a1c277d35bda/pull/0.log" May 27 21:52:02.328038 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.327989 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-lpjw6_cf5357e9-b108-487f-aaec-ee4f27878346/manager/0.log" May 27 21:52:02.449658 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.449571 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7c4qb_14047c34-6141-4064-bc70-4d687e46d63f/manager/0.log" May 27 21:52:02.480471 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.480432 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-kn99d_c9213177-b41a-4965-b615-c24a2f841c08/limitador/0.log" May 27 21:52:02.520729 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:02.520691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6lh7q_192c3091-6231-4c0a-b187-d60936e26036/manager/0.log" May 27 21:52:03.987652 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:03.987627 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/alertmanager/0.log" May 27 21:52:04.019662 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.019620 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/config-reloader/0.log" May 27 21:52:04.054633 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.054600 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/kube-rbac-proxy-web/0.log" May 27 21:52:04.087590 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.087567 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/kube-rbac-proxy/0.log" May 27 21:52:04.128454 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.128419 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/kube-rbac-proxy-metric/0.log" May 27 21:52:04.171303 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.171272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/prom-label-proxy/0.log" May 27 21:52:04.205361 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.205251 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_382615b2-b805-4171-a47f-3dc675cc0fc3/init-config-reloader/0.log" May 27 21:52:04.252599 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.251637 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-qbmcv_c7a64ac3-dae1-4f28-8947-3953878dd78c/cluster-monitoring-operator/0.log" May 27 21:52:04.430494 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.430463 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-4qxmp_81cd9965-3190-4f8d-9466-641bbea3177a/monitoring-plugin/0.log" May 27 21:52:04.498170 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.498050 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtsvn_f9ec7979-06ac-45bb-9217-7f510c3a4466/node-exporter/0.log" May 27 21:52:04.536492 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.536465 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtsvn_f9ec7979-06ac-45bb-9217-7f510c3a4466/kube-rbac-proxy/0.log" May 27 21:52:04.566653 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.566623 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtsvn_f9ec7979-06ac-45bb-9217-7f510c3a4466/init-textfile/0.log" May 27 21:52:04.802542 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.802470 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9p87m_c8fcfb5a-2ca7-4201-9944-7f5a6788c38d/kube-rbac-proxy-main/0.log" May 27 21:52:04.855799 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.855773 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9p87m_c8fcfb5a-2ca7-4201-9944-7f5a6788c38d/kube-rbac-proxy-self/0.log" May 27 21:52:04.898530 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:04.898500 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9p87m_c8fcfb5a-2ca7-4201-9944-7f5a6788c38d/openshift-state-metrics/0.log" May 27 21:52:05.362215 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.362176 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595b8f8cd-wtjp9_061fab31-abcc-40f1-8261-4e909830c152/telemeter-client/0.log" May 27 21:52:05.390553 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.390521 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595b8f8cd-wtjp9_061fab31-abcc-40f1-8261-4e909830c152/reload/0.log" May 27 21:52:05.421016 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.420957 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595b8f8cd-wtjp9_061fab31-abcc-40f1-8261-4e909830c152/kube-rbac-proxy/0.log" May 27 21:52:05.457081 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.457003 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/thanos-query/0.log" May 27 21:52:05.489312 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.489278 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/kube-rbac-proxy-web/0.log" May 27 21:52:05.519504 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.519476 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/kube-rbac-proxy/0.log" May 27 21:52:05.545608 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.545575 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/prom-label-proxy/0.log" May 27 21:52:05.575718 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.575688 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/kube-rbac-proxy-rules/0.log" May 27 21:52:05.601034 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:05.601002 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dcb5c7694-9lc9z_da9e2bda-a969-47c0-9f11-9aa0ecc54f98/kube-rbac-proxy-metrics/0.log" May 27 21:52:06.648991 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.648955 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs"] May 27 21:52:06.660007 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.659978 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs"] May 27 21:52:06.660193 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.660116 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.679628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.677117 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-proc\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.679628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.677240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-sys\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.679628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.677407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-podres\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.679628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.677444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtq5\" (UniqueName: \"kubernetes.io/projected/c4c274cd-523a-4598-887b-13694fc25a30-kube-api-access-6gtq5\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.679628 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.677532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-lib-modules\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.756383 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.756349 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-j2nsz_01aa57a0-f6b0-44a7-b90a-2c631372b819/networking-console-plugin/0.log" May 27 21:52:06.778177 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778139 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-lib-modules\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778210 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-proc\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778252 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-sys\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-lib-modules\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778347 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778304 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-proc\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778525 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778345 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-sys\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778525 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778424 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-podres\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778525 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778454 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtq5\" (UniqueName: \"kubernetes.io/projected/c4c274cd-523a-4598-887b-13694fc25a30-kube-api-access-6gtq5\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.778646 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.778577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4c274cd-523a-4598-887b-13694fc25a30-podres\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.788481 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.788452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtq5\" (UniqueName: \"kubernetes.io/projected/c4c274cd-523a-4598-887b-13694fc25a30-kube-api-access-6gtq5\") pod \"perf-node-gather-daemonset-hffgs\" (UID: \"c4c274cd-523a-4598-887b-13694fc25a30\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:06.983595 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:06.983559 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:07.174466 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.174434 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs"] May 27 21:52:07.179583 ip-10-0-140-70 kubenswrapper[2555]: W0527 21:52:07.179447 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc4c274cd_523a_4598_887b_13694fc25a30.slice/crio-a04d69ed622014bec1a4a6e81aa42e9401927914aee03b1ba26b23a399a12178 WatchSource:0}: Error finding container a04d69ed622014bec1a4a6e81aa42e9401927914aee03b1ba26b23a399a12178: Status 404 returned error can't find the container with id a04d69ed622014bec1a4a6e81aa42e9401927914aee03b1ba26b23a399a12178 May 27 21:52:07.312549 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.312512 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" event={"ID":"c4c274cd-523a-4598-887b-13694fc25a30","Type":"ContainerStarted","Data":"8c5ba0bea493ffc5f7d23545262d41038393a93062dd1a757e459b0f71d6a3db"} May 27 21:52:07.312688 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.312570 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" event={"ID":"c4c274cd-523a-4598-887b-13694fc25a30","Type":"ContainerStarted","Data":"a04d69ed622014bec1a4a6e81aa42e9401927914aee03b1ba26b23a399a12178"} May 27 21:52:07.312688 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.312589 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:07.330521 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.330470 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" podStartSLOduration=1.330451825 podStartE2EDuration="1.330451825s" podCreationTimestamp="2026-05-27 21:52:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:52:07.328013475 +0000 UTC m=+839.183084369" watchObservedRunningTime="2026-05-27 21:52:07.330451825 +0000 UTC m=+839.185522707" May 27 21:52:07.415719 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.415691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/2.log" May 27 21:52:07.421701 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.421668 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vdrrs_28e6fc5b-7fc9-47fa-b373-000f1d19a782/console-operator/3.log" May 27 21:52:07.930262 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:07.930235 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-686db78d7b-v587m_096b4f70-729c-44d3-8fca-329b206d77a2/console/0.log" May 27 21:52:08.471992 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:08.471967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-p72q4_828b8b30-3e19-4cf3-9553-a5503c367f84/volume-data-source-validator/0.log" May 27 21:52:09.409512 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:09.409482 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75zhw_18426b1e-b883-41fe-be53-64a05743a2b6/dns/0.log" May 27 21:52:09.433302 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:09.433271 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75zhw_18426b1e-b883-41fe-be53-64a05743a2b6/kube-rbac-proxy/0.log" May 27 21:52:09.583664 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:09.583628 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8fkdc_7356e278-b295-4dab-a59b-156c0e47aaeb/dns-node-resolver/0.log" May 27 21:52:10.196722 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:10.196692 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qf9h_3b682f0e-f601-41c4-a7d0-084017d6842c/node-ca/0.log" May 27 21:52:11.357657 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:11.357627 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lw59x_bd7c3727-b031-4d35-90ea-f9eeb76c0e3b/discovery/0.log" May 27 21:52:11.382107 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:11.382085 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ffdb65d85-49z6z_f1f77b95-e958-4ff1-b69f-0b40bb97886e/kube-auth-proxy/0.log" May 27 21:52:11.505801 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:11.505774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7586c8f6db-w2mxm_c9fba3ab-1440-4a8b-b779-73ad3617c6c7/router/0.log" May 27 21:52:12.164187 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.164158 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k688w_d9cbb529-7b64-41ee-b006-c085869a4edd/serve-healthcheck-canary/0.log" May 27 21:52:12.662408 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.662337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-8kjtr_9d07ff76-0915-4b2b-a125-211d834818fa/insights-operator/1.log" May 27 21:52:12.662831 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.662813 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-8kjtr_9d07ff76-0915-4b2b-a125-211d834818fa/insights-operator/0.log" May 27 21:52:12.689589 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.689560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59nj7_ca6126a3-2842-4a7f-9a54-da9fac08d0ca/kube-rbac-proxy/0.log" May 27 21:52:12.716368 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.716341 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59nj7_ca6126a3-2842-4a7f-9a54-da9fac08d0ca/exporter/0.log" May 27 21:52:12.741376 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:12.741358 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59nj7_ca6126a3-2842-4a7f-9a54-da9fac08d0ca/extractor/0.log" May 27 21:52:13.331543 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:13.331515 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-hffgs" May 27 21:52:14.972737 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:14.972707 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-pfd4d_0d18b7cc-2dda-4f1a-9af1-ea72e2d358d0/manager/0.log" May 27 21:52:15.055587 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:15.055536 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rfvj8_a26a1b96-b53f-4cf0-816a-91a0f669050e/manager/1.log" May 27 21:52:15.071442 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:15.071413 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rfvj8_a26a1b96-b53f-4cf0-816a-91a0f669050e/manager/2.log" May 27 21:52:15.165950 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:15.165924 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9fcc6c-zpxjw_5c30ae91-c8ff-4c80-99ea-5f39a21ac5b5/manager/0.log" May 27 21:52:21.748588 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:21.748552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-9fdnl_4012efd7-2087-41c7-80b7-f9aa8d76273d/kube-storage-version-migrator-operator/1.log" May 27 21:52:21.749603 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:21.749584 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-9fdnl_4012efd7-2087-41c7-80b7-f9aa8d76273d/kube-storage-version-migrator-operator/0.log" May 27 21:52:23.247514 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.247484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/kube-multus-additional-cni-plugins/0.log" May 27 21:52:23.279472 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.279443 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/egress-router-binary-copy/0.log" May 27 21:52:23.320609 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.320536 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/cni-plugins/0.log" May 27 21:52:23.353801 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.353780 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/bond-cni-plugin/0.log" May 27 21:52:23.383537 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.383510 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/routeoverride-cni/0.log" May 27 21:52:23.408848 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.408818 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/whereabouts-cni-bincopy/0.log" May 27 21:52:23.435020 ip-10-0-140-70 kubenswrapper[2555]: I0527 21:52:23.434984 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h86vc_7ba72d86-930d-4230-a503-2e33a9c98cf2/whereabouts-cni/0.log"