May 28 15:59:53.588714 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 15:59:53.588842 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 15:59:53.588939 ip-10-0-136-8 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 15:59:53.589361 ip-10-0-136-8 systemd[1]: Failed to start Kubernetes Kubelet. May 28 16:00:02.372191 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 16:00:02.372205 ip-10-0-136-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 71bee02854124aeabe4354afd99ce24e -- May 28 16:02:08.606728 ip-10-0-136-8 systemd[1]: Starting Kubernetes Kubelet... May 28 16:02:09.114260 ip-10-0-136-8 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:02:09.114260 ip-10-0-136-8 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 16:02:09.114260 ip-10-0-136-8 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:02:09.114260 ip-10-0-136-8 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 16:02:09.114260 ip-10-0-136-8 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:02:09.117644 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.117553 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125008 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125026 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125030 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125033 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125036 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:02:09.125032 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125039 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125042 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125045 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125048 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125051 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125053 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125056 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125059 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125061 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125064 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125066 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125069 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125072 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125074 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125077 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125081 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125084 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125087 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125090 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125092 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:02:09.125253 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125095 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125098 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125100 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125103 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125106 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125108 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125111 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125114 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125116 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125119 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125122 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125124 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125128 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125133 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125137 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125141 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125144 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125147 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125151 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:02:09.125776 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125154 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125156 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125159 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125161 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125164 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125167 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125169 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125172 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125174 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125177 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125179 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125182 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125184 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125188 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125192 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125195 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125197 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125200 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125202 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:02:09.126269 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125205 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125208 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125210 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125213 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125215 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125218 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125220 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125223 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125227 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125230 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125240 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125243 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125245 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125248 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125253 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125257 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125260 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125263 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125265 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125268 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:02:09.126747 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125270 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125273 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125276 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125679 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125686 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125688 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125691 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125694 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125696 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125699 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125702 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125705 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125708 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125710 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125713 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125715 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125718 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125720 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125723 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125726 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:02:09.127233 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125729 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125732 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125735 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125738 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125741 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125743 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125746 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125749 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125751 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125756 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125760 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125763 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125766 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125768 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125771 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125775 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125778 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125781 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125784 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125787 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:02:09.127737 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125790 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125793 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125796 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125798 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125800 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125803 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125805 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125808 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125810 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125813 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125815 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125818 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125822 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125825 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125829 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125832 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125834 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125837 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125839 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125842 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:02:09.128278 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125845 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125848 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125851 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125853 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125856 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125858 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125862 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125865 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125867 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125870 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125872 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125875 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125877 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125880 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125882 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125884 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125887 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125890 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125892 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:02:09.128872 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125895 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125897 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125900 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125902 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125906 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125909 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125911 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125914 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125917 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.125919 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126704 2575 flags.go:64] FLAG: --address="0.0.0.0" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126714 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126721 2575 flags.go:64] FLAG: --anonymous-auth="true" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126726 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126731 2575 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126735 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126739 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126743 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126747 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126750 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126753 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 16:02:09.129363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126757 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126760 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126763 2575 flags.go:64] FLAG: --cgroup-root="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126767 2575 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126770 2575 flags.go:64] FLAG: --client-ca-file="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126773 2575 flags.go:64] FLAG: --cloud-config="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126776 2575 flags.go:64] FLAG: --cloud-provider="external" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126779 2575 flags.go:64] FLAG: --cluster-dns="[]" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126784 2575 flags.go:64] FLAG: --cluster-domain="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126787 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126790 2575 flags.go:64] FLAG: --config-dir="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126793 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126797 2575 flags.go:64] FLAG: --container-log-max-files="5" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126805 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126809 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126812 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126816 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126820 2575 flags.go:64] FLAG: --contention-profiling="false" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126823 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126826 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126829 2575 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126832 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126836 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126839 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126842 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 16:02:09.129875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126845 2575 flags.go:64] FLAG: --enable-load-reader="false" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126849 2575 flags.go:64] FLAG: --enable-server="true" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126852 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126857 2575 flags.go:64] FLAG: --event-burst="100" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126860 2575 flags.go:64] FLAG: --event-qps="50" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126863 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126866 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126869 2575 flags.go:64] FLAG: --eviction-hard="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126873 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126876 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126879 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126882 2575 flags.go:64] FLAG: --eviction-soft="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126884 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126887 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126893 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126895 2575 flags.go:64] FLAG: --experimental-mounter-path="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126898 2575 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126901 2575 flags.go:64] FLAG: --fail-swap-on="true" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126904 2575 flags.go:64] FLAG: --feature-gates="" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126908 2575 flags.go:64] FLAG: --file-check-frequency="20s" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126911 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126914 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126918 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126921 2575 flags.go:64] FLAG: --healthz-port="10248" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126924 2575 flags.go:64] FLAG: --help="false" May 28 16:02:09.130497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126927 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-8.ec2.internal" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126930 2575 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126934 2575 flags.go:64] FLAG: --http-check-frequency="20s" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126937 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126940 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126944 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126947 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126949 2575 flags.go:64] FLAG: --image-service-endpoint="" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126952 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126956 2575 flags.go:64] FLAG: --kube-api-burst="100" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126959 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126962 2575 flags.go:64] FLAG: --kube-api-qps="50" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126964 2575 flags.go:64] FLAG: --kube-reserved="" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126967 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126970 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126973 2575 flags.go:64] FLAG: --kubelet-cgroups="" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126976 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126979 2575 flags.go:64] FLAG: --lock-file="" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126982 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126985 2575 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126988 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126994 2575 flags.go:64] FLAG: --log-json-split-stream="false" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.126997 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127000 2575 flags.go:64] FLAG: --log-text-split-stream="false" May 28 16:02:09.131146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127002 2575 flags.go:64] FLAG: --logging-format="text" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127005 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127009 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127011 2575 flags.go:64] FLAG: --manifest-url="" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127014 2575 flags.go:64] FLAG: --manifest-url-header="" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127019 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127022 2575 flags.go:64] FLAG: --max-open-files="1000000" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127027 2575 flags.go:64] FLAG: --max-pods="110" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127030 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127033 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127036 2575 flags.go:64] FLAG: --memory-manager-policy="None" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127039 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127042 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127045 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127048 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127056 2575 flags.go:64] FLAG: --node-status-max-images="50" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127059 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127062 2575 flags.go:64] FLAG: --oom-score-adj="-999" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127066 2575 flags.go:64] FLAG: --pod-cidr="" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127069 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127075 2575 flags.go:64] FLAG: --pod-manifest-path="" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127078 2575 flags.go:64] FLAG: --pod-max-pids="-1" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127081 2575 flags.go:64] FLAG: --pods-per-core="0" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127084 2575 flags.go:64] FLAG: --port="10250" May 28 16:02:09.131742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127087 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127090 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9aa6248aa810434" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127093 2575 flags.go:64] FLAG: --qos-reserved="" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127096 2575 flags.go:64] FLAG: --read-only-port="10255" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127099 2575 flags.go:64] FLAG: --register-node="true" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127106 2575 flags.go:64] FLAG: --register-schedulable="true" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127109 2575 flags.go:64] FLAG: --register-with-taints="" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127113 2575 flags.go:64] FLAG: --registry-burst="10" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127116 2575 flags.go:64] FLAG: --registry-qps="5" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127118 2575 flags.go:64] FLAG: --reserved-cpus="" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127121 2575 flags.go:64] FLAG: --reserved-memory="" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127125 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127128 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127132 2575 flags.go:64] FLAG: --rotate-certificates="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127134 2575 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127137 2575 flags.go:64] FLAG: --runonce="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127140 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127143 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127146 2575 flags.go:64] FLAG: --seccomp-default="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127149 2575 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127152 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127155 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127158 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127161 2575 flags.go:64] FLAG: --storage-driver-password="root" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127164 2575 flags.go:64] FLAG: --storage-driver-secure="false" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127167 2575 flags.go:64] FLAG: --storage-driver-table="stats" May 28 16:02:09.132330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127170 2575 flags.go:64] FLAG: --storage-driver-user="root" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127173 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127176 2575 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127179 2575 flags.go:64] FLAG: --system-cgroups="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127182 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127187 2575 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127190 2575 flags.go:64] FLAG: --tls-cert-file="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127196 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127201 2575 flags.go:64] FLAG: --tls-min-version="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127204 2575 flags.go:64] FLAG: --tls-private-key-file="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127207 2575 flags.go:64] FLAG: --topology-manager-policy="none" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127210 2575 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127214 2575 flags.go:64] FLAG: --topology-manager-scope="container" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127217 2575 flags.go:64] FLAG: --v="2" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127221 2575 flags.go:64] FLAG: --version="false" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127226 2575 flags.go:64] FLAG: --vmodule="" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127230 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127233 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127342 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127347 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127351 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127354 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127357 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:02:09.132994 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127359 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127362 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127365 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127367 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127370 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127373 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127375 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127378 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127380 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127383 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127386 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127389 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127392 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127394 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127397 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127399 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127404 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127407 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127409 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127412 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:02:09.133582 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127415 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127417 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127420 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127423 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127425 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127428 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127430 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127433 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127435 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127438 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127442 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127445 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127449 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127452 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127455 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127458 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127461 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127464 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127467 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:02:09.134123 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127469 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127472 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127475 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127478 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127481 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127483 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127486 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127489 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127492 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127496 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127499 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127501 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127504 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127507 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127509 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127512 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127514 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127517 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127520 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127523 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:02:09.134611 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127526 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127528 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127531 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127534 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127536 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127539 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127541 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127544 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127546 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127549 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127551 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127554 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127556 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127559 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127561 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127564 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127566 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127569 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127571 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127574 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:02:09.135109 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127576 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.127580 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.127585 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.134345 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.134365 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134430 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134436 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134439 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134443 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134446 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134449 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134453 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134455 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134458 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134461 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134463 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:02:09.135624 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134466 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134469 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134471 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134474 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134476 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134479 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134482 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134485 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134488 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134491 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134494 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134496 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134499 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134502 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134504 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134507 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134510 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134512 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134515 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134517 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:02:09.136034 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134522 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134524 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134527 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134529 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134532 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134535 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134538 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134540 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134543 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134545 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134548 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134551 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134553 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134556 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134558 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134561 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134563 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134566 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134569 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134571 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:02:09.136547 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134574 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134577 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134579 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134582 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134584 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134586 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134589 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134591 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134594 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134596 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134600 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134603 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134608 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134611 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134614 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134618 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134623 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134626 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134629 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:02:09.137042 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134632 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134635 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134638 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134640 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134643 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134646 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134648 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134651 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134653 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134656 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134659 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134661 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134664 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134666 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134669 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:02:09.137579 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134672 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.134676 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134792 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134797 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134800 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134804 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134806 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134809 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134812 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134815 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134818 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134821 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134824 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134828 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134832 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:02:09.137945 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134835 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134838 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134840 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134843 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134845 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134848 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134850 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134853 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134855 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134858 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134860 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134863 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134866 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134868 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134871 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134873 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134876 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134878 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134882 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:02:09.138355 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134886 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134889 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134892 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134894 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134897 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134900 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134902 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134905 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134908 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134911 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134914 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134917 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134920 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134923 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134926 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134928 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134931 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134933 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134936 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134938 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:02:09.138823 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134941 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134944 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134946 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134949 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134951 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134954 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134956 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134959 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134961 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134964 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134967 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134969 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134972 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134975 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134977 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134980 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134982 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134985 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134987 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134990 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:02:09.139316 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134992 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134995 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.134998 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135001 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135004 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135006 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135009 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135011 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135014 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135016 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135019 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135021 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135024 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:09.135026 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.135031 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:02:09.139811 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.135948 2575 server.go:962] "Client rotation is on, will bootstrap in background" May 28 16:02:09.140178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.138913 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 16:02:09.140178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.139929 2575 server.go:1019] "Starting client certificate rotation" May 28 16:02:09.140178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.140024 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 16:02:09.140178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.140063 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 16:02:09.168664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.168641 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 16:02:09.170568 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.170550 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 16:02:09.182578 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.182551 2575 log.go:25] "Validated CRI v1 runtime API" May 28 16:02:09.188686 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.188664 2575 log.go:25] "Validated CRI v1 image API" May 28 16:02:09.191609 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.191592 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 16:02:09.195890 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.195862 2575 fs.go:135] Filesystem UUIDs: map[6822810d-1b8b-4555-90f5-c582bee39088:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8e2a55d1-f936-4e56-be9a-57f932163da8:/dev/nvme0n1p3] May 28 16:02:09.195948 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.195890 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 16:02:09.198818 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.198801 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 16:02:09.200974 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.200725 2575 manager.go:217] Machine: {Timestamp:2026-05-28 16:02:09.200143501 +0000 UTC m=+0.451058348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114216 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24410f48ab5411bb0a4aa825087846 SystemUUID:ec24410f-48ab-5411-bb0a-4aa825087846 BootID:71bee028-5412-4aea-be43-54afd99ce24e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:2b:01:1e:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:2b:01:1e:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:ca:2b:c5:38:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 16:02:09.201731 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.201720 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 16:02:09.201868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.201851 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 16:02:09.204009 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.203982 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 16:02:09.204155 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.204012 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 16:02:09.204196 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.204167 2575 topology_manager.go:138] "Creating topology manager with none policy" May 28 16:02:09.204196 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.204176 2575 container_manager_linux.go:306] "Creating device plugin manager" May 28 16:02:09.204196 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.204184 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 16:02:09.205084 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.205074 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 16:02:09.206863 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.206852 2575 state_mem.go:36] "Initialized new in-memory state store" May 28 16:02:09.206982 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.206972 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 16:02:09.210291 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.210280 2575 kubelet.go:491] "Attempting to sync node with API server" May 28 16:02:09.210336 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.210310 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 16:02:09.210336 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.210323 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 16:02:09.210336 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.210333 2575 kubelet.go:397] "Adding apiserver pod source" May 28 16:02:09.210417 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.210341 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 16:02:09.211748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.211734 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 16:02:09.211801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.211753 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 16:02:09.215956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.215941 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 16:02:09.218183 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.218171 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 16:02:09.219149 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219137 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219157 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219163 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219169 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219177 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219183 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 16:02:09.219189 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219188 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 16:02:09.219362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219195 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 16:02:09.219362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219221 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 16:02:09.219362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219229 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 16:02:09.219362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219245 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 16:02:09.219467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.219439 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 16:02:09.220527 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.220515 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 16:02:09.220558 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.220529 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 16:02:09.223730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.223716 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 16:02:09.223792 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.223755 2575 server.go:1295] "Started kubelet" May 28 16:02:09.223894 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.223835 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 16:02:09.223956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.223941 2575 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 16:02:09.224278 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.224252 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 16:02:09.224470 ip-10-0-136-8 systemd[1]: Started Kubernetes Kubelet. May 28 16:02:09.225460 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.225441 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 16:02:09.228571 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.228538 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:02:09.228758 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.228713 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 16:02:09.228907 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.228889 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 16:02:09.229994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.229973 2575 server.go:317] "Adding debug handlers to kubelet server" May 28 16:02:09.234874 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.233835 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-8.ec2.internal.18b3c62280369e74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-8.ec2.internal,UID:ip-10-0-136-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-8.ec2.internal,},FirstTimestamp:2026-05-28 16:02:09.223728756 +0000 UTC m=+0.474643604,LastTimestamp:2026-05-28 16:02:09.223728756 +0000 UTC m=+0.474643604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-8.ec2.internal,}" May 28 16:02:09.235145 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.235127 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 16:02:09.235751 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.235734 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 16:02:09.235892 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.235866 2575 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 16:02:09.235892 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.235886 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 16:02:09.236032 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.235987 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 16:02:09.236089 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236065 2575 reconstruct.go:97] "Volume reconstruction finished" May 28 16:02:09.236089 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236077 2575 reconciler.go:26] "Reconciler: start to sync state" May 28 16:02:09.236466 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236423 2575 factory.go:55] Registering systemd factory May 28 16:02:09.236466 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236439 2575 factory.go:223] Registration of the systemd container factory successfully May 28 16:02:09.236952 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.236904 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.237034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236962 2575 factory.go:153] Registering CRI-O factory May 28 16:02:09.237034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.236975 2575 factory.go:223] Registration of the crio container factory successfully May 28 16:02:09.237034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.237022 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 16:02:09.237187 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.237041 2575 factory.go:103] Registering Raw factory May 28 16:02:09.237187 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.237060 2575 manager.go:1196] Started watching for new ooms in manager May 28 16:02:09.237540 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.237524 2575 manager.go:319] Starting recovery of all containers May 28 16:02:09.237696 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.237673 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 16:02:09.242211 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.242185 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcjdr" May 28 16:02:09.247169 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.247154 2575 manager.go:324] Recovery completed May 28 16:02:09.247804 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.247780 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 16:02:09.247896 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.247806 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 28 16:02:09.250354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.250335 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcjdr" May 28 16:02:09.251380 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.251367 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.255257 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255241 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.255332 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255270 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.255332 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255282 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.255788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255774 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 16:02:09.255788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255784 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 16:02:09.255894 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.255802 2575 state_mem.go:36] "Initialized new in-memory state store" May 28 16:02:09.259376 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.259357 2575 policy_none.go:49] "None policy: Start" May 28 16:02:09.259376 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.259377 2575 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 16:02:09.259482 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.259388 2575 state_mem.go:35] "Initializing new in-memory state store" May 28 16:02:09.296970 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.296951 2575 manager.go:341] "Starting Device Plugin manager" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.296996 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297009 2575 server.go:85] "Starting device plugin registration server" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297266 2575 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297276 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297362 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297446 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.297454 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.298286 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.298338 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.303854 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.305116 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.305140 2575 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.305155 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.305162 2575 kubelet.go:2451] "Starting kubelet main sync loop" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.305194 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 16:02:09.319188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.309246 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:02:09.398181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.398103 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.400657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.400630 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.400786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.400667 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.400786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.400678 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.400786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.400724 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-8.ec2.internal" May 28 16:02:09.405782 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.405762 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal"] May 28 16:02:09.405844 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.405826 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.411660 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.411636 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.411779 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.411671 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.411779 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.411695 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.412236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.412220 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-8.ec2.internal" May 28 16:02:09.412285 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.412240 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-8.ec2.internal\": node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.414177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.414163 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.414352 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.414326 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.414408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.414360 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.415630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415615 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.415704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415617 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.415704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415673 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.415704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415687 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.415704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415645 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.415844 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.415712 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.418523 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.418507 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:09.418613 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.418537 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:02:09.419215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.419201 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" May 28 16:02:09.419286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.419225 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:02:09.419286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.419236 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" May 28 16:02:09.427019 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.427002 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.437428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.437405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.443997 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.443980 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-8.ec2.internal\" not found" node="ip-10-0-136-8.ec2.internal" May 28 16:02:09.448456 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.448439 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-8.ec2.internal\" not found" node="ip-10-0-136-8.ec2.internal" May 28 16:02:09.527524 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.527495 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.537927 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.537906 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.538016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.537935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.538016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.537955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0410c5901f1d12b6ff4640234fe0fc00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"0410c5901f1d12b6ff4640234fe0fc00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:09.538016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.538000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.628583 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.628548 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.638920 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.638893 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.638920 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.638913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f338e29479901cf2a7f75d9782500a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"8f338e29479901cf2a7f75d9782500a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.639053 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.638937 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0410c5901f1d12b6ff4640234fe0fc00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"0410c5901f1d12b6ff4640234fe0fc00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:09.639053 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.638971 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0410c5901f1d12b6ff4640234fe0fc00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"0410c5901f1d12b6ff4640234fe0fc00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:09.729291 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.729227 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.748699 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.748667 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:09.753029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:09.753000 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:09.829676 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.829637 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:09.930188 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:09.930158 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:10.030699 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:10.030630 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:10.131165 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:10.131129 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:10.139480 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.139463 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 16:02:10.139643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.139623 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 16:02:10.231714 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:10.231685 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:10.235946 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.235929 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 16:02:10.246678 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.246649 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 16:02:10.252848 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.252813 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 15:57:09 +0000 UTC" deadline="2028-01-22 09:15:14.856176587 +0000 UTC" May 28 16:02:10.252848 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.252847 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14489h13m4.603332243s" May 28 16:02:10.272111 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.272076 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rrsbm" May 28 16:02:10.280323 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.280284 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rrsbm" May 28 16:02:10.332721 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:10.332698 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" May 28 16:02:10.343918 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:10.343890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f338e29479901cf2a7f75d9782500a0.slice/crio-55f5f7adc99ff0a3d4ef48df5dd6cc720f9e2ecc071b3e42b2b172da41f1bb9c WatchSource:0}: Error finding container 55f5f7adc99ff0a3d4ef48df5dd6cc720f9e2ecc071b3e42b2b172da41f1bb9c: Status 404 returned error can't find the container with id 55f5f7adc99ff0a3d4ef48df5dd6cc720f9e2ecc071b3e42b2b172da41f1bb9c May 28 16:02:10.344086 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:10.344064 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0410c5901f1d12b6ff4640234fe0fc00.slice/crio-171d586be83237dc371c4fecc1308fd6f7bf9b88231869928b8158f6a1762d83 WatchSource:0}: Error finding container 171d586be83237dc371c4fecc1308fd6f7bf9b88231869928b8158f6a1762d83: Status 404 returned error can't find the container with id 171d586be83237dc371c4fecc1308fd6f7bf9b88231869928b8158f6a1762d83 May 28 16:02:10.347277 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.347260 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:02:10.407488 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.407467 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:02:10.436230 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.436210 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" May 28 16:02:10.449421 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.449403 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 16:02:10.451759 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.451746 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" May 28 16:02:10.457693 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.457644 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:02:10.457791 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.457761 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 16:02:10.831071 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:10.831034 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:02:11.211471 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.211377 2575 apiserver.go:52] "Watching apiserver" May 28 16:02:11.217531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.217507 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 16:02:11.217849 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.217823 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal","openshift-multus/multus-additional-cni-plugins-9kcpf","openshift-multus/network-metrics-daemon-njpw4","openshift-network-diagnostics/network-check-target-xtvnr","openshift-cluster-node-tuning-operator/tuned-47674","openshift-image-registry/node-ca-jtlv5","openshift-multus/multus-j7w94","openshift-network-operator/iptables-alerter-n6sw9","openshift-ovn-kubernetes/ovnkube-node-pk672","kube-system/konnectivity-agent-hk6g2","kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw"] May 28 16:02:11.220986 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.220957 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.223642 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.223538 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 16:02:11.223926 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.223907 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 16:02:11.224018 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.223930 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 16:02:11.224018 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.223963 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 16:02:11.224018 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.224000 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 16:02:11.224402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.224288 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phmg9\"" May 28 16:02:11.225673 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.225653 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.225780 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.225740 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:11.225838 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.225769 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:11.225888 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.225839 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:11.227967 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.227948 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.230025 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.230004 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 16:02:11.230118 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.230101 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.230182 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.230155 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:11.230315 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.230264 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mp8h7\"" May 28 16:02:11.232263 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.232240 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7w94" May 28 16:02:11.232695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.232487 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5c7m\"" May 28 16:02:11.232695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.232546 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 16:02:11.232695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.232607 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 16:02:11.232695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.232630 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 16:02:11.234359 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.234341 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hdjcd\"" May 28 16:02:11.234476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.234399 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 16:02:11.234573 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.234548 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.238026 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.236490 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:11.238026 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.237219 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 16:02:11.238026 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.237500 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 16:02:11.238026 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.237707 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7c8r6\"" May 28 16:02:11.239366 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.238687 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.240676 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.240657 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 16:02:11.240961 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.240943 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 16:02:11.241262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.241077 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 16:02:11.241262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.240984 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 16:02:11.241262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.241029 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 16:02:11.241262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.240971 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 16:02:11.241777 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.241757 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snkcc\"" May 28 16:02:11.242233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.242214 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.244883 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.244560 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.245721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.245393 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 16:02:11.245721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.245491 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h9l84\"" May 28 16:02:11.245721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.245351 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 16:02:11.246313 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysconfig\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.246414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2141721f-b955-4f96-b756-5c000b93280d-serviceca\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.246414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-system-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.246414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6bb\" (UniqueName: \"kubernetes.io/projected/358ed11c-d042-4e04-952f-9e76f82c0b4f-kube-api-access-kg6bb\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.246553 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/4bdc9f5c-9530-492c-afee-5c917f830aa4-kube-api-access-c7m7p\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.246553 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.246553 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m77lm\" (UniqueName: \"kubernetes.io/projected/819ecfec-24a3-4c10-942b-45063fea15f5-kube-api-access-m77lm\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-bin\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-config\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb0b6881-dce5-483e-865c-e9de9c79224d-ovn-node-metrics-cert\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-cnibin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-os-release\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.246711 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-conf-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-conf\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-ovn\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246844 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-etc-kubernetes\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-netns\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-netns\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246923 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246961 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 16:02:11.247094 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247100 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.246941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-etc-tuned\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-sys\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-lib-modules\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-var-lib-kubelet\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-var-lib-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-netd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247189 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjnk2\"" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-socket-dir-parent\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9r6s\" (UniqueName: \"kubernetes.io/projected/2141721f-b955-4f96-b756-5c000b93280d-kube-api-access-d9r6s\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-slash\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-script-lib\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247456 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ecfec-24a3-4c10-942b-45063fea15f5-host-slash\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxhm\" (UniqueName: \"kubernetes.io/projected/eb0b6881-dce5-483e-865c-e9de9c79224d-kube-api-access-fmxhm\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-k8s-cni-cncf-io\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-host\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.247735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-etc-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-daemon-config\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-kubernetes\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-run\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-env-overrides\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-hostroot\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-systemd\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sxf5\" (UniqueName: \"kubernetes.io/projected/26976454-8b53-4c15-8534-5d3907456eaf-kube-api-access-2sxf5\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-systemd-units\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2141721f-b955-4f96-b756-5c000b93280d-host\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cnibin\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.247999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgmjv\" (UniqueName: \"kubernetes.io/projected/cb6981b3-4b8b-44b9-bc69-f48d8b118884-kube-api-access-vgmjv\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-multus\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.248491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-kubelet\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-log-socket\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-tmp\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/819ecfec-24a3-4c10-942b-45063fea15f5-iptables-alerter-script\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-system-cni-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-cni-binary-copy\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-multus-certs\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-modprobe-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-os-release\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-kubelet\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-systemd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-node-log\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.249210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.248626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-bin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.281098 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.281063 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:57:10 +0000 UTC" deadline="2028-03-03 02:16:14.926278042 +0000 UTC" May 28 16:02:11.281215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.281103 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15466h14m3.645185958s" May 28 16:02:11.310006 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.309957 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" event={"ID":"0410c5901f1d12b6ff4640234fe0fc00","Type":"ContainerStarted","Data":"171d586be83237dc371c4fecc1308fd6f7bf9b88231869928b8158f6a1762d83"} May 28 16:02:11.311216 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.311191 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"8f338e29479901cf2a7f75d9782500a0","Type":"ContainerStarted","Data":"55f5f7adc99ff0a3d4ef48df5dd6cc720f9e2ecc071b3e42b2b172da41f1bb9c"} May 28 16:02:11.337424 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.337383 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 16:02:11.349835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.349807 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:11.349835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.349849 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ecfec-24a3-4c10-942b-45063fea15f5-host-slash\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.350065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.349875 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxhm\" (UniqueName: \"kubernetes.io/projected/eb0b6881-dce5-483e-865c-e9de9c79224d-kube-api-access-fmxhm\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.349904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cea25699-9b7a-43c4-9c50-7dc9a4937359-agent-certs\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.350065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.349949 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ecfec-24a3-4c10-942b-45063fea15f5-host-slash\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.350232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350086 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-k8s-cni-cncf-io\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.350232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350125 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-host\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-k8s-cni-cncf-io\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.350232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-host\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350226 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-etc-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350262 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-daemon-config\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350288 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-etc-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350287 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-kubernetes\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350364 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-kubernetes\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-run\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350425 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350450 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-env-overrides\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350480 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-run\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmmr\" (UniqueName: \"kubernetes.io/projected/70f209a6-c145-40ea-8c97-13d629d50336-kube-api-access-gzmmr\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350531 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350556 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-hostroot\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350579 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-systemd\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350604 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sxf5\" (UniqueName: \"kubernetes.io/projected/26976454-8b53-4c15-8534-5d3907456eaf-kube-api-access-2sxf5\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350645 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-systemd-units\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350647 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-hostroot\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cea25699-9b7a-43c4-9c50-7dc9a4937359-konnectivity-ca\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-registration-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350721 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2141721f-b955-4f96-b756-5c000b93280d-host\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350746 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cnibin\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350770 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgmjv\" (UniqueName: \"kubernetes.io/projected/cb6981b3-4b8b-44b9-bc69-f48d8b118884-kube-api-access-vgmjv\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.350830 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-multus\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-kubelet\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350847 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350874 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-log-socket\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-systemd\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350910 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-tmp\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-systemd-units\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-daemon-config\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350934 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/819ecfec-24a3-4c10-942b-45063fea15f5-iptables-alerter-script\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350965 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-env-overrides\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.350970 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-system-cni-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-system-cni-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351019 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-log-socket\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cnibin\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351047 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-cni-binary-copy\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351089 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-kubelet\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.351664 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.351181 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351229 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.351254 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:11.851234974 +0000 UTC m=+3.102149826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2141721f-b955-4f96-b756-5c000b93280d-host\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351333 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/819ecfec-24a3-4c10-942b-45063fea15f5-iptables-alerter-script\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351458 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-multus-certs\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351482 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-modprobe-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-multus-certs\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-multus\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351516 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-os-release\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/358ed11c-d042-4e04-952f-9e76f82c0b4f-cni-binary-copy\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351531 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-kubelet\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351557 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-systemd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-kubelet\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351579 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351603 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-node-log\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.352529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-modprobe-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb6981b3-4b8b-44b9-bc69-f48d8b118884-os-release\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-systemd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-socket-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351651 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351666 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-node-log\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-bin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-var-lib-cni-bin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351720 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysconfig\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351757 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2141721f-b955-4f96-b756-5c000b93280d-serviceca\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351772 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysconfig\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351783 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-system-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351826 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6bb\" (UniqueName: \"kubernetes.io/projected/358ed11c-d042-4e04-952f-9e76f82c0b4f-kube-api-access-kg6bb\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351857 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/4bdc9f5c-9530-492c-afee-5c917f830aa4-kube-api-access-c7m7p\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351882 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351907 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m77lm\" (UniqueName: \"kubernetes.io/projected/819ecfec-24a3-4c10-942b-45063fea15f5-kube-api-access-m77lm\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-system-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351930 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-bin\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.353354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351971 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-bin\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.351998 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-config\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352026 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb0b6881-dce5-483e-865c-e9de9c79224d-ovn-node-metrics-cert\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352051 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352093 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-cnibin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352116 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-os-release\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352141 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-conf-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2141721f-b955-4f96-b756-5c000b93280d-serviceca\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-conf\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352192 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-ovn\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-cni-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352219 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-cnibin\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-device-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352364 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-run-ovn\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352381 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-conf-dir\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-os-release\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.355079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-conf\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352512 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-etc-kubernetes\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352529 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-config\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352611 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352640 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-sys-fs\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-netns\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-netns\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352750 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-etc-tuned\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-sys\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-lib-modules\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-var-lib-kubelet\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-var-lib-kubelet\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352897 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-var-lib-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-var-lib-openvswitch\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-run-netns\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-netd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.355922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352984 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-host-run-netns\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.352947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb6981b3-4b8b-44b9-bc69-f48d8b118884-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353022 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-socket-dir-parent\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353042 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-lib-modules\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-etc-kubernetes\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353063 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-cni-netd\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353094 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9r6s\" (UniqueName: \"kubernetes.io/projected/2141721f-b955-4f96-b756-5c000b93280d-kube-api-access-d9r6s\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-sys\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353130 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26976454-8b53-4c15-8534-5d3907456eaf-etc-sysctl-d\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353130 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/358ed11c-d042-4e04-952f-9e76f82c0b4f-multus-socket-dir-parent\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353161 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-slash\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-script-lib\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb0b6881-dce5-483e-865c-e9de9c79224d-host-slash\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.353924 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb0b6881-dce5-483e-865c-e9de9c79224d-ovnkube-script-lib\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.355837 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-tmp\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.355900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26976454-8b53-4c15-8534-5d3907456eaf-etc-tuned\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.356801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.356684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb0b6881-dce5-483e-865c-e9de9c79224d-ovn-node-metrics-cert\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.357639 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.357290 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:11.357639 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.357328 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:11.357639 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.357338 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:11.357639 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.357403 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:11.857385375 +0000 UTC m=+3.108300208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:11.359355 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.359285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxhm\" (UniqueName: \"kubernetes.io/projected/eb0b6881-dce5-483e-865c-e9de9c79224d-kube-api-access-fmxhm\") pod \"ovnkube-node-pk672\" (UID: \"eb0b6881-dce5-483e-865c-e9de9c79224d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.361953 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.361782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6bb\" (UniqueName: \"kubernetes.io/projected/358ed11c-d042-4e04-952f-9e76f82c0b4f-kube-api-access-kg6bb\") pod \"multus-j7w94\" (UID: \"358ed11c-d042-4e04-952f-9e76f82c0b4f\") " pod="openshift-multus/multus-j7w94" May 28 16:02:11.362051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.362003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgmjv\" (UniqueName: \"kubernetes.io/projected/cb6981b3-4b8b-44b9-bc69-f48d8b118884-kube-api-access-vgmjv\") pod \"multus-additional-cni-plugins-9kcpf\" (UID: \"cb6981b3-4b8b-44b9-bc69-f48d8b118884\") " pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.365153 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.365131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/4bdc9f5c-9530-492c-afee-5c917f830aa4-kube-api-access-c7m7p\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.366382 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.366359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9r6s\" (UniqueName: \"kubernetes.io/projected/2141721f-b955-4f96-b756-5c000b93280d-kube-api-access-d9r6s\") pod \"node-ca-jtlv5\" (UID: \"2141721f-b955-4f96-b756-5c000b93280d\") " pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.366479 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.366448 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m77lm\" (UniqueName: \"kubernetes.io/projected/819ecfec-24a3-4c10-942b-45063fea15f5-kube-api-access-m77lm\") pod \"iptables-alerter-n6sw9\" (UID: \"819ecfec-24a3-4c10-942b-45063fea15f5\") " pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.367137 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.367099 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sxf5\" (UniqueName: \"kubernetes.io/projected/26976454-8b53-4c15-8534-5d3907456eaf-kube-api-access-2sxf5\") pod \"tuned-47674\" (UID: \"26976454-8b53-4c15-8534-5d3907456eaf\") " pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.420726 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.420690 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:02:11.453978 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.453946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-device-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.453978 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.453992 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454021 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-sys-fs\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454053 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454097 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cea25699-9b7a-43c4-9c50-7dc9a4937359-agent-certs\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-device-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454130 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmmr\" (UniqueName: \"kubernetes.io/projected/70f209a6-c145-40ea-8c97-13d629d50336-kube-api-access-gzmmr\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454159 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cea25699-9b7a-43c4-9c50-7dc9a4937359-konnectivity-ca\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-sys-fs\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454175 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-registration-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454620 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454215 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-socket-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454620 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-socket-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454620 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454579 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70f209a6-c145-40ea-8c97-13d629d50336-registration-dir\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.454842 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.454790 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cea25699-9b7a-43c4-9c50-7dc9a4937359-konnectivity-ca\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.457153 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.457125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cea25699-9b7a-43c4-9c50-7dc9a4937359-agent-certs\") pod \"konnectivity-agent-hk6g2\" (UID: \"cea25699-9b7a-43c4-9c50-7dc9a4937359\") " pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.462851 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.462800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmmr\" (UniqueName: \"kubernetes.io/projected/70f209a6-c145-40ea-8c97-13d629d50336-kube-api-access-gzmmr\") pod \"aws-ebs-csi-driver-node-jpstw\" (UID: \"70f209a6-c145-40ea-8c97-13d629d50336\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.532782 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.532743 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" May 28 16:02:11.543794 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.543766 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47674" May 28 16:02:11.553646 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.553619 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jtlv5" May 28 16:02:11.558823 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.558802 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7w94" May 28 16:02:11.567382 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.567362 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6sw9" May 28 16:02:11.574985 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.574963 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:11.580050 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.580028 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6981b3_4b8b_44b9_bc69_f48d8b118884.slice/crio-5e0a1cdd0475848ac68e8adaf231550d9f4656b954412a0516a1296d40eb0c50 WatchSource:0}: Error finding container 5e0a1cdd0475848ac68e8adaf231550d9f4656b954412a0516a1296d40eb0c50: Status 404 returned error can't find the container with id 5e0a1cdd0475848ac68e8adaf231550d9f4656b954412a0516a1296d40eb0c50 May 28 16:02:11.580853 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.580808 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2141721f_b955_4f96_b756_5c000b93280d.slice/crio-5734d5cb9d0b022d8e76a4bb3bd4e5adb85babd457e9bb226160cecc159f2790 WatchSource:0}: Error finding container 5734d5cb9d0b022d8e76a4bb3bd4e5adb85babd457e9bb226160cecc159f2790: Status 404 returned error can't find the container with id 5734d5cb9d0b022d8e76a4bb3bd4e5adb85babd457e9bb226160cecc159f2790 May 28 16:02:11.582566 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.582547 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:11.583557 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.583539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819ecfec_24a3_4c10_942b_45063fea15f5.slice/crio-34d73dcd3225e50be48ffd6fb2249252f81854a56f4082ab4e403f636842a313 WatchSource:0}: Error finding container 34d73dcd3225e50be48ffd6fb2249252f81854a56f4082ab4e403f636842a313: Status 404 returned error can't find the container with id 34d73dcd3225e50be48ffd6fb2249252f81854a56f4082ab4e403f636842a313 May 28 16:02:11.584549 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.584524 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358ed11c_d042_4e04_952f_9e76f82c0b4f.slice/crio-4f52df6e03607058727fd6400f89cf5a9f70f68cbf98cd1025bfb123fc40b9be WatchSource:0}: Error finding container 4f52df6e03607058727fd6400f89cf5a9f70f68cbf98cd1025bfb123fc40b9be: Status 404 returned error can't find the container with id 4f52df6e03607058727fd6400f89cf5a9f70f68cbf98cd1025bfb123fc40b9be May 28 16:02:11.585286 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.585268 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26976454_8b53_4c15_8534_5d3907456eaf.slice/crio-cb52fba385910512d7f84f7da89381e89d18db268c37c8f5b756f40407d60cfe WatchSource:0}: Error finding container cb52fba385910512d7f84f7da89381e89d18db268c37c8f5b756f40407d60cfe: Status 404 returned error can't find the container with id cb52fba385910512d7f84f7da89381e89d18db268c37c8f5b756f40407d60cfe May 28 16:02:11.589570 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.589529 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" May 28 16:02:11.590902 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.590879 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0b6881_dce5_483e_865c_e9de9c79224d.slice/crio-f32233aaa9ea32528836ca7d89a3df0b522aabae92b023453247c29b8885b8f9 WatchSource:0}: Error finding container f32233aaa9ea32528836ca7d89a3df0b522aabae92b023453247c29b8885b8f9: Status 404 returned error can't find the container with id f32233aaa9ea32528836ca7d89a3df0b522aabae92b023453247c29b8885b8f9 May 28 16:02:11.592607 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.592535 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea25699_9b7a_43c4_9c50_7dc9a4937359.slice/crio-d163cdeadf47f2c2f189b7e6f46142184808d9c1a4e3914614eb413056eb1e4f WatchSource:0}: Error finding container d163cdeadf47f2c2f189b7e6f46142184808d9c1a4e3914614eb413056eb1e4f: Status 404 returned error can't find the container with id d163cdeadf47f2c2f189b7e6f46142184808d9c1a4e3914614eb413056eb1e4f May 28 16:02:11.618222 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:11.618196 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f209a6_c145_40ea_8c97_13d629d50336.slice/crio-7c2f9f36c44d0ac118e5fb969da1c07526c0a2765d5c2b4b09b094776d87a246 WatchSource:0}: Error finding container 7c2f9f36c44d0ac118e5fb969da1c07526c0a2765d5c2b4b09b094776d87a246: Status 404 returned error can't find the container with id 7c2f9f36c44d0ac118e5fb969da1c07526c0a2765d5c2b4b09b094776d87a246 May 28 16:02:11.856107 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.856073 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:11.856289 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.856221 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:11.856289 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.856285 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:12.856269068 +0000 UTC m=+4.107183902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:11.956526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:11.956500 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:11.956706 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.956688 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:11.956796 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.956712 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:11.956796 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.956726 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:11.956883 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:11.956797 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:12.956777583 +0000 UTC m=+4.207692419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:12.281959 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.281855 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:57:10 +0000 UTC" deadline="2028-01-10 04:16:14.999633101 +0000 UTC" May 28 16:02:12.281959 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.281894 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14196h14m2.717742471s" May 28 16:02:12.306441 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.306413 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:12.306592 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.306556 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:12.320241 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.320204 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jtlv5" event={"ID":"2141721f-b955-4f96-b756-5c000b93280d","Type":"ContainerStarted","Data":"5734d5cb9d0b022d8e76a4bb3bd4e5adb85babd457e9bb226160cecc159f2790"} May 28 16:02:12.329814 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.329766 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"f32233aaa9ea32528836ca7d89a3df0b522aabae92b023453247c29b8885b8f9"} May 28 16:02:12.335802 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.335771 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47674" event={"ID":"26976454-8b53-4c15-8534-5d3907456eaf","Type":"ContainerStarted","Data":"cb52fba385910512d7f84f7da89381e89d18db268c37c8f5b756f40407d60cfe"} May 28 16:02:12.337851 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.337825 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerStarted","Data":"5e0a1cdd0475848ac68e8adaf231550d9f4656b954412a0516a1296d40eb0c50"} May 28 16:02:12.342340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.342314 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" event={"ID":"0410c5901f1d12b6ff4640234fe0fc00","Type":"ContainerStarted","Data":"8493ecab80c26b505d68a4e2598da4474036900fdc19e8abadec4af6049022ec"} May 28 16:02:12.345341 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.345315 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" event={"ID":"70f209a6-c145-40ea-8c97-13d629d50336","Type":"ContainerStarted","Data":"7c2f9f36c44d0ac118e5fb969da1c07526c0a2765d5c2b4b09b094776d87a246"} May 28 16:02:12.349190 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.349160 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hk6g2" event={"ID":"cea25699-9b7a-43c4-9c50-7dc9a4937359","Type":"ContainerStarted","Data":"d163cdeadf47f2c2f189b7e6f46142184808d9c1a4e3914614eb413056eb1e4f"} May 28 16:02:12.368253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.368200 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" podStartSLOduration=2.368183699 podStartE2EDuration="2.368183699s" podCreationTimestamp="2026-05-28 16:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:12.366990208 +0000 UTC m=+3.617905064" watchObservedRunningTime="2026-05-28 16:02:12.368183699 +0000 UTC m=+3.619098555" May 28 16:02:12.369513 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.369418 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7w94" event={"ID":"358ed11c-d042-4e04-952f-9e76f82c0b4f","Type":"ContainerStarted","Data":"4f52df6e03607058727fd6400f89cf5a9f70f68cbf98cd1025bfb123fc40b9be"} May 28 16:02:12.382566 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.382512 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6sw9" event={"ID":"819ecfec-24a3-4c10-942b-45063fea15f5","Type":"ContainerStarted","Data":"34d73dcd3225e50be48ffd6fb2249252f81854a56f4082ab4e403f636842a313"} May 28 16:02:12.871551 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.871514 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:12.871723 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.871654 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:12.871812 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.871724 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:14.871703399 +0000 UTC m=+6.122618234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:12.972898 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:12.972851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:12.973083 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.973019 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:12.973083 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.973037 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:12.973083 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.973049 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:12.973236 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:12.973108 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:14.973091016 +0000 UTC m=+6.224005863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:13.307650 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:13.307517 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:13.308117 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:13.307693 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:13.387428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:13.387389 2575 generic.go:358] "Generic (PLEG): container finished" podID="8f338e29479901cf2a7f75d9782500a0" containerID="e4ea87d06d551cd92c48ac1aa81e332dfbdaee4b8903fc66bfb6be09a3300fe5" exitCode=0 May 28 16:02:13.388362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:13.388334 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"8f338e29479901cf2a7f75d9782500a0","Type":"ContainerDied","Data":"e4ea87d06d551cd92c48ac1aa81e332dfbdaee4b8903fc66bfb6be09a3300fe5"} May 28 16:02:14.305399 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:14.305367 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:14.305597 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.305504 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:14.392845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:14.392811 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"8f338e29479901cf2a7f75d9782500a0","Type":"ContainerStarted","Data":"4e310d4751cae18d7c53b93ded0c33e44a0aa509b4c2b4fbb728506a75abf96f"} May 28 16:02:14.406464 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:14.406109 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" podStartSLOduration=4.406089331 podStartE2EDuration="4.406089331s" podCreationTimestamp="2026-05-28 16:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:14.406053229 +0000 UTC m=+5.656968085" watchObservedRunningTime="2026-05-28 16:02:14.406089331 +0000 UTC m=+5.657004221" May 28 16:02:14.890203 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:14.890147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:14.890389 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.890374 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:14.890499 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.890450 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:18.89042955 +0000 UTC m=+10.141344397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:14.991154 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:14.991118 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:14.991390 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.991281 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:14.991390 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.991340 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:14.991390 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.991354 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:14.991591 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:14.991423 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:18.991394897 +0000 UTC m=+10.242309736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:15.305967 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:15.305893 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:15.306150 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:15.306029 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:16.305943 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:16.305894 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:16.306378 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:16.306062 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:17.306470 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:17.306396 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:17.307001 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:17.306529 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:18.305976 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:18.305927 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:18.306171 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:18.306091 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:18.920643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:18.920609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:18.921078 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:18.920729 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:18.921078 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:18.920795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:26.92077518 +0000 UTC m=+18.171690015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:19.021183 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:19.021144 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:19.021406 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:19.021360 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:19.021406 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:19.021386 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:19.021406 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:19.021400 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:19.021574 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:19.021468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:27.021446442 +0000 UTC m=+18.272361284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:19.306486 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:19.306409 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:19.306633 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:19.306526 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:20.306566 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:20.306069 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:20.306566 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:20.306204 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:21.305643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:21.305611 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:21.305806 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:21.305744 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:22.305518 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:22.305473 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:22.305907 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:22.305627 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:23.305772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:23.305712 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:23.306286 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:23.305835 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:24.306359 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:24.306328 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:24.306765 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:24.306470 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:25.305839 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:25.305753 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:25.305989 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:25.305881 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:26.306084 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:26.306050 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:26.306525 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:26.306192 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:26.982585 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:26.982546 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:26.982764 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:26.982729 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:26.982845 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:26.982803 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:42.982785137 +0000 UTC m=+34.233699975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:27.083356 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:27.083317 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:27.083554 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:27.083487 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:02:27.083554 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:27.083505 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:02:27.083554 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:27.083514 2575 projected.go:194] Error preparing data for projected volume kube-api-access-pjc2f for pod openshift-network-diagnostics/network-check-target-xtvnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:27.083713 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:27.083568 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f podName:bb508ca5-6638-48e7-be0c-006c1dad8bb7 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.083551609 +0000 UTC m=+34.334466441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjc2f" (UniqueName: "kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f") pod "network-check-target-xtvnr" (UID: "bb508ca5-6638-48e7-be0c-006c1dad8bb7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:02:27.305725 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:27.305652 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:27.305873 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:27.305755 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:28.306035 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:28.305997 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:28.306527 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:28.306120 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:29.306227 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:29.306199 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:29.306588 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:29.306281 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:30.305585 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.305432 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:30.305715 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:30.305685 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:30.421751 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.421719 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"53bd00a3aacfd42edebc429cd48ee5f525dd6ac05ede1d99484b70dc055e7b77"} May 28 16:02:30.423127 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.423092 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47674" event={"ID":"26976454-8b53-4c15-8534-5d3907456eaf","Type":"ContainerStarted","Data":"1ea6c8b569721681733670aa86acdacd5532bfee46f509faddfb77e2e8a87e09"} May 28 16:02:30.424530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.424507 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="367c0f8e2dbb21fb259125821206c5994a3514dde33cd2994c2441eb17705e9e" exitCode=0 May 28 16:02:30.424686 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.424581 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"367c0f8e2dbb21fb259125821206c5994a3514dde33cd2994c2441eb17705e9e"} May 28 16:02:30.425960 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.425937 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" event={"ID":"70f209a6-c145-40ea-8c97-13d629d50336","Type":"ContainerStarted","Data":"c29090c40bd0f9ce177bb83d210608c864d5c8b39d3fc6f72c78d205edd6756e"} May 28 16:02:30.427217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.427197 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hk6g2" event={"ID":"cea25699-9b7a-43c4-9c50-7dc9a4937359","Type":"ContainerStarted","Data":"21c6c6611e61758684ef804492a7457ff3efa0be5c04172a294e686da2210ebb"} May 28 16:02:30.428576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.428545 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7w94" event={"ID":"358ed11c-d042-4e04-952f-9e76f82c0b4f","Type":"ContainerStarted","Data":"ae6cfe95c12fc7f5da7576df900353a63bd5b26c55628fad0edbc32866bb7d07"} May 28 16:02:30.429805 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.429779 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jtlv5" event={"ID":"2141721f-b955-4f96-b756-5c000b93280d","Type":"ContainerStarted","Data":"e272fe09a719b507e21cab94a65e1ac2f9cbfd5be91dc4430ae8a63e087efe5e"} May 28 16:02:30.436925 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.436887 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-47674" podStartSLOduration=3.16458821 podStartE2EDuration="21.436878111s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.58751957 +0000 UTC m=+2.838434415" lastFinishedPulling="2026-05-28 16:02:29.85980947 +0000 UTC m=+21.110724316" observedRunningTime="2026-05-28 16:02:30.436825501 +0000 UTC m=+21.687740355" watchObservedRunningTime="2026-05-28 16:02:30.436878111 +0000 UTC m=+21.687792965" May 28 16:02:30.492359 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.492319 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jtlv5" podStartSLOduration=8.130314034 podStartE2EDuration="21.492285606s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.582473873 +0000 UTC m=+2.833388706" lastFinishedPulling="2026-05-28 16:02:24.944445432 +0000 UTC m=+16.195360278" observedRunningTime="2026-05-28 16:02:30.476915152 +0000 UTC m=+21.727830006" watchObservedRunningTime="2026-05-28 16:02:30.492285606 +0000 UTC m=+21.743200498" May 28 16:02:30.492450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.492389 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j7w94" podStartSLOduration=3.215154466 podStartE2EDuration="21.492384954s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.587595958 +0000 UTC m=+2.838510800" lastFinishedPulling="2026-05-28 16:02:29.864826424 +0000 UTC m=+21.115741288" observedRunningTime="2026-05-28 16:02:30.492065519 +0000 UTC m=+21.742980374" watchObservedRunningTime="2026-05-28 16:02:30.492384954 +0000 UTC m=+21.743299814" May 28 16:02:30.507153 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:30.507115 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hk6g2" podStartSLOduration=3.3179940390000002 podStartE2EDuration="21.507102513s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.612916999 +0000 UTC m=+2.863831836" lastFinishedPulling="2026-05-28 16:02:29.802025476 +0000 UTC m=+21.052940310" observedRunningTime="2026-05-28 16:02:30.506938377 +0000 UTC m=+21.757853233" watchObservedRunningTime="2026-05-28 16:02:30.507102513 +0000 UTC m=+21.758017367" May 28 16:02:31.250840 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.250669 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 16:02:31.306124 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.306091 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:31.306273 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:31.306194 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:31.307652 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.307576 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T16:02:31.250838467Z","UUID":"1a301cba-e013-4fab-b5b4-ff700d28fbf3","Handler":null,"Name":"","Endpoint":""} May 28 16:02:31.310358 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.310341 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 16:02:31.310453 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.310367 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 16:02:31.435030 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.434955 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435271 2575 generic.go:358] "Generic (PLEG): container finished" podID="eb0b6881-dce5-483e-865c-e9de9c79224d" containerID="845c18e4ead121e10500a5025d3991ab4c2c5d4e252b8fcc0a4b8d85f8ae9fa4" exitCode=1 May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435350 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"a04689e145e6b530dd2bf1f243cf68c697c24aaafb9680301bb274ce6397decf"} May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435388 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"44dfd49e4d407af28e770f7ce6a6cbcfe5323a1c61072d5cda5a9d080212015c"} May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435403 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"b6924c23072b1de597fab40f871999775d35a89998035a364c6e220a9350d1b1"} May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435415 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"f719bb63d3322e3ae4025996ddd66a08195b656c2cd9190d92d98eaca4dc6ed8"} May 28 16:02:31.435530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.435427 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerDied","Data":"845c18e4ead121e10500a5025d3991ab4c2c5d4e252b8fcc0a4b8d85f8ae9fa4"} May 28 16:02:31.436956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.436931 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" event={"ID":"70f209a6-c145-40ea-8c97-13d629d50336","Type":"ContainerStarted","Data":"a997559df4218bd7a59d7f47c743e4c0369dce19f3832d42cc911926d77acf07"} May 28 16:02:31.438431 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.438384 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6sw9" event={"ID":"819ecfec-24a3-4c10-942b-45063fea15f5","Type":"ContainerStarted","Data":"45f3809f703d21297914815d68a9a44b5632767a74ccde3e0e7143bf76b6614f"} May 28 16:02:31.463603 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.463561 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n6sw9" podStartSLOduration=4.246980911 podStartE2EDuration="22.46355073s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.585454603 +0000 UTC m=+2.836369449" lastFinishedPulling="2026-05-28 16:02:29.802024435 +0000 UTC m=+21.052939268" observedRunningTime="2026-05-28 16:02:31.463466499 +0000 UTC m=+22.714381364" watchObservedRunningTime="2026-05-28 16:02:31.46355073 +0000 UTC m=+22.714465584" May 28 16:02:31.606127 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.606092 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:31.606778 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:31.606757 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:32.091519 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.091487 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ntrj8"] May 28 16:02:32.093935 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.093913 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.096778 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.096754 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 16:02:32.096887 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.096795 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-65cpj\"" May 28 16:02:32.096887 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.096802 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 16:02:32.220821 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.220628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a02dd1-1758-41d7-98b9-cb335cfd49a6-tmp-dir\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.220966 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.220879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7g6b\" (UniqueName: \"kubernetes.io/projected/71a02dd1-1758-41d7-98b9-cb335cfd49a6-kube-api-access-d7g6b\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.221028 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.220967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a02dd1-1758-41d7-98b9-cb335cfd49a6-hosts-file\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.306376 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.306347 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:32.306567 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:32.306469 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:32.321788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.321755 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a02dd1-1758-41d7-98b9-cb335cfd49a6-tmp-dir\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.321928 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.321822 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7g6b\" (UniqueName: \"kubernetes.io/projected/71a02dd1-1758-41d7-98b9-cb335cfd49a6-kube-api-access-d7g6b\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.321928 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.321891 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a02dd1-1758-41d7-98b9-cb335cfd49a6-hosts-file\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.322020 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.321975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a02dd1-1758-41d7-98b9-cb335cfd49a6-hosts-file\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.322136 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.322114 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a02dd1-1758-41d7-98b9-cb335cfd49a6-tmp-dir\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.334359 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.334332 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7g6b\" (UniqueName: \"kubernetes.io/projected/71a02dd1-1758-41d7-98b9-cb335cfd49a6-kube-api-access-d7g6b\") pod \"node-resolver-ntrj8\" (UID: \"71a02dd1-1758-41d7-98b9-cb335cfd49a6\") " pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.404371 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.404285 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntrj8" May 28 16:02:32.411826 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:32.411799 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a02dd1_1758_41d7_98b9_cb335cfd49a6.slice/crio-e463ef22ea10ff2a77fd279c81dac898631cab6a0c8b18116843701b6e4f6a38 WatchSource:0}: Error finding container e463ef22ea10ff2a77fd279c81dac898631cab6a0c8b18116843701b6e4f6a38: Status 404 returned error can't find the container with id e463ef22ea10ff2a77fd279c81dac898631cab6a0c8b18116843701b6e4f6a38 May 28 16:02:32.443245 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.443192 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" event={"ID":"70f209a6-c145-40ea-8c97-13d629d50336","Type":"ContainerStarted","Data":"c5477f9cbc285b1ed2f1e63437c5087d10bba8b994af88bb243eb724c220a544"} May 28 16:02:32.444652 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.444626 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntrj8" event={"ID":"71a02dd1-1758-41d7-98b9-cb335cfd49a6","Type":"ContainerStarted","Data":"e463ef22ea10ff2a77fd279c81dac898631cab6a0c8b18116843701b6e4f6a38"} May 28 16:02:32.463046 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:32.462886 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpstw" podStartSLOduration=2.9560828839999997 podStartE2EDuration="23.462868252s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.62041128 +0000 UTC m=+2.871326116" lastFinishedPulling="2026-05-28 16:02:32.127196651 +0000 UTC m=+23.378111484" observedRunningTime="2026-05-28 16:02:32.462062386 +0000 UTC m=+23.712977242" watchObservedRunningTime="2026-05-28 16:02:32.462868252 +0000 UTC m=+23.713783108" May 28 16:02:33.305961 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.305886 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:33.306099 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:33.305995 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:33.340998 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.340969 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:33.341548 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.341515 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hk6g2" May 28 16:02:33.447520 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.447468 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntrj8" event={"ID":"71a02dd1-1758-41d7-98b9-cb335cfd49a6","Type":"ContainerStarted","Data":"9c7d1486629597c03e09250c95c66b915d676eb85eaa4e68bb6010e0c93a0ec2"} May 28 16:02:33.450700 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.450680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:02:33.451024 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.451001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"40ee1eb3b7772d61ae0eced8a686b79518d2331fdc6e968cb67232b122d53b85"} May 28 16:02:33.463742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:33.463699 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ntrj8" podStartSLOduration=1.463683453 podStartE2EDuration="1.463683453s" podCreationTimestamp="2026-05-28 16:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:33.462985482 +0000 UTC m=+24.713900336" watchObservedRunningTime="2026-05-28 16:02:33.463683453 +0000 UTC m=+24.714598321" May 28 16:02:34.306248 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:34.306217 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:34.306428 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:34.306340 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:35.306146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.305960 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:35.306662 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:35.306242 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:35.457308 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.457269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:02:35.457648 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.457622 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"7ae8c7fe221b54592a2da87b40df07b1378bffc1f74c2b71b74a20e66f978d6a"} May 28 16:02:35.457911 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.457887 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:35.457911 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.457912 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:35.458053 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.457924 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:35.458176 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.458156 2575 scope.go:117] "RemoveContainer" containerID="845c18e4ead121e10500a5025d3991ab4c2c5d4e252b8fcc0a4b8d85f8ae9fa4" May 28 16:02:35.459357 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.459334 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="ecbaccccf53e37566d964fd9ca084eca2032c3b6d676874ce0189b43e53d388c" exitCode=0 May 28 16:02:35.459456 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.459370 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"ecbaccccf53e37566d964fd9ca084eca2032c3b6d676874ce0189b43e53d388c"} May 28 16:02:35.474310 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.474267 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:35.474912 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:35.474822 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:02:36.308122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.307623 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:36.308122 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:36.307768 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:36.464495 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.464415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:02:36.464784 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.464760 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" event={"ID":"eb0b6881-dce5-483e-865c-e9de9c79224d","Type":"ContainerStarted","Data":"ae67037c35073091aa4193f08dadeac03f579112f1de5782ff918a67e25dbb74"} May 28 16:02:36.466781 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.466753 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="92f48724e27bdf4635e3cc36f369b87fa14fe6873a83900125d4ef5d4ee6dbc3" exitCode=0 May 28 16:02:36.466898 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.466807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"92f48724e27bdf4635e3cc36f369b87fa14fe6873a83900125d4ef5d4ee6dbc3"} May 28 16:02:36.496977 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.496936 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" podStartSLOduration=8.818002855 podStartE2EDuration="27.496922252s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.612839695 +0000 UTC m=+2.863754538" lastFinishedPulling="2026-05-28 16:02:30.291759102 +0000 UTC m=+21.542673935" observedRunningTime="2026-05-28 16:02:36.495526494 +0000 UTC m=+27.746441373" watchObservedRunningTime="2026-05-28 16:02:36.496922252 +0000 UTC m=+27.747837111" May 28 16:02:36.985085 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.984834 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njpw4"] May 28 16:02:36.985224 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.985187 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:36.985350 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:36.985328 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:36.987590 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.987568 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtvnr"] May 28 16:02:36.987689 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:36.987676 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:36.987789 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:36.987771 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:38.305682 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:38.305649 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:38.306167 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:38.305769 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:38.306167 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:38.305818 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:38.306167 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:38.305899 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:38.472360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:38.472321 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="9fe73f627729418d7edcc1af8d7930a6e035970f7cfce4ad68dd244b4231477b" exitCode=0 May 28 16:02:38.472360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:38.472359 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"9fe73f627729418d7edcc1af8d7930a6e035970f7cfce4ad68dd244b4231477b"} May 28 16:02:40.306049 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:40.306021 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:40.306704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:40.306015 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:40.306704 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:40.306143 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:40.306704 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:40.306237 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:42.306291 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.306250 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:42.306877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.306251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:42.306877 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.306391 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtvnr" podUID="bb508ca5-6638-48e7-be0c-006c1dad8bb7" May 28 16:02:42.306877 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.306535 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njpw4" podUID="4bdc9f5c-9530-492c-afee-5c917f830aa4" May 28 16:02:42.524472 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.524438 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeReady" May 28 16:02:42.524692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.524574 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 16:02:42.570146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.570117 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:02:42.594664 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.594629 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq"] May 28 16:02:42.594857 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.594773 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.599240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.599216 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 16:02:42.600061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.600036 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 16:02:42.601052 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.600708 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 16:02:42.602824 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.602799 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7"] May 28 16:02:42.603849 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.603820 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4zxf5\"" May 28 16:02:42.609699 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.609677 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 16:02:42.617087 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.617063 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr"] May 28 16:02:42.618582 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.617847 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.621629 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.621603 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kjthh\"" May 28 16:02:42.621912 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.621893 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 16:02:42.622185 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.622166 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 16:02:42.622842 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.622422 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:42.627734 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.627713 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96"] May 28 16:02:42.627910 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.627886 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" May 28 16:02:42.627980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.627945 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.630670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.630648 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 28 16:02:42.630823 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.630704 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 16:02:42.630908 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.630874 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xsn8m\"" May 28 16:02:42.631052 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.631033 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:42.631191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.631178 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 28 16:02:42.631571 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.631554 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t4zxg\"" May 28 16:02:42.642061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.642024 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-86tf6"] May 28 16:02:42.642398 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.642377 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.645483 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.645463 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 16:02:42.645648 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.645466 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:42.645648 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.645641 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fzgpq\"" May 28 16:02:42.645764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.645750 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 16:02:42.645838 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.645822 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 16:02:42.656372 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.656331 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t"] May 28 16:02:42.656707 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.656616 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.659737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.659718 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 16:02:42.663891 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.660920 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-65z4k\"" May 28 16:02:42.663891 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.661093 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 16:02:42.663891 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.661187 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 16:02:42.663891 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.661810 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 16:02:42.668952 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.668933 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-247qz"] May 28 16:02:42.669090 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.669075 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.671735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.671718 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 16:02:42.671833 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.671747 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bzcj6\"" May 28 16:02:42.672009 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.671994 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 16:02:42.672860 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.672844 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 16:02:42.677887 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.677863 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 16:02:42.678161 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.678143 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 16:02:42.684284 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.684266 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wxl59"] May 28 16:02:42.684437 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.684417 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-247qz" May 28 16:02:42.686875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.686858 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 16:02:42.687033 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.687016 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 16:02:42.687138 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.687057 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cq7wp\"" May 28 16:02:42.694178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.694161 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5fdf595458-kqvgd"] May 28 16:02:42.694345 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.694331 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.695500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695596 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzpf7\" (UniqueName: \"kubernetes.io/projected/5cbbc410-4e29-425e-af49-a432873ffd5a-kube-api-access-pzpf7\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.695702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695762 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4xm\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695816 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695872 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.695872 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695960 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.695999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.696049 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.695999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqzc\" (UniqueName: \"kubernetes.io/projected/8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1-kube-api-access-dqqzc\") pod \"volume-data-source-validator-5cf8c89d64-qmzgq\" (UID: \"8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" May 28 16:02:42.696049 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.696022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.698224 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.698166 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 28 16:02:42.698335 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.698228 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 28 16:02:42.698335 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.698232 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 28 16:02:42.698460 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.698440 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:42.698636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.698620 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ntbhg\"" May 28 16:02:42.705779 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.705756 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 28 16:02:42.709086 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.709066 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6g8g4"] May 28 16:02:42.709220 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.709205 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.711725 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.711708 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 16:02:42.711831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.711737 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4j855\"" May 28 16:02:42.711894 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.711866 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 16:02:42.712000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.711980 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 16:02:42.712079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.712019 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 16:02:42.712079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.712043 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 16:02:42.712186 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.712050 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 16:02:42.725583 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.725560 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7"] May 28 16:02:42.725734 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.725708 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:42.728333 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.728314 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-whswg\"" May 28 16:02:42.728441 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.728428 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 16:02:42.728491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.728456 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 16:02:42.728745 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.728725 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 16:02:42.735526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.735503 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:02:42.735624 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.735595 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:42.737808 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.737789 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 16:02:42.738143 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.738038 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 16:02:42.738143 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.738111 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ddczq\"" May 28 16:02:42.738143 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.738140 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 16:02:42.738400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.738251 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 16:02:42.748256 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.748233 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx"] May 28 16:02:42.748416 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.748394 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.762145 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762127 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762153 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762167 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762177 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-86tf6"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762188 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762198 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762209 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wxl59"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762219 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762229 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762239 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-247qz"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762249 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96"] May 28 16:02:42.762251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762253 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" May 28 16:02:42.762737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762259 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fdf595458-kqvgd"] May 28 16:02:42.762737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762354 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t"] May 28 16:02:42.762737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.762368 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6g8g4"] May 28 16:02:42.765041 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.765025 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 16:02:42.766499 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.765368 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 16:02:42.766499 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.765599 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vhpvh\"" May 28 16:02:42.796722 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796694 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqzc\" (UniqueName: \"kubernetes.io/projected/8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1-kube-api-access-dqqzc\") pod \"volume-data-source-validator-5cf8c89d64-qmzgq\" (UID: \"8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" May 28 16:02:42.796870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.796870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzh5\" (UniqueName: \"kubernetes.io/projected/7ccdf75b-b009-448f-aab0-776c93289ac0-kube-api-access-wgzh5\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.796870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7301293c-aa7c-499e-865c-59487a34a47e-serving-cert\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.796870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42596\" (UniqueName: \"kubernetes.io/projected/f52a7ac3-de62-4237-b8d8-725fcc942b2d-kube-api-access-42596\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.797066 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-config\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.797066 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.796999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.797066 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.797066 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-tmp-dir\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.797234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9j6z\" (UniqueName: \"kubernetes.io/projected/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-kube-api-access-l9j6z\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.797234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797099 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.797234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797131 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.797234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8q8\" (UniqueName: \"kubernetes.io/projected/58c0a118-055a-4aa4-9107-26b53796ad93-kube-api-access-ct8q8\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.797234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-service-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.797251 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797268 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797317 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.797333 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls podName:5cbbc410-4e29-425e-af49-a432873ffd5a nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.297314412 +0000 UTC m=+34.548229260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls") pod "cluster-samples-operator-697587599-zvxb7" (UID: "5cbbc410-4e29-425e-af49-a432873ffd5a") : secret "samples-operator-tls" not found May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-snapshots\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/2b991597-e3b6-4982-be46-b6a97ded5161-kube-api-access-vlhmm\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.797481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797480 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzpf7\" (UniqueName: \"kubernetes.io/projected/5cbbc410-4e29-425e-af49-a432873ffd5a-kube-api-access-pzpf7\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-stats-auth\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797539 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797615 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4xm\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58c0a118-055a-4aa4-9107-26b53796ad93-serving-cert\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797684 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4v95\" (UniqueName: \"kubernetes.io/projected/7301293c-aa7c-499e-865c-59487a34a47e-kube-api-access-r4v95\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f52a7ac3-de62-4237-b8d8-725fcc942b2d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.797868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-trusted-ca\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.797928 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ccdf75b-b009-448f-aab0-776c93289ac0-serving-cert\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-config-volume\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798128 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-default-certificate\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.798217 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.798210 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.798224 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798247 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.798283 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.298252967 +0000 UTC m=+34.549167805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798336 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-tmp\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7301293c-aa7c-499e-865c-59487a34a47e-config\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.798512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.798458 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.802079 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.802057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.802176 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.802078 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.811146 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.810978 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqzc\" (UniqueName: \"kubernetes.io/projected/8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1-kube-api-access-dqqzc\") pod \"volume-data-source-validator-5cf8c89d64-qmzgq\" (UID: \"8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" May 28 16:02:42.811259 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.810995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.811259 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.811121 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4xm\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:42.812482 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.812458 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzpf7\" (UniqueName: \"kubernetes.io/projected/5cbbc410-4e29-425e-af49-a432873ffd5a-kube-api-access-pzpf7\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:42.899702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899605 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8q8\" (UniqueName: \"kubernetes.io/projected/58c0a118-055a-4aa4-9107-26b53796ad93-kube-api-access-ct8q8\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.899702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.899702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899698 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-service-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/33e463e3-113e-4e69-974c-bdb1b0b889c5-kube-api-access-7xwg9\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkr6n\" (UniqueName: \"kubernetes.io/projected/16e6f5c3-dc9f-41c5-8648-35e679c765b3-kube-api-access-zkr6n\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.899863 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.399839409 +0000 UTC m=+34.650754269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6f5c3-dc9f-41c5-8648-35e679c765b3-config\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899939 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-snapshots\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.899979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899966 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/2b991597-e3b6-4982-be46-b6a97ded5161-kube-api-access-vlhmm\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.899995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16e6f5c3-dc9f-41c5-8648-35e679c765b3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pc28\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900095 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900154 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900201 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-stats-auth\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.900249 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.900320 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.900322 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.400288338 +0000 UTC m=+34.651203182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-service-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.900381 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.40036413 +0000 UTC m=+34.651278978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:42.900402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900404 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58c0a118-055a-4aa4-9107-26b53796ad93-serving-cert\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900437 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4v95\" (UniqueName: \"kubernetes.io/projected/7301293c-aa7c-499e-865c-59487a34a47e-kube-api-access-r4v95\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f52a7ac3-de62-4237-b8d8-725fcc942b2d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900531 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-trusted-ca\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900567 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ccdf75b-b009-448f-aab0-776c93289ac0-serving-cert\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900592 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-config-volume\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900649 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-default-certificate\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900666 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-tmp\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900703 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7301293c-aa7c-499e-865c-59487a34a47e-config\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900723 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnl4\" (UniqueName: \"kubernetes.io/projected/dc18d335-6a46-4cda-8a3a-b19eca0fdffa-kube-api-access-kgnl4\") pod \"network-check-source-7f44b6dd87-vd8fx\" (UID: \"dc18d335-6a46-4cda-8a3a-b19eca0fdffa\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900789 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzh5\" (UniqueName: \"kubernetes.io/projected/7ccdf75b-b009-448f-aab0-776c93289ac0-kube-api-access-wgzh5\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.901191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900880 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7301293c-aa7c-499e-865c-59487a34a47e-serving-cert\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900917 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42596\" (UniqueName: \"kubernetes.io/projected/f52a7ac3-de62-4237-b8d8-725fcc942b2d-kube-api-access-42596\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900951 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-config\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.900983 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901035 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901065 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-tmp-dir\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9j6z\" (UniqueName: \"kubernetes.io/projected/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-kube-api-access-l9j6z\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.900808 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.901236 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.401220825 +0000 UTC m=+34.652135723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901375 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-config-volume\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.901980 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.901521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-tmp\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.902663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.902007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7301293c-aa7c-499e-865c-59487a34a47e-config\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.902663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.902107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-trusted-ca\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.902663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.902530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7ccdf75b-b009-448f-aab0-776c93289ac0-snapshots\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.902815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.902686 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:42.902875 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.902850 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f52a7ac3-de62-4237-b8d8-725fcc942b2d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.903056 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.903031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-tmp-dir\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.903142 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.903125 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:42.903204 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:42.903188 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.403172009 +0000 UTC m=+34.654086843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:42.903428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.903379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58c0a118-055a-4aa4-9107-26b53796ad93-config\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.903601 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.903561 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ccdf75b-b009-448f-aab0-776c93289ac0-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.903764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.903746 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7301293c-aa7c-499e-865c-59487a34a47e-serving-cert\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.903764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.903757 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58c0a118-055a-4aa4-9107-26b53796ad93-serving-cert\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.904659 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.904621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-stats-auth\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.905124 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.905095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-default-certificate\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.905506 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.905483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ccdf75b-b009-448f-aab0-776c93289ac0-serving-cert\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.911264 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.911214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8q8\" (UniqueName: \"kubernetes.io/projected/58c0a118-055a-4aa4-9107-26b53796ad93-kube-api-access-ct8q8\") pod \"console-operator-76dff48d59-wxl59\" (UID: \"58c0a118-055a-4aa4-9107-26b53796ad93\") " pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:42.911915 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.911890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42596\" (UniqueName: \"kubernetes.io/projected/f52a7ac3-de62-4237-b8d8-725fcc942b2d-kube-api-access-42596\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:42.912016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.911972 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzh5\" (UniqueName: \"kubernetes.io/projected/7ccdf75b-b009-448f-aab0-776c93289ac0-kube-api-access-wgzh5\") pod \"insights-operator-78bdfb888c-86tf6\" (UID: \"7ccdf75b-b009-448f-aab0-776c93289ac0\") " pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:42.912434 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.912392 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4v95\" (UniqueName: \"kubernetes.io/projected/7301293c-aa7c-499e-865c-59487a34a47e-kube-api-access-r4v95\") pod \"service-ca-operator-57b5b68b8-8bg96\" (UID: \"7301293c-aa7c-499e-865c-59487a34a47e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.912633 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.912600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/2b991597-e3b6-4982-be46-b6a97ded5161-kube-api-access-vlhmm\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:42.913095 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.913054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9j6z\" (UniqueName: \"kubernetes.io/projected/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-kube-api-access-l9j6z\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:42.941749 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.941726 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" May 28 16:02:42.954736 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.954706 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" May 28 16:02:42.977403 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:42.977368 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" May 28 16:02:43.002584 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002552 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.002728 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002592 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:43.002728 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.002700 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:43.002728 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.002716 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:43.002877 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.002737 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:43.002877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002728 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.002877 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.002763 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.502742052 +0000 UTC m=+34.753656891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:43.002877 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.002796 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:43.502779565 +0000 UTC m=+34.753694403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:43.002877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnl4\" (UniqueName: \"kubernetes.io/projected/dc18d335-6a46-4cda-8a3a-b19eca0fdffa-kube-api-access-kgnl4\") pod \"network-check-source-7f44b6dd87-vd8fx\" (UID: \"dc18d335-6a46-4cda-8a3a-b19eca0fdffa\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" May 28 16:02:43.003106 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003106 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.002927 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003106 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003067 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003121 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:43.003253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003164 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/33e463e3-113e-4e69-974c-bdb1b0b889c5-kube-api-access-7xwg9\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:43.003253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003200 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkr6n\" (UniqueName: \"kubernetes.io/projected/16e6f5c3-dc9f-41c5-8648-35e679c765b3-kube-api-access-zkr6n\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.003253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003233 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003253 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.003241 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003260 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6f5c3-dc9f-41c5-8648-35e679c765b3-config\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.003289 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs podName:4bdc9f5c-9530-492c-afee-5c917f830aa4 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:15.0032748 +0000 UTC m=+66.254189648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs") pod "network-metrics-daemon-njpw4" (UID: "4bdc9f5c-9530-492c-afee-5c917f830aa4") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003319 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16e6f5c3-dc9f-41c5-8648-35e679c765b3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003380 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003409 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pc28\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.003878 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003841 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16e6f5c3-dc9f-41c5-8648-35e679c765b3-config\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.004013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.003963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.004229 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.004211 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.005393 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.005373 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:43.005741 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.005720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.005741 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.005733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16e6f5c3-dc9f-41c5-8648-35e679c765b3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.005883 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.005725 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.012372 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.012280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkr6n\" (UniqueName: \"kubernetes.io/projected/16e6f5c3-dc9f-41c5-8648-35e679c765b3-kube-api-access-zkr6n\") pod \"kube-storage-version-migrator-operator-565644f49-bxzf7\" (UID: \"16e6f5c3-dc9f-41c5-8648-35e679c765b3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.012507 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.012486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwg9\" (UniqueName: \"kubernetes.io/projected/33e463e3-113e-4e69-974c-bdb1b0b889c5-kube-api-access-7xwg9\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:43.012910 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.012870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnl4\" (UniqueName: \"kubernetes.io/projected/dc18d335-6a46-4cda-8a3a-b19eca0fdffa-kube-api-access-kgnl4\") pod \"network-check-source-7f44b6dd87-vd8fx\" (UID: \"dc18d335-6a46-4cda-8a3a-b19eca0fdffa\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" May 28 16:02:43.012910 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.012908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.013601 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.013586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pc28\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.047760 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.047727 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" May 28 16:02:43.071627 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.071593 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" May 28 16:02:43.104715 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.104680 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:43.107555 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.107530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjc2f\" (UniqueName: \"kubernetes.io/projected/bb508ca5-6638-48e7-be0c-006c1dad8bb7-kube-api-access-pjc2f\") pod \"network-check-target-xtvnr\" (UID: \"bb508ca5-6638-48e7-be0c-006c1dad8bb7\") " pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:43.306661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.306529 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:43.306661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.306647 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:43.307155 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.306713 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:43.307155 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.306737 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:43.307155 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.306813 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.306792886 +0000 UTC m=+35.557707725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:43.307155 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.306822 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 16:02:43.307155 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.306891 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls podName:5cbbc410-4e29-425e-af49-a432873ffd5a nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.306871522 +0000 UTC m=+35.557786370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls") pod "cluster-samples-operator-697587599-zvxb7" (UID: "5cbbc410-4e29-425e-af49-a432873ffd5a") : secret "samples-operator-tls" not found May 28 16:02:43.408099 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.408060 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.408113 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.408204 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408226 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.408268 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408325 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.408289921 +0000 UTC m=+35.659204779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:43.408342 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408329 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408365 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.408377 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408386 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.408373514 +0000 UTC m=+35.659288349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408241 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408409 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.408396775 +0000 UTC m=+35.659311607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408429 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.408419649 +0000 UTC m=+35.659334482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:43.408586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.408447 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.408438085 +0000 UTC m=+35.659352923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:43.509493 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.509453 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:43.509493 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:43.509501 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:43.509803 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.509583 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:43.509803 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.509584 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:43.509803 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.509707 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:43.509803 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.509764 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.509745443 +0000 UTC m=+35.760660292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:43.509803 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:43.509795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:44.509784768 +0000 UTC m=+35.760699621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:44.305956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.305919 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:44.306170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.305919 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:02:44.310375 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.310343 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66q44\"" May 28 16:02:44.310742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.310561 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 16:02:44.310742 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.310741 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjf64\"" May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.318270 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.318396 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.318561 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.318605 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.318625 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.318633 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls podName:5cbbc410-4e29-425e-af49-a432873ffd5a nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.318614684 +0000 UTC m=+37.569529519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls") pod "cluster-samples-operator-697587599-zvxb7" (UID: "5cbbc410-4e29-425e-af49-a432873ffd5a") : secret "samples-operator-tls" not found May 28 16:02:44.318685 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.318688 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.318660034 +0000 UTC m=+37.569574887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:44.320096 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.319329 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.419637 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.419722 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.419786 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.419852 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.419879 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.420007 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.420071 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.420052106 +0000 UTC m=+37.670966943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.420457 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.420435347 +0000 UTC m=+37.671350191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421044 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421094 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.421079639 +0000 UTC m=+37.671994508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421157 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421186 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.42117548 +0000 UTC m=+37.672090322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421244 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:44.424101 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.421275 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.421265226 +0000 UTC m=+37.672180083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:44.489734 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.489653 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq"] May 28 16:02:44.496470 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.496427 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7db7ec_0d1b_4717_a764_06c0a5a4e3f1.slice/crio-35d44225678dcc1035a9e216277a84a1d1e61dffdb032a46fd283b6938825c56 WatchSource:0}: Error finding container 35d44225678dcc1035a9e216277a84a1d1e61dffdb032a46fd283b6938825c56: Status 404 returned error can't find the container with id 35d44225678dcc1035a9e216277a84a1d1e61dffdb032a46fd283b6938825c56 May 28 16:02:44.502242 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.501913 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-86tf6"] May 28 16:02:44.505140 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.505009 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96"] May 28 16:02:44.507509 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.507438 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wxl59"] May 28 16:02:44.507509 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.507459 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccdf75b_b009_448f_aab0_776c93289ac0.slice/crio-77496cb2daa07186aea9a830d5d03ed5ead6305b7ce7dd8b542448573d38324e WatchSource:0}: Error finding container 77496cb2daa07186aea9a830d5d03ed5ead6305b7ce7dd8b542448573d38324e: Status 404 returned error can't find the container with id 77496cb2daa07186aea9a830d5d03ed5ead6305b7ce7dd8b542448573d38324e May 28 16:02:44.510896 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.510871 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7301293c_aa7c_499e_865c_59487a34a47e.slice/crio-e7bffaba92a03cedeb7206fb495e4a7f4949ddde52fa685365198fa8dc1e6b38 WatchSource:0}: Error finding container e7bffaba92a03cedeb7206fb495e4a7f4949ddde52fa685365198fa8dc1e6b38: Status 404 returned error can't find the container with id e7bffaba92a03cedeb7206fb495e4a7f4949ddde52fa685365198fa8dc1e6b38 May 28 16:02:44.511689 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.511669 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c0a118_055a_4aa4_9107_26b53796ad93.slice/crio-31b08b0f3c5553ca17922fae4499d260dbe1a8f791f5544d1a496333351a49f1 WatchSource:0}: Error finding container 31b08b0f3c5553ca17922fae4499d260dbe1a8f791f5544d1a496333351a49f1: Status 404 returned error can't find the container with id 31b08b0f3c5553ca17922fae4499d260dbe1a8f791f5544d1a496333351a49f1 May 28 16:02:44.520701 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.520678 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx"] May 28 16:02:44.520784 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.520698 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:44.520784 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.520744 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:44.520876 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.520781 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:44.520876 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.520797 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:44.520876 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.520852 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.520833109 +0000 UTC m=+37.771747943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:44.521005 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.520884 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:44.521005 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:44.520932 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:46.520915191 +0000 UTC m=+37.771830029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:44.523408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.523375 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7"] May 28 16:02:44.525704 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.525668 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc18d335_6a46_4cda_8a3a_b19eca0fdffa.slice/crio-0f0dcc3c7ecd19525bb41ca05e8f23efd6ea331c64c40aebcc59e45b1f980c02 WatchSource:0}: Error finding container 0f0dcc3c7ecd19525bb41ca05e8f23efd6ea331c64c40aebcc59e45b1f980c02: Status 404 returned error can't find the container with id 0f0dcc3c7ecd19525bb41ca05e8f23efd6ea331c64c40aebcc59e45b1f980c02 May 28 16:02:44.526257 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.526231 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e6f5c3_dc9f_41c5_8648_35e679c765b3.slice/crio-0f18ae2dc2c3ad636fdce81ae9386b97c139c7b545f2e23b0b5565b1b2fbab13 WatchSource:0}: Error finding container 0f18ae2dc2c3ad636fdce81ae9386b97c139c7b545f2e23b0b5565b1b2fbab13: Status 404 returned error can't find the container with id 0f18ae2dc2c3ad636fdce81ae9386b97c139c7b545f2e23b0b5565b1b2fbab13 May 28 16:02:44.548422 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:44.548109 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtvnr"] May 28 16:02:44.551794 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:44.551769 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb508ca5_6638_48e7_be0c_006c1dad8bb7.slice/crio-3112c468ad9bff07d23a9c65c8537348d257fd9773f937e301ca1c276463beda WatchSource:0}: Error finding container 3112c468ad9bff07d23a9c65c8537348d257fd9773f937e301ca1c276463beda: Status 404 returned error can't find the container with id 3112c468ad9bff07d23a9c65c8537348d257fd9773f937e301ca1c276463beda May 28 16:02:45.491623 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.491555 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" event={"ID":"8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1","Type":"ContainerStarted","Data":"35d44225678dcc1035a9e216277a84a1d1e61dffdb032a46fd283b6938825c56"} May 28 16:02:45.502675 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.501715 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="9ad8755f57104b17e75c14f5d5a19e15f467cc4689c40ffe0bc6a801f615db7c" exitCode=0 May 28 16:02:45.502675 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.501795 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"9ad8755f57104b17e75c14f5d5a19e15f467cc4689c40ffe0bc6a801f615db7c"} May 28 16:02:45.505661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.505554 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtvnr" event={"ID":"bb508ca5-6638-48e7-be0c-006c1dad8bb7","Type":"ContainerStarted","Data":"3112c468ad9bff07d23a9c65c8537348d257fd9773f937e301ca1c276463beda"} May 28 16:02:45.516266 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.516192 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" event={"ID":"58c0a118-055a-4aa4-9107-26b53796ad93","Type":"ContainerStarted","Data":"31b08b0f3c5553ca17922fae4499d260dbe1a8f791f5544d1a496333351a49f1"} May 28 16:02:45.518814 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.518787 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" event={"ID":"7ccdf75b-b009-448f-aab0-776c93289ac0","Type":"ContainerStarted","Data":"77496cb2daa07186aea9a830d5d03ed5ead6305b7ce7dd8b542448573d38324e"} May 28 16:02:45.520757 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.520708 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" event={"ID":"dc18d335-6a46-4cda-8a3a-b19eca0fdffa","Type":"ContainerStarted","Data":"0f0dcc3c7ecd19525bb41ca05e8f23efd6ea331c64c40aebcc59e45b1f980c02"} May 28 16:02:45.523812 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.523172 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" event={"ID":"16e6f5c3-dc9f-41c5-8648-35e679c765b3","Type":"ContainerStarted","Data":"0f18ae2dc2c3ad636fdce81ae9386b97c139c7b545f2e23b0b5565b1b2fbab13"} May 28 16:02:45.529073 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:45.529035 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" event={"ID":"7301293c-aa7c-499e-865c-59487a34a47e","Type":"ContainerStarted","Data":"e7bffaba92a03cedeb7206fb495e4a7f4949ddde52fa685365198fa8dc1e6b38"} May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.340421 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.340568 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.340798 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.340870 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls podName:5cbbc410-4e29-425e-af49-a432873ffd5a nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.340844637 +0000 UTC m=+41.591759490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls") pod "cluster-samples-operator-697587599-zvxb7" (UID: "5cbbc410-4e29-425e-af49-a432873ffd5a") : secret "samples-operator-tls" not found May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.341334 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.341353 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:46.341446 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.341407 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.341390176 +0000 UTC m=+41.592305021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.441495 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.441564 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.441593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.441688 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.441746 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.441910 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:46.442326 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.441979 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.441954416 +0000 UTC m=+41.692869253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443160 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443221 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.443203808 +0000 UTC m=+41.694118640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443318 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443359 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.443346832 +0000 UTC m=+41.694261680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443449 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.443437017 +0000 UTC m=+41.694351851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:46.443487 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443481 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:46.443888 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.443529 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.443519002 +0000 UTC m=+41.694433840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:46.542585 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.542548 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.542598 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.542812 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.542870 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.542852869 +0000 UTC m=+41.793767721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.542930 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.542943 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:46.543148 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:46.542980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:50.542967917 +0000 UTC m=+41.793882769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:46.560363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.558512 2575 generic.go:358] "Generic (PLEG): container finished" podID="cb6981b3-4b8b-44b9-bc69-f48d8b118884" containerID="2c3741988d0921ac3162053e6329cdf4acab80adcaca2f2c56e5dffc832dc5ad" exitCode=0 May 28 16:02:46.560363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:46.558573 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerDied","Data":"2c3741988d0921ac3162053e6329cdf4acab80adcaca2f2c56e5dffc832dc5ad"} May 28 16:02:50.379260 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.379219 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.379342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.379401 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.379418 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.379475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.379456925 +0000 UTC m=+49.630371780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.379493 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 16:02:50.379855 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.379561 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls podName:5cbbc410-4e29-425e-af49-a432873ffd5a nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.379543573 +0000 UTC m=+49.630458409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls") pod "cluster-samples-operator-697587599-zvxb7" (UID: "5cbbc410-4e29-425e-af49-a432873ffd5a") : secret "samples-operator-tls" not found May 28 16:02:50.480039 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.479986 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:50.480226 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.480062 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:50.480226 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.480113 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:50.480226 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.480164 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:50.480226 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.480184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480161 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480266 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.480250529 +0000 UTC m=+49.731165381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480289 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.480281216 +0000 UTC m=+49.731196050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480219 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480324 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480339 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.480332032 +0000 UTC m=+49.731246864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480269 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480383 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.480365666 +0000 UTC m=+49.731280501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:50.480478 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.480402 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.480392497 +0000 UTC m=+49.731307332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:50.581387 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.581352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:50.581584 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:50.581401 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:50.581584 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.581490 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:50.581584 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.581511 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:50.581584 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.581527 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:50.581584 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.581576 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.581558312 +0000 UTC m=+49.832473146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:50.581812 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:50.581597 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:58.581588644 +0000 UTC m=+49.832503493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:51.572113 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.572079 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" event={"ID":"8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1","Type":"ContainerStarted","Data":"3c43e914524e614124bf2bf4396f58e831c558a8235c11e9c28389bbfd09bb38"} May 28 16:02:51.576374 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.576334 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" event={"ID":"cb6981b3-4b8b-44b9-bc69-f48d8b118884","Type":"ContainerStarted","Data":"bc343ec7c69466b92b2c46c7ac28113a5ca5b8e540970f443675f98a736362fe"} May 28 16:02:51.579803 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.579777 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" event={"ID":"16e6f5c3-dc9f-41c5-8648-35e679c765b3","Type":"ContainerStarted","Data":"ef5713131c3788f17bdf6bc946d9d8d52c35617bf6c127e1800ab14417c94eb1"} May 28 16:02:51.581193 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.581170 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" event={"ID":"7301293c-aa7c-499e-865c-59487a34a47e","Type":"ContainerStarted","Data":"7870902863e99f4d5d69284aa68fd833e8e7a78136f2adf352a6f66b47b0dc73"} May 28 16:02:51.587713 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.587652 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-qmzgq" podStartSLOduration=13.865605041 podStartE2EDuration="20.587634525s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.498927194 +0000 UTC m=+35.749842041" lastFinishedPulling="2026-05-28 16:02:51.22095668 +0000 UTC m=+42.471871525" observedRunningTime="2026-05-28 16:02:51.586136968 +0000 UTC m=+42.837051823" watchObservedRunningTime="2026-05-28 16:02:51.587634525 +0000 UTC m=+42.838549380" May 28 16:02:51.630654 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.630595 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9kcpf" podStartSLOduration=9.70503551 podStartE2EDuration="42.630576651s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.582474882 +0000 UTC m=+2.833389719" lastFinishedPulling="2026-05-28 16:02:44.50801602 +0000 UTC m=+35.758930860" observedRunningTime="2026-05-28 16:02:51.612580219 +0000 UTC m=+42.863495072" watchObservedRunningTime="2026-05-28 16:02:51.630576651 +0000 UTC m=+42.881491507" May 28 16:02:51.652349 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:51.650506 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" podStartSLOduration=13.945361141 podStartE2EDuration="20.650486504s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.515653417 +0000 UTC m=+35.766568263" lastFinishedPulling="2026-05-28 16:02:51.220778778 +0000 UTC m=+42.471693626" observedRunningTime="2026-05-28 16:02:51.631292899 +0000 UTC m=+42.882207755" watchObservedRunningTime="2026-05-28 16:02:51.650486504 +0000 UTC m=+42.901401361" May 28 16:02:52.586698 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.586651 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" event={"ID":"dc18d335-6a46-4cda-8a3a-b19eca0fdffa","Type":"ContainerStarted","Data":"e1a98e39c945fdb6342b4a08fb0ac6e21859f1a5852e0089a1d19a4a2fe8853e"} May 28 16:02:52.594764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.594725 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtvnr" event={"ID":"bb508ca5-6638-48e7-be0c-006c1dad8bb7","Type":"ContainerStarted","Data":"95246648920a385d44cdce6ca5e8d9fbac0e750032b10114b652087b28b87d2e"} May 28 16:02:52.594920 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.594879 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:02:52.596545 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.596520 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/0.log" May 28 16:02:52.596682 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.596560 2575 generic.go:358] "Generic (PLEG): container finished" podID="58c0a118-055a-4aa4-9107-26b53796ad93" containerID="b56ed9729e7ababb22a05de25f979b99291e0fd65febdf6ff9fbd15d08935d4e" exitCode=255 May 28 16:02:52.596682 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.596634 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" event={"ID":"58c0a118-055a-4aa4-9107-26b53796ad93","Type":"ContainerDied","Data":"b56ed9729e7ababb22a05de25f979b99291e0fd65febdf6ff9fbd15d08935d4e"} May 28 16:02:52.597272 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.597254 2575 scope.go:117] "RemoveContainer" containerID="b56ed9729e7ababb22a05de25f979b99291e0fd65febdf6ff9fbd15d08935d4e" May 28 16:02:52.598312 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.598273 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" event={"ID":"7ccdf75b-b009-448f-aab0-776c93289ac0","Type":"ContainerStarted","Data":"847d6acb7cf85a1f44a3b9fba399e38fbbc8d9c7941f0dcf6e4bbe6c6dad1c03"} May 28 16:02:52.601571 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.601522 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" podStartSLOduration=14.909037408 podStartE2EDuration="21.601507844s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.528592193 +0000 UTC m=+35.779507028" lastFinishedPulling="2026-05-28 16:02:51.221062628 +0000 UTC m=+42.471977464" observedRunningTime="2026-05-28 16:02:51.652193727 +0000 UTC m=+42.903108599" watchObservedRunningTime="2026-05-28 16:02:52.601507844 +0000 UTC m=+43.852422701" May 28 16:02:52.601683 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.601623 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vd8fx" podStartSLOduration=14.89869032 podStartE2EDuration="21.601618712s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.527408023 +0000 UTC m=+35.778322863" lastFinishedPulling="2026-05-28 16:02:51.230336422 +0000 UTC m=+42.481251255" observedRunningTime="2026-05-28 16:02:52.600959096 +0000 UTC m=+43.851873954" watchObservedRunningTime="2026-05-28 16:02:52.601618712 +0000 UTC m=+43.852533568" May 28 16:02:52.617098 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.617056 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" podStartSLOduration=14.905645422 podStartE2EDuration="21.61704373s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.510090283 +0000 UTC m=+35.761005119" lastFinishedPulling="2026-05-28 16:02:51.221488589 +0000 UTC m=+42.472403427" observedRunningTime="2026-05-28 16:02:52.615879771 +0000 UTC m=+43.866794625" watchObservedRunningTime="2026-05-28 16:02:52.61704373 +0000 UTC m=+43.867958584" May 28 16:02:52.650859 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:52.650807 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xtvnr" podStartSLOduration=36.706038232 podStartE2EDuration="43.650789169s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.554087311 +0000 UTC m=+35.805002143" lastFinishedPulling="2026-05-28 16:02:51.498838236 +0000 UTC m=+42.749753080" observedRunningTime="2026-05-28 16:02:52.64939373 +0000 UTC m=+43.900308586" watchObservedRunningTime="2026-05-28 16:02:52.650789169 +0000 UTC m=+43.901704026" May 28 16:02:53.005595 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.005508 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:53.005595 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.005551 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:02:53.115770 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.115734 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b"] May 28 16:02:53.142069 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.142036 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b"] May 28 16:02:53.142220 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.142168 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" May 28 16:02:53.144426 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.144402 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 16:02:53.144426 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.144416 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 16:02:53.144591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.144464 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r6hdx\"" May 28 16:02:53.207014 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.206969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgl4c\" (UniqueName: \"kubernetes.io/projected/bcee752e-a57b-4a5f-8feb-6898f0fda42c-kube-api-access-bgl4c\") pod \"migrator-b985f5d89-7vl9b\" (UID: \"bcee752e-a57b-4a5f-8feb-6898f0fda42c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" May 28 16:02:53.307537 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.307450 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgl4c\" (UniqueName: \"kubernetes.io/projected/bcee752e-a57b-4a5f-8feb-6898f0fda42c-kube-api-access-bgl4c\") pod \"migrator-b985f5d89-7vl9b\" (UID: \"bcee752e-a57b-4a5f-8feb-6898f0fda42c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" May 28 16:02:53.316671 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.316644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgl4c\" (UniqueName: \"kubernetes.io/projected/bcee752e-a57b-4a5f-8feb-6898f0fda42c-kube-api-access-bgl4c\") pod \"migrator-b985f5d89-7vl9b\" (UID: \"bcee752e-a57b-4a5f-8feb-6898f0fda42c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" May 28 16:02:53.451409 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.451378 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" May 28 16:02:53.572441 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.572410 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b"] May 28 16:02:53.575338 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:53.575312 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcee752e_a57b_4a5f_8feb_6898f0fda42c.slice/crio-81cf1896b7adcf18b724e853cc93666471471243ad1f60883250a966d1073909 WatchSource:0}: Error finding container 81cf1896b7adcf18b724e853cc93666471471243ad1f60883250a966d1073909: Status 404 returned error can't find the container with id 81cf1896b7adcf18b724e853cc93666471471243ad1f60883250a966d1073909 May 28 16:02:53.603928 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.603895 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" event={"ID":"bcee752e-a57b-4a5f-8feb-6898f0fda42c","Type":"ContainerStarted","Data":"81cf1896b7adcf18b724e853cc93666471471243ad1f60883250a966d1073909"} May 28 16:02:53.605209 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605193 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:02:53.605569 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605555 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/0.log" May 28 16:02:53.605651 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605586 2575 generic.go:358] "Generic (PLEG): container finished" podID="58c0a118-055a-4aa4-9107-26b53796ad93" containerID="516b977916b8edd44e1ebf2a5e210266130c1333fd20da70dbea2bd83dc8a9a8" exitCode=255 May 28 16:02:53.605715 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605693 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" event={"ID":"58c0a118-055a-4aa4-9107-26b53796ad93","Type":"ContainerDied","Data":"516b977916b8edd44e1ebf2a5e210266130c1333fd20da70dbea2bd83dc8a9a8"} May 28 16:02:53.605768 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605735 2575 scope.go:117] "RemoveContainer" containerID="b56ed9729e7ababb22a05de25f979b99291e0fd65febdf6ff9fbd15d08935d4e" May 28 16:02:53.605972 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.605956 2575 scope.go:117] "RemoveContainer" containerID="516b977916b8edd44e1ebf2a5e210266130c1333fd20da70dbea2bd83dc8a9a8" May 28 16:02:53.606173 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:53.606152 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-wxl59_openshift-console-operator(58c0a118-055a-4aa4-9107-26b53796ad93)\"" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" podUID="58c0a118-055a-4aa4-9107-26b53796ad93" May 28 16:02:53.688782 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:53.688756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntrj8_71a02dd1-1758-41d7-98b9-cb335cfd49a6/dns-node-resolver/0.log" May 28 16:02:54.288351 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:54.288324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jtlv5_2141721f-b955-4f96-b756-5c000b93280d/node-ca/0.log" May 28 16:02:54.610579 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:54.610551 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:02:54.610994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:54.610973 2575 scope.go:117] "RemoveContainer" containerID="516b977916b8edd44e1ebf2a5e210266130c1333fd20da70dbea2bd83dc8a9a8" May 28 16:02:54.611211 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:54.611189 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-wxl59_openshift-console-operator(58c0a118-055a-4aa4-9107-26b53796ad93)\"" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" podUID="58c0a118-055a-4aa4-9107-26b53796ad93" May 28 16:02:55.046941 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.046852 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zsv26"] May 28 16:02:55.077694 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.077661 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zsv26"] May 28 16:02:55.077845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.077815 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.080653 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.080627 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 28 16:02:55.081029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.080877 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 28 16:02:55.081029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.080961 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 28 16:02:55.081029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.081000 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 28 16:02:55.081228 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.081080 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kr6lj\"" May 28 16:02:55.121846 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.121808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-cabundle\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.122029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.121925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzt2\" (UniqueName: \"kubernetes.io/projected/9ad84427-250f-470f-8ade-73c9505dbaa3-kube-api-access-hnzt2\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.122029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.121977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-key\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.222827 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.222784 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-cabundle\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.223019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.222856 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzt2\" (UniqueName: \"kubernetes.io/projected/9ad84427-250f-470f-8ade-73c9505dbaa3-kube-api-access-hnzt2\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.223019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.222890 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-key\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.223655 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.223627 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-cabundle\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.225855 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.225825 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ad84427-250f-470f-8ade-73c9505dbaa3-signing-key\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.232526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.232498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzt2\" (UniqueName: \"kubernetes.io/projected/9ad84427-250f-470f-8ade-73c9505dbaa3-kube-api-access-hnzt2\") pod \"service-ca-67d667c7d-zsv26\" (UID: \"9ad84427-250f-470f-8ade-73c9505dbaa3\") " pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.389753 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.389716 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zsv26" May 28 16:02:55.527514 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.527482 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zsv26"] May 28 16:02:55.593045 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:02:55.593015 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad84427_250f_470f_8ade_73c9505dbaa3.slice/crio-b70b8011133b8f2461f112cc8ee016126b33473743ae539169e384709c15da07 WatchSource:0}: Error finding container b70b8011133b8f2461f112cc8ee016126b33473743ae539169e384709c15da07: Status 404 returned error can't find the container with id b70b8011133b8f2461f112cc8ee016126b33473743ae539169e384709c15da07 May 28 16:02:55.614275 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:55.614241 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zsv26" event={"ID":"9ad84427-250f-470f-8ade-73c9505dbaa3","Type":"ContainerStarted","Data":"b70b8011133b8f2461f112cc8ee016126b33473743ae539169e384709c15da07"} May 28 16:02:56.618534 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:56.618498 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zsv26" event={"ID":"9ad84427-250f-470f-8ade-73c9505dbaa3","Type":"ContainerStarted","Data":"e13e777c0d6c980bdbac013684205446b98fab24b962d1f3d0ac5a26594d8c43"} May 28 16:02:56.620104 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:56.620078 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" event={"ID":"bcee752e-a57b-4a5f-8feb-6898f0fda42c","Type":"ContainerStarted","Data":"fab48cbd245301f42e0ae4e44bce5335fa4c7a64eeb81c5571199e3a2d5a1432"} May 28 16:02:56.620198 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:56.620111 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" event={"ID":"bcee752e-a57b-4a5f-8feb-6898f0fda42c","Type":"ContainerStarted","Data":"71ae754ed36159baa31d8618bbda176df566e33cde5248a95b845c4479966612"} May 28 16:02:56.638721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:56.638677 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-zsv26" podStartSLOduration=1.6386623120000001 podStartE2EDuration="1.638662312s" podCreationTimestamp="2026-05-28 16:02:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:56.638232337 +0000 UTC m=+47.889147445" watchObservedRunningTime="2026-05-28 16:02:56.638662312 +0000 UTC m=+47.889577167" May 28 16:02:58.454064 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.454016 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:58.454530 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.454172 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:02:58.454530 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.454330 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:58.454530 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.454355 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c447d6448-qr5kc: secret "image-registry-tls" not found May 28 16:02:58.454530 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.454413 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls podName:82a72019-5c77-4ead-8939-d55510533bcb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.454398473 +0000 UTC m=+65.705313306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls") pod "image-registry-5c447d6448-qr5kc" (UID: "82a72019-5c77-4ead-8939-d55510533bcb") : secret "image-registry-tls" not found May 28 16:02:58.456458 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.456440 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbbc410-4e29-425e-af49-a432873ffd5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zvxb7\" (UID: \"5cbbc410-4e29-425e-af49-a432873ffd5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:58.529861 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.529823 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" May 28 16:02:58.554995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.554961 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:02:58.555117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.555020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:02:58.555117 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555111 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 16:02:58.555205 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555138 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 16:02:58.555205 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555184 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls podName:6554cc8a-2ea1-44b7-ba35-084707c1d3bd nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.555170791 +0000 UTC m=+65.806085643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls") pod "dns-default-247qz" (UID: "6554cc8a-2ea1-44b7-ba35-084707c1d3bd") : secret "dns-default-metrics-tls" not found May 28 16:02:58.555316 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert podName:7e761cb6-3403-43ee-8509-6c31f7b4b6fc nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.555190727 +0000 UTC m=+65.806105584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-l5jkr" (UID: "7e761cb6-3403-43ee-8509-6c31f7b4b6fc") : secret "networking-console-plugin-cert" not found May 28 16:02:58.555316 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.555240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:58.555397 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.555331 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:02:58.555397 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555348 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.555334956 +0000 UTC m=+65.806249805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : configmap references non-existent config key: service-ca.crt May 28 16:02:58.555397 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.555384 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:02:58.555503 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555400 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 16:02:58.555503 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555439 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs podName:2b991597-e3b6-4982-be46-b6a97ded5161 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.555426308 +0000 UTC m=+65.806341155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs") pod "router-default-5fdf595458-kqvgd" (UID: "2b991597-e3b6-4982-be46-b6a97ded5161") : secret "router-metrics-certs-default" not found May 28 16:02:58.555503 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555475 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 16:02:58.555615 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.555518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls podName:f52a7ac3-de62-4237-b8d8-725fcc942b2d nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.555505638 +0000 UTC m=+65.806420470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ksv6t" (UID: "f52a7ac3-de62-4237-b8d8-725fcc942b2d") : secret "cluster-monitoring-operator-tls" not found May 28 16:02:58.656512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.656477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:02:58.656512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.656515 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:02:58.656738 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.656644 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 16:02:58.656738 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.656651 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 16:02:58.656738 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.656676 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59cff65f5f-nzdns: secret "image-registry-tls" not found May 28 16:02:58.656738 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.656701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert podName:33e463e3-113e-4e69-974c-bdb1b0b889c5 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.65668751 +0000 UTC m=+65.907602342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert") pod "ingress-canary-6g8g4" (UID: "33e463e3-113e-4e69-974c-bdb1b0b889c5") : secret "canary-serving-cert" not found May 28 16:02:58.656738 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:02:58.656729 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls podName:b7cce9e3-34d0-4a18-891f-40a5d671bffb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:14.656712069 +0000 UTC m=+65.907626908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls") pod "image-registry-59cff65f5f-nzdns" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb") : secret "image-registry-tls" not found May 28 16:02:58.660439 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.660183 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7vl9b" podStartSLOduration=3.619121066 podStartE2EDuration="5.660165246s" podCreationTimestamp="2026-05-28 16:02:53 +0000 UTC" firstStartedPulling="2026-05-28 16:02:53.577343984 +0000 UTC m=+44.828258820" lastFinishedPulling="2026-05-28 16:02:55.618388164 +0000 UTC m=+46.869303000" observedRunningTime="2026-05-28 16:02:56.653811055 +0000 UTC m=+47.904725910" watchObservedRunningTime="2026-05-28 16:02:58.660165246 +0000 UTC m=+49.911080104" May 28 16:02:58.661400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:58.661379 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7"] May 28 16:02:59.629475 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:02:59.629439 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" event={"ID":"5cbbc410-4e29-425e-af49-a432873ffd5a","Type":"ContainerStarted","Data":"11612b2acc478610184dba949499db0610995ff480a7b2cca85ca9dfb33f4442"} May 28 16:03:01.637532 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:01.637492 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" event={"ID":"5cbbc410-4e29-425e-af49-a432873ffd5a","Type":"ContainerStarted","Data":"830a7a2c0d1184256559fde7ca570c4e5aa36fcfdbbf5066399aca47c5a88444"} May 28 16:03:01.637532 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:01.637530 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" event={"ID":"5cbbc410-4e29-425e-af49-a432873ffd5a","Type":"ContainerStarted","Data":"143fe6393b7d2ff8860c6d8155d9652459d18450bd305da10b16307b35dbae14"} May 28 16:03:01.655288 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:01.655240 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zvxb7" podStartSLOduration=28.708463053 podStartE2EDuration="30.655226314s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:58.730428858 +0000 UTC m=+49.981343695" lastFinishedPulling="2026-05-28 16:03:00.677192119 +0000 UTC m=+51.928106956" observedRunningTime="2026-05-28 16:03:01.654325437 +0000 UTC m=+52.905240292" watchObservedRunningTime="2026-05-28 16:03:01.655226314 +0000 UTC m=+52.906141169" May 28 16:03:03.006138 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.006097 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:03:03.006579 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.006151 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:03:03.006579 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.006569 2575 scope.go:117] "RemoveContainer" containerID="516b977916b8edd44e1ebf2a5e210266130c1333fd20da70dbea2bd83dc8a9a8" May 28 16:03:03.644904 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.644873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:03:03.645074 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.644963 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" event={"ID":"58c0a118-055a-4aa4-9107-26b53796ad93","Type":"ContainerStarted","Data":"c0ca0ba141c2cd27b1df0e82194b82e344ec18496f34990c4555ad01adedea3d"} May 28 16:03:03.645240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.645219 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:03:03.662161 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.662108 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" podStartSLOduration=25.95673838 podStartE2EDuration="32.662090663s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:02:44.515531645 +0000 UTC m=+35.766446483" lastFinishedPulling="2026-05-28 16:02:51.220883929 +0000 UTC m=+42.471798766" observedRunningTime="2026-05-28 16:03:03.661649394 +0000 UTC m=+54.912564250" watchObservedRunningTime="2026-05-28 16:03:03.662090663 +0000 UTC m=+54.913005515" May 28 16:03:03.911622 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:03.911549 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-wxl59" May 28 16:03:07.479735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:07.479706 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk672" May 28 16:03:14.491120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.491076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:03:14.493505 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.493471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"image-registry-5c447d6448-qr5kc\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:03:14.591722 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.591678 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:14.591934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.591733 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:14.591934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.591757 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:03:14.591934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.591825 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:03:14.591934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.591879 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:03:14.592531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.592500 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b991597-e3b6-4982-be46-b6a97ded5161-service-ca-bundle\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:14.594335 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.594284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6554cc8a-2ea1-44b7-ba35-084707c1d3bd-metrics-tls\") pod \"dns-default-247qz\" (UID: \"6554cc8a-2ea1-44b7-ba35-084707c1d3bd\") " pod="openshift-dns/dns-default-247qz" May 28 16:03:14.594335 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.594322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b991597-e3b6-4982-be46-b6a97ded5161-metrics-certs\") pod \"router-default-5fdf595458-kqvgd\" (UID: \"2b991597-e3b6-4982-be46-b6a97ded5161\") " pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:14.594467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.594284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e761cb6-3403-43ee-8509-6c31f7b4b6fc-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-l5jkr\" (UID: \"7e761cb6-3403-43ee-8509-6c31f7b4b6fc\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:03:14.594467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.594420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f52a7ac3-de62-4237-b8d8-725fcc942b2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ksv6t\" (UID: \"f52a7ac3-de62-4237-b8d8-725fcc942b2d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:03:14.692492 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.692452 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:14.692492 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.692496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:03:14.694929 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.694901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e463e3-113e-4e69-974c-bdb1b0b889c5-cert\") pod \"ingress-canary-6g8g4\" (UID: \"33e463e3-113e-4e69-974c-bdb1b0b889c5\") " pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:03:14.695049 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.695000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"image-registry-59cff65f5f-nzdns\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:14.711405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.711375 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4zxf5\"" May 28 16:03:14.719453 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.719430 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:03:14.749465 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.749382 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t4zxg\"" May 28 16:03:14.757225 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.757196 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" May 28 16:03:14.781145 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.781078 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bzcj6\"" May 28 16:03:14.789061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.789032 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" May 28 16:03:14.796136 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.796111 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cq7wp\"" May 28 16:03:14.804219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.804122 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-247qz" May 28 16:03:14.823119 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.823089 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4j855\"" May 28 16:03:14.830687 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.830585 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:14.838833 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.838791 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-whswg\"" May 28 16:03:14.846820 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.846795 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6g8g4" May 28 16:03:14.858540 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.858310 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:14.862256 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.862208 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:03:14.872134 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:14.872102 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a72019_5c77_4ead_8939_d55510533bcb.slice/crio-86f2eb100fa6aa9b601bbc499f0c3965b41fef713da3a06967e132ea7001d924 WatchSource:0}: Error finding container 86f2eb100fa6aa9b601bbc499f0c3965b41fef713da3a06967e132ea7001d924: Status 404 returned error can't find the container with id 86f2eb100fa6aa9b601bbc499f0c3965b41fef713da3a06967e132ea7001d924 May 28 16:03:14.931902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.931232 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr"] May 28 16:03:14.991653 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:14.991575 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t"] May 28 16:03:14.999924 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:14.999855 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52a7ac3_de62_4237_b8d8_725fcc942b2d.slice/crio-b003d4a61259ab4bad641bf01c17f4daa35ea94a2cb1c429a7dc96342cc2e1ef WatchSource:0}: Error finding container b003d4a61259ab4bad641bf01c17f4daa35ea94a2cb1c429a7dc96342cc2e1ef: Status 404 returned error can't find the container with id b003d4a61259ab4bad641bf01c17f4daa35ea94a2cb1c429a7dc96342cc2e1ef May 28 16:03:15.009798 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.008925 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-247qz"] May 28 16:03:15.012780 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:15.012726 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6554cc8a_2ea1_44b7_ba35_084707c1d3bd.slice/crio-1f5f1c7a66ba799e8828aad25b3bf10cae2d3d226316ce3f4560b0866136a5cd WatchSource:0}: Error finding container 1f5f1c7a66ba799e8828aad25b3bf10cae2d3d226316ce3f4560b0866136a5cd: Status 404 returned error can't find the container with id 1f5f1c7a66ba799e8828aad25b3bf10cae2d3d226316ce3f4560b0866136a5cd May 28 16:03:15.043031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.042998 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fdf595458-kqvgd"] May 28 16:03:15.050014 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:15.049967 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b991597_e3b6_4982_be46_b6a97ded5161.slice/crio-01db5aec8e8bfd865ef3e5255316530521bad9eeedc474258d5ac8321288ceb4 WatchSource:0}: Error finding container 01db5aec8e8bfd865ef3e5255316530521bad9eeedc474258d5ac8321288ceb4: Status 404 returned error can't find the container with id 01db5aec8e8bfd865ef3e5255316530521bad9eeedc474258d5ac8321288ceb4 May 28 16:03:15.059392 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.059361 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6g8g4"] May 28 16:03:15.061959 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:15.061935 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e463e3_113e_4e69_974c_bdb1b0b889c5.slice/crio-3f72dc731cc9e423da9e3d7eeaf11e186b822bb27007fdcfd5a8bf8ad4a0e769 WatchSource:0}: Error finding container 3f72dc731cc9e423da9e3d7eeaf11e186b822bb27007fdcfd5a8bf8ad4a0e769: Status 404 returned error can't find the container with id 3f72dc731cc9e423da9e3d7eeaf11e186b822bb27007fdcfd5a8bf8ad4a0e769 May 28 16:03:15.087262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.087233 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:03:15.090928 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:15.090904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cce9e3_34d0_4a18_891f_40a5d671bffb.slice/crio-14a0b78e9754610729774ae81c40c4e64df0a40ea914e2ca1247ecb813ecf007 WatchSource:0}: Error finding container 14a0b78e9754610729774ae81c40c4e64df0a40ea914e2ca1247ecb813ecf007: Status 404 returned error can't find the container with id 14a0b78e9754610729774ae81c40c4e64df0a40ea914e2ca1247ecb813ecf007 May 28 16:03:15.099979 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.099955 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:03:15.102251 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.102235 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 16:03:15.113167 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.113137 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bdc9f5c-9530-492c-afee-5c917f830aa4-metrics-certs\") pod \"network-metrics-daemon-njpw4\" (UID: \"4bdc9f5c-9530-492c-afee-5c917f830aa4\") " pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:03:15.239428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.239397 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjf64\"" May 28 16:03:15.247476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.247446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njpw4" May 28 16:03:15.433165 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.433104 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njpw4"] May 28 16:03:15.437590 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:15.437563 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdc9f5c_9530_492c_afee_5c917f830aa4.slice/crio-063f6793745303e1152490201e66bd9a952a825d8ce323f6740dfeaf53238bcc WatchSource:0}: Error finding container 063f6793745303e1152490201e66bd9a952a825d8ce323f6740dfeaf53238bcc: Status 404 returned error can't find the container with id 063f6793745303e1152490201e66bd9a952a825d8ce323f6740dfeaf53238bcc May 28 16:03:15.685602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.685515 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fdf595458-kqvgd" event={"ID":"2b991597-e3b6-4982-be46-b6a97ded5161","Type":"ContainerStarted","Data":"66db5ab917401fdb5d54d64bf83a202ac2521fd094909f4ad8c0b4f278be2f5c"} May 28 16:03:15.685602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.685560 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fdf595458-kqvgd" event={"ID":"2b991597-e3b6-4982-be46-b6a97ded5161","Type":"ContainerStarted","Data":"01db5aec8e8bfd865ef3e5255316530521bad9eeedc474258d5ac8321288ceb4"} May 28 16:03:15.687919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.687882 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-247qz" event={"ID":"6554cc8a-2ea1-44b7-ba35-084707c1d3bd","Type":"ContainerStarted","Data":"1f5f1c7a66ba799e8828aad25b3bf10cae2d3d226316ce3f4560b0866136a5cd"} May 28 16:03:15.690913 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.690854 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njpw4" event={"ID":"4bdc9f5c-9530-492c-afee-5c917f830aa4","Type":"ContainerStarted","Data":"063f6793745303e1152490201e66bd9a952a825d8ce323f6740dfeaf53238bcc"} May 28 16:03:15.693135 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.693085 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6g8g4" event={"ID":"33e463e3-113e-4e69-974c-bdb1b0b889c5","Type":"ContainerStarted","Data":"3f72dc731cc9e423da9e3d7eeaf11e186b822bb27007fdcfd5a8bf8ad4a0e769"} May 28 16:03:15.694730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.694685 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" event={"ID":"82a72019-5c77-4ead-8939-d55510533bcb","Type":"ContainerStarted","Data":"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22"} May 28 16:03:15.694730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.694712 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" event={"ID":"82a72019-5c77-4ead-8939-d55510533bcb","Type":"ContainerStarted","Data":"86f2eb100fa6aa9b601bbc499f0c3965b41fef713da3a06967e132ea7001d924"} May 28 16:03:15.695332 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.695267 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:03:15.696908 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.696846 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" event={"ID":"b7cce9e3-34d0-4a18-891f-40a5d671bffb","Type":"ContainerStarted","Data":"06599eb18eef1554c1922734357254d4076ea575613d6b8aea46ad501fec25e2"} May 28 16:03:15.696908 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.696875 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" event={"ID":"b7cce9e3-34d0-4a18-891f-40a5d671bffb","Type":"ContainerStarted","Data":"14a0b78e9754610729774ae81c40c4e64df0a40ea914e2ca1247ecb813ecf007"} May 28 16:03:15.698050 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.698008 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" event={"ID":"f52a7ac3-de62-4237-b8d8-725fcc942b2d","Type":"ContainerStarted","Data":"b003d4a61259ab4bad641bf01c17f4daa35ea94a2cb1c429a7dc96342cc2e1ef"} May 28 16:03:15.699402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.699325 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" event={"ID":"7e761cb6-3403-43ee-8509-6c31f7b4b6fc","Type":"ContainerStarted","Data":"9b86a0aa39f711895ccccde977872e15eaa12e9b3c25d8f12f4dec96c7d43ac3"} May 28 16:03:15.706786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.706739 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5fdf595458-kqvgd" podStartSLOduration=44.706722996 podStartE2EDuration="44.706722996s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:15.705428363 +0000 UTC m=+66.956343221" watchObservedRunningTime="2026-05-28 16:03:15.706722996 +0000 UTC m=+66.957637857" May 28 16:03:15.725328 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.725260 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" podStartSLOduration=40.725243019 podStartE2EDuration="40.725243019s" podCreationTimestamp="2026-05-28 16:02:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:15.72447471 +0000 UTC m=+66.975389567" watchObservedRunningTime="2026-05-28 16:03:15.725243019 +0000 UTC m=+66.976157871" May 28 16:03:15.744576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.744015 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" podStartSLOduration=65.743993333 podStartE2EDuration="1m5.743993333s" podCreationTimestamp="2026-05-28 16:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:15.742050563 +0000 UTC m=+66.992965422" watchObservedRunningTime="2026-05-28 16:03:15.743993333 +0000 UTC m=+66.994908190" May 28 16:03:15.831641 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.831585 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:15.834414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:15.834387 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:16.702649 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:16.702588 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:16.702649 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:16.702634 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:16.704199 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:16.704171 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5fdf595458-kqvgd" May 28 16:03:17.060739 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.060653 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf"] May 28 16:03:17.065566 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.065537 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx"] May 28 16:03:17.065715 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.065672 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.068061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.068022 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p7577\"" May 28 16:03:17.068278 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.068260 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 28 16:03:17.068730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.068704 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7"] May 28 16:03:17.068816 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.068785 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 28 16:03:17.068877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.068823 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 28 16:03:17.069090 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.069058 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 28 16:03:17.069188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.069116 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.072097 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.072077 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.074029 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.073891 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 28 16:03:17.075485 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.075461 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 28 16:03:17.075655 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.075633 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 28 16:03:17.075744 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.075645 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 28 16:03:17.075804 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.075747 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 28 16:03:17.084634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.084597 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf"] May 28 16:03:17.086375 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.086341 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7"] May 28 16:03:17.087967 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.087948 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx"] May 28 16:03:17.118141 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118111 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:03:17.118379 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g588\" (UniqueName: \"kubernetes.io/projected/8280226c-a372-4baa-a4a8-c3946267e1d0-kube-api-access-2g588\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.118448 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a14b4d0-72f5-464e-b028-023b7b5830dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.118507 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk5hd\" (UniqueName: \"kubernetes.io/projected/2a14b4d0-72f5-464e-b028-023b7b5830dd-kube-api-access-zk5hd\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.118594 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8280226c-a372-4baa-a4a8-c3946267e1d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.118659 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.118644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8280226c-a372-4baa-a4a8-c3946267e1d0-tmp\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.175812 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.175779 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-6r8t6"] May 28 16:03:17.179013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.178989 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:17.181629 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.181604 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mlctn\"" May 28 16:03:17.182058 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.182007 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 16:03:17.182310 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.182277 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 16:03:17.192816 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.192209 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6r8t6"] May 28 16:03:17.219242 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.219427 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219265 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2g588\" (UniqueName: \"kubernetes.io/projected/8280226c-a372-4baa-a4a8-c3946267e1d0-kube-api-access-2g588\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.219427 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219348 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a14b4d0-72f5-464e-b028-023b7b5830dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219497 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zk5hd\" (UniqueName: \"kubernetes.io/projected/2a14b4d0-72f5-464e-b028-023b7b5830dd-kube-api-access-zk5hd\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219595 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8280226c-a372-4baa-a4a8-c3946267e1d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpld4\" (UniqueName: \"kubernetes.io/projected/c72f5cd3-34e0-4255-afec-132e1ec400ae-kube-api-access-vpld4\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.219695 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.220180 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219756 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8280226c-a372-4baa-a4a8-c3946267e1d0-tmp\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.220180 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.219795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c72f5cd3-34e0-4255-afec-132e1ec400ae-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.220352 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.220330 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8280226c-a372-4baa-a4a8-c3946267e1d0-tmp\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.222547 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.222504 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8280226c-a372-4baa-a4a8-c3946267e1d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.222687 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.222665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a14b4d0-72f5-464e-b028-023b7b5830dd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.243414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.243378 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g588\" (UniqueName: \"kubernetes.io/projected/8280226c-a372-4baa-a4a8-c3946267e1d0-kube-api-access-2g588\") pod \"klusterlet-addon-workmgr-7c75fcd686-ktxzx\" (UID: \"8280226c-a372-4baa-a4a8-c3946267e1d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.243580 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.243420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk5hd\" (UniqueName: \"kubernetes.io/projected/2a14b4d0-72f5-464e-b028-023b7b5830dd-kube-api-access-zk5hd\") pod \"managed-serviceaccount-addon-agent-85f74b7798-h5mjf\" (UID: \"2a14b4d0-72f5-464e-b028-023b7b5830dd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.272721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.272683 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55f8dc8f48-5js4j"] May 28 16:03:17.279456 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.279423 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.292284 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.292258 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f8dc8f48-5js4j"] May 28 16:03:17.320415 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320382 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c72f5cd3-34e0-4255-afec-132e1ec400ae-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.320602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6j45\" (UniqueName: \"kubernetes.io/projected/5a1c87ef-5b56-4c71-8d46-d16a269683d1-kube-api-access-l6j45\") pod \"downloads-57bd96b888-6r8t6\" (UID: \"5a1c87ef-5b56-4c71-8d46-d16a269683d1\") " pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:17.320602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.320602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320574 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.320772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320719 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.320772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320756 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpld4\" (UniqueName: \"kubernetes.io/projected/c72f5cd3-34e0-4255-afec-132e1ec400ae-kube-api-access-vpld4\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.320862 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.320788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.321170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.321126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c72f5cd3-34e0-4255-afec-132e1ec400ae-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.323367 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.323343 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-ca\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.323555 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.323524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.323809 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.323788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.324006 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.323989 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c72f5cd3-34e0-4255-afec-132e1ec400ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.330347 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.330246 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpld4\" (UniqueName: \"kubernetes.io/projected/c72f5cd3-34e0-4255-afec-132e1ec400ae-kube-api-access-vpld4\") pod \"cluster-proxy-proxy-agent-d74689c68-54fj7\" (UID: \"c72f5cd3-34e0-4255-afec-132e1ec400ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.386247 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.386215 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" May 28 16:03:17.396598 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.396568 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:17.404378 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.404358 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" May 28 16:03:17.421840 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.421810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-installation-pull-secrets\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.421966 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.421854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-bound-sa-token\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.421966 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.421934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-certificates\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422090 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.421980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58f53d8c-23a0-44fa-9fad-660c20af0afc-ca-trust-extracted\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422090 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.422019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-tls\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422090 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.422079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-trusted-ca\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422223 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.422134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-image-registry-private-configuration\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422223 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.422173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldk8v\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-kube-api-access-ldk8v\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.422223 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.422211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6j45\" (UniqueName: \"kubernetes.io/projected/5a1c87ef-5b56-4c71-8d46-d16a269683d1-kube-api-access-l6j45\") pod \"downloads-57bd96b888-6r8t6\" (UID: \"5a1c87ef-5b56-4c71-8d46-d16a269683d1\") " pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:17.431955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.431931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6j45\" (UniqueName: \"kubernetes.io/projected/5a1c87ef-5b56-4c71-8d46-d16a269683d1-kube-api-access-l6j45\") pod \"downloads-57bd96b888-6r8t6\" (UID: \"5a1c87ef-5b56-4c71-8d46-d16a269683d1\") " pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:17.496721 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.496683 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:17.524087 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524033 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-image-registry-private-configuration\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524258 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldk8v\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-kube-api-access-ldk8v\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524258 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524238 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-installation-pull-secrets\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-bound-sa-token\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-certificates\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524390 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58f53d8c-23a0-44fa-9fad-660c20af0afc-ca-trust-extracted\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524543 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-tls\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.524543 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.524477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-trusted-ca\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.525388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.525359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-certificates\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.526100 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.526073 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58f53d8c-23a0-44fa-9fad-660c20af0afc-ca-trust-extracted\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.527436 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.527409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-image-registry-private-configuration\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.527534 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.527520 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58f53d8c-23a0-44fa-9fad-660c20af0afc-trusted-ca\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.529619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.528731 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-registry-tls\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.529619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.528769 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58f53d8c-23a0-44fa-9fad-660c20af0afc-installation-pull-secrets\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.533096 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.533062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldk8v\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-kube-api-access-ldk8v\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.533487 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.533468 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f53d8c-23a0-44fa-9fad-660c20af0afc-bound-sa-token\") pod \"image-registry-55f8dc8f48-5js4j\" (UID: \"58f53d8c-23a0-44fa-9fad-660c20af0afc\") " pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:17.592602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:17.592502 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:18.504794 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.504536 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7"] May 28 16:03:18.553330 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.549391 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f8dc8f48-5js4j"] May 28 16:03:18.553330 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:18.552457 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f53d8c_23a0_44fa_9fad_660c20af0afc.slice/crio-a996f45d655d47aace6f7ac32a7946683ef1266f2d3468f0e19ff0854ac91ba6 WatchSource:0}: Error finding container a996f45d655d47aace6f7ac32a7946683ef1266f2d3468f0e19ff0854ac91ba6: Status 404 returned error can't find the container with id a996f45d655d47aace6f7ac32a7946683ef1266f2d3468f0e19ff0854ac91ba6 May 28 16:03:18.584034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.576638 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf"] May 28 16:03:18.584034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.581496 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6r8t6"] May 28 16:03:18.624376 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.624317 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx"] May 28 16:03:18.710805 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.710736 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-247qz" event={"ID":"6554cc8a-2ea1-44b7-ba35-084707c1d3bd","Type":"ContainerStarted","Data":"9e57586f7c0382785344321662ca42db7f09043887c5d63accc6202816b11ee1"} May 28 16:03:18.710805 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.710777 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-247qz" event={"ID":"6554cc8a-2ea1-44b7-ba35-084707c1d3bd","Type":"ContainerStarted","Data":"3e2e5170c7f3effeeb24374a0c530301400fcd885a3f778ef52f63d5482faeee"} May 28 16:03:18.711076 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.711046 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-247qz" May 28 16:03:18.713622 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.713584 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" event={"ID":"58f53d8c-23a0-44fa-9fad-660c20af0afc","Type":"ContainerStarted","Data":"6466950e4c19006cd240746c6bf9fa90883c9c991a4f45ca3c2ed9b5dfc3ec42"} May 28 16:03:18.713752 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.713627 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" event={"ID":"58f53d8c-23a0-44fa-9fad-660c20af0afc","Type":"ContainerStarted","Data":"a996f45d655d47aace6f7ac32a7946683ef1266f2d3468f0e19ff0854ac91ba6"} May 28 16:03:18.713752 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.713726 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:18.715016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.714955 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" event={"ID":"2a14b4d0-72f5-464e-b028-023b7b5830dd","Type":"ContainerStarted","Data":"38788f9c4e87ba36c6da73fb2d1ac137728f7ce54af8695ee5e9d32ef16b1308"} May 28 16:03:18.717669 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.717617 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6r8t6" event={"ID":"5a1c87ef-5b56-4c71-8d46-d16a269683d1","Type":"ContainerStarted","Data":"a2b88238d3d660a7838ee85d36bc6bd70c6bc9f2bf21ebbeaeac7aa97d9a5a4a"} May 28 16:03:18.718886 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.718809 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" event={"ID":"8280226c-a372-4baa-a4a8-c3946267e1d0","Type":"ContainerStarted","Data":"bd119768d188bd17ba291589878484a2cecff1cfd0f6c298731b031388a418e6"} May 28 16:03:18.721613 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.721567 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njpw4" event={"ID":"4bdc9f5c-9530-492c-afee-5c917f830aa4","Type":"ContainerStarted","Data":"f4608235ad58824ab59247b1a867c514341876e873d31049ec7235c14fed3a3c"} May 28 16:03:18.721613 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.721597 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njpw4" event={"ID":"4bdc9f5c-9530-492c-afee-5c917f830aa4","Type":"ContainerStarted","Data":"cb5e7dca3bd18c68a9c09cddcaca23fa379a9eff27f3f4f519cd68aae361d1a7"} May 28 16:03:18.724112 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.724070 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6g8g4" event={"ID":"33e463e3-113e-4e69-974c-bdb1b0b889c5","Type":"ContainerStarted","Data":"05279b4b33a7eb16d72965ef93a5cc7d05333147b890b5b17d537490c0fb7f72"} May 28 16:03:18.725511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.725487 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" event={"ID":"c72f5cd3-34e0-4255-afec-132e1ec400ae","Type":"ContainerStarted","Data":"6a94eb085e8939443bb8b1c127323cbfbb5640d3c6a82dfb6bc893e95494ab5c"} May 28 16:03:18.727069 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.727003 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" event={"ID":"f52a7ac3-de62-4237-b8d8-725fcc942b2d","Type":"ContainerStarted","Data":"d7f1392044068d4d982ec78f84270ea7e40634ffd0991b11c7ad3d2b0c2d3c18"} May 28 16:03:18.730676 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.729830 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" event={"ID":"7e761cb6-3403-43ee-8509-6c31f7b4b6fc","Type":"ContainerStarted","Data":"c5b2c442f7bc800d2bc3188c1d992803900c6c0ba6e866220cbfefb082c33db6"} May 28 16:03:18.754725 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.754675 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-247qz" podStartSLOduration=33.508485183 podStartE2EDuration="36.754659318s" podCreationTimestamp="2026-05-28 16:02:42 +0000 UTC" firstStartedPulling="2026-05-28 16:03:15.015181648 +0000 UTC m=+66.266096495" lastFinishedPulling="2026-05-28 16:03:18.26135579 +0000 UTC m=+69.512270630" observedRunningTime="2026-05-28 16:03:18.730178287 +0000 UTC m=+69.981093168" watchObservedRunningTime="2026-05-28 16:03:18.754659318 +0000 UTC m=+70.005574174" May 28 16:03:18.755198 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.755173 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-njpw4" podStartSLOduration=66.968070448 podStartE2EDuration="1m9.755167383s" podCreationTimestamp="2026-05-28 16:02:09 +0000 UTC" firstStartedPulling="2026-05-28 16:03:15.439932757 +0000 UTC m=+66.690847589" lastFinishedPulling="2026-05-28 16:03:18.227029688 +0000 UTC m=+69.477944524" observedRunningTime="2026-05-28 16:03:18.75357755 +0000 UTC m=+70.004492406" watchObservedRunningTime="2026-05-28 16:03:18.755167383 +0000 UTC m=+70.006082236" May 28 16:03:18.783275 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.783220 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" podStartSLOduration=1.783203083 podStartE2EDuration="1.783203083s" podCreationTimestamp="2026-05-28 16:03:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:18.781925435 +0000 UTC m=+70.032840291" watchObservedRunningTime="2026-05-28 16:03:18.783203083 +0000 UTC m=+70.034117969" May 28 16:03:18.819000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.818947 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6g8g4" podStartSLOduration=33.653502657 podStartE2EDuration="36.81893115s" podCreationTimestamp="2026-05-28 16:02:42 +0000 UTC" firstStartedPulling="2026-05-28 16:03:15.063780904 +0000 UTC m=+66.314695737" lastFinishedPulling="2026-05-28 16:03:18.229209384 +0000 UTC m=+69.480124230" observedRunningTime="2026-05-28 16:03:18.817239943 +0000 UTC m=+70.068154798" watchObservedRunningTime="2026-05-28 16:03:18.81893115 +0000 UTC m=+70.069846005" May 28 16:03:18.843375 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.843311 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ksv6t" podStartSLOduration=44.570610657 podStartE2EDuration="47.843278115s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:03:15.003147156 +0000 UTC m=+66.254062005" lastFinishedPulling="2026-05-28 16:03:18.275814624 +0000 UTC m=+69.526729463" observedRunningTime="2026-05-28 16:03:18.838306829 +0000 UTC m=+70.089221678" watchObservedRunningTime="2026-05-28 16:03:18.843278115 +0000 UTC m=+70.094192973" May 28 16:03:18.861168 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:18.860842 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-l5jkr" podStartSLOduration=44.605806859 podStartE2EDuration="47.860822009s" podCreationTimestamp="2026-05-28 16:02:31 +0000 UTC" firstStartedPulling="2026-05-28 16:03:14.967853615 +0000 UTC m=+66.218768465" lastFinishedPulling="2026-05-28 16:03:18.222868765 +0000 UTC m=+69.473783615" observedRunningTime="2026-05-28 16:03:18.86064223 +0000 UTC m=+70.111557089" watchObservedRunningTime="2026-05-28 16:03:18.860822009 +0000 UTC m=+70.111736866" May 28 16:03:19.032654 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.032568 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v"] May 28 16:03:19.041513 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.041461 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:19.046898 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.045699 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 28 16:03:19.046898 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.046440 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h9hjh\"" May 28 16:03:19.046898 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.046874 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v"] May 28 16:03:19.143191 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.143083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/058c5e5c-def2-42d0-bf7c-16229ba10e41-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-84g7v\" (UID: \"058c5e5c-def2-42d0-bf7c-16229ba10e41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:19.244466 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.243988 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/058c5e5c-def2-42d0-bf7c-16229ba10e41-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-84g7v\" (UID: \"058c5e5c-def2-42d0-bf7c-16229ba10e41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:19.247167 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.247115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/058c5e5c-def2-42d0-bf7c-16229ba10e41-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-84g7v\" (UID: \"058c5e5c-def2-42d0-bf7c-16229ba10e41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:19.354350 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.354002 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:19.551953 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.551318 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v"] May 28 16:03:19.572126 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:19.570723 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058c5e5c_def2_42d0_bf7c_16229ba10e41.slice/crio-5d0466ac20d0b70e21a210121bdeb81f859514785db8d8f4eb34349037fc7b4a WatchSource:0}: Error finding container 5d0466ac20d0b70e21a210121bdeb81f859514785db8d8f4eb34349037fc7b4a: Status 404 returned error can't find the container with id 5d0466ac20d0b70e21a210121bdeb81f859514785db8d8f4eb34349037fc7b4a May 28 16:03:19.747032 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:19.745523 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" event={"ID":"058c5e5c-def2-42d0-bf7c-16229ba10e41","Type":"ContainerStarted","Data":"5d0466ac20d0b70e21a210121bdeb81f859514785db8d8f4eb34349037fc7b4a"} May 28 16:03:22.248073 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.246218 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-swqsb"] May 28 16:03:22.320275 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.320240 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swqsb"] May 28 16:03:22.320471 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.320401 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.321147 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.320728 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:03:22.324177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.324150 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 16:03:22.355368 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.355334 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:03:22.355534 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.355458 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.358339 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.358292 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 16:03:22.359425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.358683 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 16:03:22.359425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.358906 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 16:03:22.359425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.359117 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 16:03:22.359425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.359286 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 16:03:22.359669 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.359621 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zmgxd\"" May 28 16:03:22.480032 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.479997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-dbus\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.480181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.480181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.480181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.480181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.480181 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b181aa-edbd-46c6-8290-f513a4bad451-original-pull-secret\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.480363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-kubelet-config\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.480363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.480363 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.480251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxht\" (UniqueName: \"kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.580803 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580761 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-dbus\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580825 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580855 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580891 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580914 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b181aa-edbd-46c6-8290-f513a4bad451-original-pull-secret\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.581001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.580982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-kubelet-config\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.581334 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581019 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581334 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581039 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxht\" (UniqueName: \"kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581334 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-dbus\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.581334 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b181aa-edbd-46c6-8290-f513a4bad451-kubelet-config\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.581847 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581819 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581950 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.581950 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.581925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.584013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.583987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.584120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.584029 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b181aa-edbd-46c6-8290-f513a4bad451-original-pull-secret\") pod \"global-pull-secret-syncer-swqsb\" (UID: \"43b181aa-edbd-46c6-8290-f513a4bad451\") " pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.584345 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.584322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.589264 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.589241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxht\" (UniqueName: \"kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht\") pod \"console-7f84986b44-7gjrw\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:22.633170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.633136 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swqsb" May 28 16:03:22.670203 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:22.670152 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:23.609284 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:23.609131 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xtvnr" May 28 16:03:27.577097 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.577045 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swqsb"] May 28 16:03:27.580095 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:27.579834 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b181aa_edbd_46c6_8290_f513a4bad451.slice/crio-5c0accba6135da77fbe9029f6abc3844bcd4eef844b187d0bb532a5d20b4431b WatchSource:0}: Error finding container 5c0accba6135da77fbe9029f6abc3844bcd4eef844b187d0bb532a5d20b4431b: Status 404 returned error can't find the container with id 5c0accba6135da77fbe9029f6abc3844bcd4eef844b187d0bb532a5d20b4431b May 28 16:03:27.599561 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.599532 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:03:27.605144 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:27.605027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c4b33c_649d_4cf6_8196_1f52f9a8721f.slice/crio-c6829c8e17d0653d30a4e46e889c1e01cd7144073f49d0806df62eefb4fd7147 WatchSource:0}: Error finding container c6829c8e17d0653d30a4e46e889c1e01cd7144073f49d0806df62eefb4fd7147: Status 404 returned error can't find the container with id c6829c8e17d0653d30a4e46e889c1e01cd7144073f49d0806df62eefb4fd7147 May 28 16:03:27.781715 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.781621 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" event={"ID":"2a14b4d0-72f5-464e-b028-023b7b5830dd","Type":"ContainerStarted","Data":"cb525ac4661da17d432d70ea82e50f36f1b0f08923fda33ac54ba6369d7403a7"} May 28 16:03:27.783237 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.783203 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" event={"ID":"058c5e5c-def2-42d0-bf7c-16229ba10e41","Type":"ContainerStarted","Data":"62e0f70648d300c07a9808db8dae31f79a04487631728a4b9cf62c7ee3c1dafa"} May 28 16:03:27.783448 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.783425 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:27.785166 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.785125 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" event={"ID":"8280226c-a372-4baa-a4a8-c3946267e1d0","Type":"ContainerStarted","Data":"f5b99372931f6c486a2263fa70ab1fe2021a3025ee19af1a2f30e172480b9325"} May 28 16:03:27.785445 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.785402 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:27.786788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.786754 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swqsb" event={"ID":"43b181aa-edbd-46c6-8290-f513a4bad451","Type":"ContainerStarted","Data":"5c0accba6135da77fbe9029f6abc3844bcd4eef844b187d0bb532a5d20b4431b"} May 28 16:03:27.786885 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.786856 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" May 28 16:03:27.788541 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.788508 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" event={"ID":"c72f5cd3-34e0-4255-afec-132e1ec400ae","Type":"ContainerStarted","Data":"b4a8eab08315da81c03de097ec6cbd845b78b152465fc0f42598003b06576465"} May 28 16:03:27.788977 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.788954 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" May 28 16:03:27.789992 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.789969 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f84986b44-7gjrw" event={"ID":"72c4b33c-649d-4cf6-8196-1f52f9a8721f","Type":"ContainerStarted","Data":"c6829c8e17d0653d30a4e46e889c1e01cd7144073f49d0806df62eefb4fd7147"} May 28 16:03:27.797374 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.797337 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85f74b7798-h5mjf" podStartSLOduration=2.00782841 podStartE2EDuration="10.797325802s" podCreationTimestamp="2026-05-28 16:03:17 +0000 UTC" firstStartedPulling="2026-05-28 16:03:18.587902899 +0000 UTC m=+69.838817744" lastFinishedPulling="2026-05-28 16:03:27.377400299 +0000 UTC m=+78.628315136" observedRunningTime="2026-05-28 16:03:27.79623846 +0000 UTC m=+79.047153318" watchObservedRunningTime="2026-05-28 16:03:27.797325802 +0000 UTC m=+79.048240658" May 28 16:03:27.810241 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.810196 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-84g7v" podStartSLOduration=0.991852463 podStartE2EDuration="8.810183554s" podCreationTimestamp="2026-05-28 16:03:19 +0000 UTC" firstStartedPulling="2026-05-28 16:03:19.573067241 +0000 UTC m=+70.823982076" lastFinishedPulling="2026-05-28 16:03:27.391398316 +0000 UTC m=+78.642313167" observedRunningTime="2026-05-28 16:03:27.809663155 +0000 UTC m=+79.060578012" watchObservedRunningTime="2026-05-28 16:03:27.810183554 +0000 UTC m=+79.061098410" May 28 16:03:27.827271 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:27.827167 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c75fcd686-ktxzx" podStartSLOduration=2.047902557 podStartE2EDuration="10.827146925s" podCreationTimestamp="2026-05-28 16:03:17 +0000 UTC" firstStartedPulling="2026-05-28 16:03:18.638462231 +0000 UTC m=+69.889377069" lastFinishedPulling="2026-05-28 16:03:27.417706603 +0000 UTC m=+78.668621437" observedRunningTime="2026-05-28 16:03:27.824754273 +0000 UTC m=+79.075669129" watchObservedRunningTime="2026-05-28 16:03:27.827146925 +0000 UTC m=+79.078061781" May 28 16:03:28.090230 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.090121 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn"] May 28 16:03:28.094214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.094186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.098179 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.098008 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 16:03:28.098179 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.098072 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 16:03:28.098643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.098619 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ddvst\"" May 28 16:03:28.102998 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.100808 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 16:03:28.102998 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.101811 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn"] May 28 16:03:28.237756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.237435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.237756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.237488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rbv\" (UniqueName: \"kubernetes.io/projected/83683591-5b18-44c9-8fa4-df02b47f71a9-kube-api-access-x2rbv\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.237756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.237536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.237756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.237575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83683591-5b18-44c9-8fa4-df02b47f71a9-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.340019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.338486 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.340019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.338543 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rbv\" (UniqueName: \"kubernetes.io/projected/83683591-5b18-44c9-8fa4-df02b47f71a9-kube-api-access-x2rbv\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.340019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.338583 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.340019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.338633 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83683591-5b18-44c9-8fa4-df02b47f71a9-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.344486 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.344399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83683591-5b18-44c9-8fa4-df02b47f71a9-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.344619 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:28.344536 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 28 16:03:28.344619 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:28.344614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls podName:83683591-5b18-44c9-8fa4-df02b47f71a9 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:28.84459206 +0000 UTC m=+80.095506910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-7cdbn" (UID: "83683591-5b18-44c9-8fa4-df02b47f71a9") : secret "prometheus-operator-tls" not found May 28 16:03:28.347851 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.345523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.349623 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.349600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rbv\" (UniqueName: \"kubernetes.io/projected/83683591-5b18-44c9-8fa4-df02b47f71a9-kube-api-access-x2rbv\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.635321 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.633757 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:03:28.638456 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.637692 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.657582 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.657553 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:03:28.658559 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.658502 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 16:03:28.743942 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.743906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.743958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.744027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.744063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w44g\" (UniqueName: \"kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744289 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.744134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744289 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.744176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.744289 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.744223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.750135 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.750096 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-247qz" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845560 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845620 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845706 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845752 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w44g\" (UniqueName: \"kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845846 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845875 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845912 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.846531 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.845938 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.849511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.848245 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.849511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.848487 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.849511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.849032 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.849511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.849455 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.853407 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.853356 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.854277 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.854144 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.856560 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.856511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83683591-5b18-44c9-8fa4-df02b47f71a9-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7cdbn\" (UID: \"83683591-5b18-44c9-8fa4-df02b47f71a9\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:28.858535 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.858494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w44g\" (UniqueName: \"kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g\") pod \"console-f795fcb49-jck66\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:28.954175 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:28.953815 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:29.013727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:29.013687 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" May 28 16:03:29.199116 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:29.198985 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:03:29.204797 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:29.204722 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092976b5_867a_4d22_91bb_a4d5ad6546fe.slice/crio-fff73ab88bcfc16bf8a5e159f114e1edf021a323a771b39c9c6fcd7ad2c588ac WatchSource:0}: Error finding container fff73ab88bcfc16bf8a5e159f114e1edf021a323a771b39c9c6fcd7ad2c588ac: Status 404 returned error can't find the container with id fff73ab88bcfc16bf8a5e159f114e1edf021a323a771b39c9c6fcd7ad2c588ac May 28 16:03:29.242534 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:29.242498 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn"] May 28 16:03:29.245772 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:29.245733 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83683591_5b18_44c9_8fa4_df02b47f71a9.slice/crio-b7666f7e7a49784db4befecc5e7470567b6fd7da456fd773a8b6f187d2209673 WatchSource:0}: Error finding container b7666f7e7a49784db4befecc5e7470567b6fd7da456fd773a8b6f187d2209673: Status 404 returned error can't find the container with id b7666f7e7a49784db4befecc5e7470567b6fd7da456fd773a8b6f187d2209673 May 28 16:03:29.802210 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:29.802137 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" event={"ID":"83683591-5b18-44c9-8fa4-df02b47f71a9","Type":"ContainerStarted","Data":"b7666f7e7a49784db4befecc5e7470567b6fd7da456fd773a8b6f187d2209673"} May 28 16:03:29.804085 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:29.804019 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f795fcb49-jck66" event={"ID":"092976b5-867a-4d22-91bb-a4d5ad6546fe","Type":"ContainerStarted","Data":"fff73ab88bcfc16bf8a5e159f114e1edf021a323a771b39c9c6fcd7ad2c588ac"} May 28 16:03:34.724263 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:34.724220 2575 patch_prober.go:28] interesting pod/image-registry-5c447d6448-qr5kc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 16:03:34.724748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:34.724282 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" podUID="82a72019-5c77-4ead-8939-d55510533bcb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 16:03:37.710540 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:37.710508 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:03:38.736997 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:38.736964 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:39.751836 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:39.751805 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55f8dc8f48-5js4j" May 28 16:03:39.809763 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:39.809728 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:03:41.852522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.852477 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f84986b44-7gjrw" event={"ID":"72c4b33c-649d-4cf6-8196-1f52f9a8721f","Type":"ContainerStarted","Data":"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d"} May 28 16:03:41.854559 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.854526 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6r8t6" event={"ID":"5a1c87ef-5b56-4c71-8d46-d16a269683d1","Type":"ContainerStarted","Data":"8448d2fd1a1ea993cd1ba6110e4a910bc794dff30c0b59629fd458ef3e5e2f28"} May 28 16:03:41.854771 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.854735 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:41.856149 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.856124 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swqsb" event={"ID":"43b181aa-edbd-46c6-8290-f513a4bad451","Type":"ContainerStarted","Data":"a84ca745b5099f4a748283340b9dea858972e5a203a7fd0605b0db0bdcc48110"} May 28 16:03:41.857880 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.857856 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f795fcb49-jck66" event={"ID":"092976b5-867a-4d22-91bb-a4d5ad6546fe","Type":"ContainerStarted","Data":"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389"} May 28 16:03:41.859978 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.859958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" event={"ID":"c72f5cd3-34e0-4255-afec-132e1ec400ae","Type":"ContainerStarted","Data":"39fbf7f994a1f83e7f3dab6805b58ac73891db03a8c4b3aa9afed1893845e940"} May 28 16:03:41.860075 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.859986 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" event={"ID":"c72f5cd3-34e0-4255-afec-132e1ec400ae","Type":"ContainerStarted","Data":"4ba5994571b9475c7f107eacdb2f5289a9e55ac2c1a57d0ec2e65b271ba721bd"} May 28 16:03:41.861908 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.861879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" event={"ID":"83683591-5b18-44c9-8fa4-df02b47f71a9","Type":"ContainerStarted","Data":"b74c45913915de4f04a6e95b2aa05ad92d235dd7116dccbe4a5bf32031d18721"} May 28 16:03:41.862011 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.861911 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" event={"ID":"83683591-5b18-44c9-8fa4-df02b47f71a9","Type":"ContainerStarted","Data":"5f918de416849a9181fd0c5bce3e0471526135a8444b18f7000440c241289ecf"} May 28 16:03:41.870013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.869990 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-6r8t6" May 28 16:03:41.872117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.872073 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f84986b44-7gjrw" podStartSLOduration=6.646545178 podStartE2EDuration="19.872057834s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:27.607037498 +0000 UTC m=+78.857952344" lastFinishedPulling="2026-05-28 16:03:40.832550164 +0000 UTC m=+92.083465000" observedRunningTime="2026-05-28 16:03:41.870884138 +0000 UTC m=+93.121798994" watchObservedRunningTime="2026-05-28 16:03:41.872057834 +0000 UTC m=+93.122972692" May 28 16:03:41.888847 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.888798 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7cdbn" podStartSLOduration=2.274684823 podStartE2EDuration="13.88878547s" podCreationTimestamp="2026-05-28 16:03:28 +0000 UTC" firstStartedPulling="2026-05-28 16:03:29.248472119 +0000 UTC m=+80.499386956" lastFinishedPulling="2026-05-28 16:03:40.862572754 +0000 UTC m=+92.113487603" observedRunningTime="2026-05-28 16:03:41.886667552 +0000 UTC m=+93.137582413" watchObservedRunningTime="2026-05-28 16:03:41.88878547 +0000 UTC m=+93.139700326" May 28 16:03:41.909317 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.906512 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f795fcb49-jck66" podStartSLOduration=2.253043162 podStartE2EDuration="13.906489687s" podCreationTimestamp="2026-05-28 16:03:28 +0000 UTC" firstStartedPulling="2026-05-28 16:03:29.20696801 +0000 UTC m=+80.457882859" lastFinishedPulling="2026-05-28 16:03:40.860414546 +0000 UTC m=+92.111329384" observedRunningTime="2026-05-28 16:03:41.905942913 +0000 UTC m=+93.156857771" watchObservedRunningTime="2026-05-28 16:03:41.906489687 +0000 UTC m=+93.157404545" May 28 16:03:41.925368 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.925289 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d74689c68-54fj7" podStartSLOduration=2.610457294 podStartE2EDuration="24.925271965s" podCreationTimestamp="2026-05-28 16:03:17 +0000 UTC" firstStartedPulling="2026-05-28 16:03:18.517689331 +0000 UTC m=+69.768604171" lastFinishedPulling="2026-05-28 16:03:40.832503996 +0000 UTC m=+92.083418842" observedRunningTime="2026-05-28 16:03:41.924124828 +0000 UTC m=+93.175039683" watchObservedRunningTime="2026-05-28 16:03:41.925271965 +0000 UTC m=+93.176186823" May 28 16:03:41.941374 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.941311 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-swqsb" podStartSLOduration=6.690726073 podStartE2EDuration="19.94127724s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:27.581951267 +0000 UTC m=+78.832866117" lastFinishedPulling="2026-05-28 16:03:40.83250245 +0000 UTC m=+92.083417284" observedRunningTime="2026-05-28 16:03:41.939572096 +0000 UTC m=+93.190486952" watchObservedRunningTime="2026-05-28 16:03:41.94127724 +0000 UTC m=+93.192192131" May 28 16:03:41.959892 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:41.959829 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-6r8t6" podStartSLOduration=2.718099104 podStartE2EDuration="24.959810813s" podCreationTimestamp="2026-05-28 16:03:17 +0000 UTC" firstStartedPulling="2026-05-28 16:03:18.593818448 +0000 UTC m=+69.844733295" lastFinishedPulling="2026-05-28 16:03:40.835530154 +0000 UTC m=+92.086445004" observedRunningTime="2026-05-28 16:03:41.958106306 +0000 UTC m=+93.209021164" watchObservedRunningTime="2026-05-28 16:03:41.959810813 +0000 UTC m=+93.210725669" May 28 16:03:42.671271 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:42.671230 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:42.671271 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:42.671282 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:42.677075 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:42.677048 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:42.870526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:42.870494 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:03:43.470726 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.470688 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-sx668"] May 28 16:03:43.500783 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.500750 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-sx668"] May 28 16:03:43.501022 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.501007 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2c7jb"] May 28 16:03:43.501490 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.501463 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.506343 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.505950 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 28 16:03:43.506343 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.506182 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wbv7r\"" May 28 16:03:43.506570 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.506557 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 28 16:03:43.516890 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.516733 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.519728 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.517785 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl"] May 28 16:03:43.521214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.520706 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gfwpb\"" May 28 16:03:43.521214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.520898 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 16:03:43.521214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.521064 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 16:03:43.521720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.521556 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 16:03:43.562323 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.561616 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl"] May 28 16:03:43.562323 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.561780 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.566587 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.565531 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 28 16:03:43.566587 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.565737 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 28 16:03:43.566587 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.565882 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 28 16:03:43.566587 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.566017 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rkbql\"" May 28 16:03:43.596241 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-metrics-client-ca\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-root\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.596408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-sys\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-textfile\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qv5\" (UniqueName: \"kubernetes.io/projected/af4f4ab4-9a30-4758-a255-44317f1962ce-kube-api-access-f5qv5\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.596619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8vz\" (UniqueName: \"kubernetes.io/projected/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-kube-api-access-rc8vz\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-wtmp\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.596955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.596892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcl7\" (UniqueName: \"kubernetes.io/projected/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-api-access-mqcl7\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.698292 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698349 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.698497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698380 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-sys\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-textfile\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698497 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:43.698458 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-sys\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:43.698569 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls podName:af4f4ab4-9a30-4758-a255-44317f1962ce nodeName:}" failed. No retries permitted until 2026-05-28 16:03:44.198529267 +0000 UTC m=+95.449444123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls") pod "node-exporter-2c7jb" (UID: "af4f4ab4-9a30-4758-a255-44317f1962ce") : secret "node-exporter-tls" not found May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qv5\" (UniqueName: \"kubernetes.io/projected/af4f4ab4-9a30-4758-a255-44317f1962ce-kube-api-access-f5qv5\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.698712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698700 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698726 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-textfile\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698749 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698785 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8vz\" (UniqueName: \"kubernetes.io/projected/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-kube-api-access-rc8vz\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698818 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698848 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-wtmp\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.698999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.698962 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699012 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcl7\" (UniqueName: \"kubernetes.io/projected/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-api-access-mqcl7\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-metrics-client-ca\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699090 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-root\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699190 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:43.699198 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 28 16:03:43.699360 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:43.699331 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls podName:cc824ed3-b6a4-4d28-bc7b-c340d617c02c nodeName:}" failed. No retries permitted until 2026-05-28 16:03:44.199280802 +0000 UTC m=+95.450195659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-sx668" (UID: "cc824ed3-b6a4-4d28-bc7b-c340d617c02c") : secret "openshift-state-metrics-tls" not found May 28 16:03:43.699768 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.699768 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.699873 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-root\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.700806 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.699934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af4f4ab4-9a30-4758-a255-44317f1962ce-metrics-client-ca\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.700806 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.700075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-wtmp\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.700806 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.700108 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.700806 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.700663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.702873 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.702822 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.703058 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.703032 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.703626 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.703595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.706333 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.706260 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.713407 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.712866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8vz\" (UniqueName: \"kubernetes.io/projected/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-kube-api-access-rc8vz\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:43.713743 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.713698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qv5\" (UniqueName: \"kubernetes.io/projected/af4f4ab4-9a30-4758-a255-44317f1962ce-kube-api-access-f5qv5\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:43.719749 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.719724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcl7\" (UniqueName: \"kubernetes.io/projected/ef4a0ce6-e9c1-442a-89dd-b2a1d5549404-kube-api-access-mqcl7\") pod \"kube-state-metrics-54fd6bc5c4-667pl\" (UID: \"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:43.751616 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.751534 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" podUID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" containerName="registry" containerID="cri-o://06599eb18eef1554c1922734357254d4076ea575613d6b8aea46ad501fec25e2" gracePeriod=30 May 28 16:03:43.871006 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.870966 2575 generic.go:358] "Generic (PLEG): container finished" podID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" containerID="06599eb18eef1554c1922734357254d4076ea575613d6b8aea46ad501fec25e2" exitCode=0 May 28 16:03:43.871680 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.871655 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" event={"ID":"b7cce9e3-34d0-4a18-891f-40a5d671bffb","Type":"ContainerDied","Data":"06599eb18eef1554c1922734357254d4076ea575613d6b8aea46ad501fec25e2"} May 28 16:03:43.877689 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:43.877344 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" May 28 16:03:44.061714 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.061690 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:44.074710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.074683 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl"] May 28 16:03:44.077884 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:44.077798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4a0ce6_e9c1_442a_89dd_b2a1d5549404.slice/crio-388101f08b916c1447b7b965c158a51265d2c05e11e77e3fb1508a37dbed8b10 WatchSource:0}: Error finding container 388101f08b916c1447b7b965c158a51265d2c05e11e77e3fb1508a37dbed8b10: Status 404 returned error can't find the container with id 388101f08b916c1447b7b965c158a51265d2c05e11e77e3fb1508a37dbed8b10 May 28 16:03:44.104915 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.104883 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105062 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.104931 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105062 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105008 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105062 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105035 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105228 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105077 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105228 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105118 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pc28\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105228 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105155 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105228 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105180 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted\") pod \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\" (UID: \"b7cce9e3-34d0-4a18-891f-40a5d671bffb\") " May 28 16:03:44.105797 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.105738 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:03:44.107219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.107127 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:03:44.111329 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.111255 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:03:44.111744 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.111703 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28" (OuterVolumeSpecName: "kube-api-access-2pc28") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "kube-api-access-2pc28". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:03:44.112109 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.112062 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:03:44.112214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.112185 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:03:44.114138 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.114112 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:03:44.116611 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.116581 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b7cce9e3-34d0-4a18-891f-40a5d671bffb" (UID: "b7cce9e3-34d0-4a18-891f-40a5d671bffb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:03:44.206675 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206636 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:44.206862 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:44.206862 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206843 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-installation-pull-secrets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206863 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7cce9e3-34d0-4a18-891f-40a5d671bffb-image-registry-private-configuration\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206880 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-bound-sa-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206893 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-certificates\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206908 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-registry-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206920 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pc28\" (UniqueName: \"kubernetes.io/projected/b7cce9e3-34d0-4a18-891f-40a5d671bffb-kube-api-access-2pc28\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206933 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7cce9e3-34d0-4a18-891f-40a5d671bffb-trusted-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.206995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.206945 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7cce9e3-34d0-4a18-891f-40a5d671bffb-ca-trust-extracted\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:03:44.209662 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.209638 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af4f4ab4-9a30-4758-a255-44317f1962ce-node-exporter-tls\") pod \"node-exporter-2c7jb\" (UID: \"af4f4ab4-9a30-4758-a255-44317f1962ce\") " pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:44.209780 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.209707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc824ed3-b6a4-4d28-bc7b-c340d617c02c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-sx668\" (UID: \"cc824ed3-b6a4-4d28-bc7b-c340d617c02c\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:44.428058 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.428009 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" May 28 16:03:44.448917 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.448495 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2c7jb" May 28 16:03:44.464758 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:44.464709 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4f4ab4_9a30_4758_a255_44317f1962ce.slice/crio-57396472b8b094fae2708984bf27fb59839392d0e6fa2869fd4477bf91cbdfe3 WatchSource:0}: Error finding container 57396472b8b094fae2708984bf27fb59839392d0e6fa2869fd4477bf91cbdfe3: Status 404 returned error can't find the container with id 57396472b8b094fae2708984bf27fb59839392d0e6fa2869fd4477bf91cbdfe3 May 28 16:03:44.601619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.601583 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:03:44.602390 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.602371 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" containerName="registry" May 28 16:03:44.602527 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.602517 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" containerName="registry" May 28 16:03:44.602703 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.602693 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" containerName="registry" May 28 16:03:44.621851 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.621820 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.622142 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.622113 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.625673 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.625730 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.625960 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626000 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626089 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.625680 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626520 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626688 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626825 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qjs9t\"" May 28 16:03:44.627775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.626844 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 28 16:03:44.634804 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.634767 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-sx668"] May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.712979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkv6d\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.713720 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.713279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.714253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.714101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.714253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.714157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.714253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.714239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.714497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.714313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.815325 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.815325 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815236 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.815325 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815265 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815600 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815639 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815700 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815836 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815866 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815911 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkv6d\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.815954 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.816238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.816006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.817443 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.817050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.817443 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.817230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.818998 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.818952 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.821578 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.821535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.822243 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.822180 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.824122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.823370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.824122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.823668 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.824122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.824081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.826208 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.826074 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.827882 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.827858 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.830387 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.830339 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.830783 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.830744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.837621 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.837586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkv6d\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d\") pod \"alertmanager-main-0\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:44.897021 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.896898 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" event={"ID":"b7cce9e3-34d0-4a18-891f-40a5d671bffb","Type":"ContainerDied","Data":"14a0b78e9754610729774ae81c40c4e64df0a40ea914e2ca1247ecb813ecf007"} May 28 16:03:44.897021 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.896975 2575 scope.go:117] "RemoveContainer" containerID="06599eb18eef1554c1922734357254d4076ea575613d6b8aea46ad501fec25e2" May 28 16:03:44.897468 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.897161 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cff65f5f-nzdns" May 28 16:03:44.913513 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.913482 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" event={"ID":"cc824ed3-b6a4-4d28-bc7b-c340d617c02c","Type":"ContainerStarted","Data":"a2407637f34f4e7b13d5d17b3e452da83b8f8fcc4afcce3eae69a02e361a5ff3"} May 28 16:03:44.913719 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.913699 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" event={"ID":"cc824ed3-b6a4-4d28-bc7b-c340d617c02c","Type":"ContainerStarted","Data":"89d154220244dc2c0dfe52cb31ccde2723645b586ee9073f9a02537f3dd46d7c"} May 28 16:03:44.916946 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.916701 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c7jb" event={"ID":"af4f4ab4-9a30-4758-a255-44317f1962ce","Type":"ContainerStarted","Data":"57396472b8b094fae2708984bf27fb59839392d0e6fa2869fd4477bf91cbdfe3"} May 28 16:03:44.918508 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.918404 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" event={"ID":"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404","Type":"ContainerStarted","Data":"388101f08b916c1447b7b965c158a51265d2c05e11e77e3fb1508a37dbed8b10"} May 28 16:03:44.928798 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.928775 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:03:44.937619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.937513 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59cff65f5f-nzdns"] May 28 16:03:44.949604 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:44.949132 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 16:03:45.160914 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.160776 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:03:45.169389 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:45.169147 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e253bc_8705_4b33_9617_89b1b434f8fd.slice/crio-d43076a9ae091e427c00aeb922b9b96fed76935b99aa7ea421bcb40b08819b7e WatchSource:0}: Error finding container d43076a9ae091e427c00aeb922b9b96fed76935b99aa7ea421bcb40b08819b7e: Status 404 returned error can't find the container with id d43076a9ae091e427c00aeb922b9b96fed76935b99aa7ea421bcb40b08819b7e May 28 16:03:45.316364 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.316257 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7cce9e3-34d0-4a18-891f-40a5d671bffb" path="/var/lib/kubelet/pods/b7cce9e3-34d0-4a18-891f-40a5d671bffb/volumes" May 28 16:03:45.487318 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.487260 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59b599bf55-fqqkg"] May 28 16:03:45.508161 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.507619 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b599bf55-fqqkg"] May 28 16:03:45.508161 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.507815 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.512388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.510607 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 16:03:45.512388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.511099 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vrmgw\"" May 28 16:03:45.512388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.511455 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 16:03:45.512388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.511659 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 16:03:45.512388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.511844 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a5pp83c0o36db\"" May 28 16:03:45.512800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.512500 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 16:03:45.512800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.512792 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 16:03:45.625165 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5962ac23-aa42-42db-8436-082adb3e8482-metrics-client-ca\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-grpc-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hw6\" (UniqueName: \"kubernetes.io/projected/5962ac23-aa42-42db-8436-082adb3e8482-kube-api-access-49hw6\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.625636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.625538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727335 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727389 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49hw6\" (UniqueName: \"kubernetes.io/projected/5962ac23-aa42-42db-8436-082adb3e8482-kube-api-access-49hw6\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727432 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727611 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5962ac23-aa42-42db-8436-082adb3e8482-metrics-client-ca\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727638 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-grpc-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.728080 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.727679 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.730878 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.729290 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5962ac23-aa42-42db-8436-082adb3e8482-metrics-client-ca\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.732331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.732263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.732511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.732479 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.737102 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.737057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hw6\" (UniqueName: \"kubernetes.io/projected/5962ac23-aa42-42db-8436-082adb3e8482-kube-api-access-49hw6\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.737692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.737647 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.740164 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.740120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.740956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.740910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.746095 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.746045 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5962ac23-aa42-42db-8436-082adb3e8482-secret-grpc-tls\") pod \"thanos-querier-59b599bf55-fqqkg\" (UID: \"5962ac23-aa42-42db-8436-082adb3e8482\") " pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.823705 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.823203 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:45.928965 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.928873 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" event={"ID":"cc824ed3-b6a4-4d28-bc7b-c340d617c02c","Type":"ContainerStarted","Data":"ecc485f06823d9cfc9d88efc42209648327bc586838899380f60a88c4e4652a3"} May 28 16:03:45.930857 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:45.930807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"d43076a9ae091e427c00aeb922b9b96fed76935b99aa7ea421bcb40b08819b7e"} May 28 16:03:47.373104 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:47.373070 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b599bf55-fqqkg"] May 28 16:03:47.959748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:47.959705 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c7jb" event={"ID":"af4f4ab4-9a30-4758-a255-44317f1962ce","Type":"ContainerStarted","Data":"7e2c05c8d46a4468b29edaa670cbe8d68af6a0ba2af985f22a332919ae29028e"} May 28 16:03:47.962592 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:47.962514 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" event={"ID":"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404","Type":"ContainerStarted","Data":"27d146294247c83fc50c3c58ba1e2689d72ce52aba22632760625616f7d09e1d"} May 28 16:03:47.962592 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:47.962556 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" event={"ID":"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404","Type":"ContainerStarted","Data":"15a71ca47091e83b47d554d3359337d5911418b85edfd80d0f9a01965e0821de"} May 28 16:03:47.966088 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:47.965102 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"40300fe434b8844fbbef9f68734d1a5fe7f3c9b634a4d2615ec05ea4995279f6"} May 28 16:03:48.025337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.021874 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79b586d48b-tdfrf"] May 28 16:03:48.047138 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.046044 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79b586d48b-tdfrf"] May 28 16:03:48.047138 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.046211 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.051135 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.051107 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 16:03:48.051254 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.051166 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 16:03:48.052368 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.051798 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-g49u9afcr18e\"" May 28 16:03:48.052802 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.052777 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hx5vl\"" May 28 16:03:48.054044 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.053287 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 16:03:48.054399 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.054256 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 16:03:48.156095 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-tls\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156095 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-client-certs\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-audit-log\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-client-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-metrics-server-audit-profiles\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.156384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.156378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mth6m\" (UniqueName: \"kubernetes.io/projected/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-kube-api-access-mth6m\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.256982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-tls\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257158 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257030 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257158 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257088 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-client-certs\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257158 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257120 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-audit-log\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257158 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-client-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257394 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257332 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-metrics-server-audit-profiles\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257394 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257364 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mth6m\" (UniqueName: \"kubernetes.io/projected/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-kube-api-access-mth6m\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.257903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.257878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-audit-log\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.258761 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.258741 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.259401 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.259356 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-metrics-server-audit-profiles\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.260542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.260497 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-client-ca-bundle\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.260943 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.260920 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-tls\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.261859 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.261810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-secret-metrics-server-client-certs\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.272066 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.272033 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vjstp"] May 28 16:03:48.279346 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.279287 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mth6m\" (UniqueName: \"kubernetes.io/projected/6b49c3ef-1fd5-4f5f-9821-eddb2395b65b-kube-api-access-mth6m\") pod \"metrics-server-79b586d48b-tdfrf\" (UID: \"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b\") " pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.305924 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.305894 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vjstp"] May 28 16:03:48.306064 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.306048 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:48.311372 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.308547 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-jnc4w\"" May 28 16:03:48.311372 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.308850 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 16:03:48.358645 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.358373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vjstp\" (UID: \"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:48.368670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.368644 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:03:48.461425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.459249 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vjstp\" (UID: \"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:48.461425 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:48.459601 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 28 16:03:48.461425 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:03:48.459676 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert podName:d6d77d95-cb9f-4b90-8c4d-e75b56b5e177 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:48.959654846 +0000 UTC m=+100.210569698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-vjstp" (UID: "d6d77d95-cb9f-4b90-8c4d-e75b56b5e177") : secret "monitoring-plugin-cert" not found May 28 16:03:48.561529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.561463 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79b586d48b-tdfrf"] May 28 16:03:48.955000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.954712 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:48.955000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.954763 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:48.961623 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.961568 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:48.965794 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.965224 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vjstp\" (UID: \"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:48.969312 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.969274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6d77d95-cb9f-4b90-8c4d-e75b56b5e177-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vjstp\" (UID: \"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:48.974969 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.974941 2575 generic.go:358] "Generic (PLEG): container finished" podID="af4f4ab4-9a30-4758-a255-44317f1962ce" containerID="7e2c05c8d46a4468b29edaa670cbe8d68af6a0ba2af985f22a332919ae29028e" exitCode=0 May 28 16:03:48.975100 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.975030 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c7jb" event={"ID":"af4f4ab4-9a30-4758-a255-44317f1962ce","Type":"ContainerDied","Data":"7e2c05c8d46a4468b29edaa670cbe8d68af6a0ba2af985f22a332919ae29028e"} May 28 16:03:48.979429 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.979152 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" event={"ID":"ef4a0ce6-e9c1-442a-89dd-b2a1d5549404","Type":"ContainerStarted","Data":"be515de1f9f433b3559502b86fe2259074c5518d077f4474961d49a8042bab57"} May 28 16:03:48.982586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.982374 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" event={"ID":"cc824ed3-b6a4-4d28-bc7b-c340d617c02c","Type":"ContainerStarted","Data":"23edc6b0784130ca1a84a55d443d8a9eb8e16a4bc41c327cc7d42d9e7d420fe3"} May 28 16:03:48.989512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.989482 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c" exitCode=0 May 28 16:03:48.989629 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.989558 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c"} May 28 16:03:48.992762 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.992732 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" event={"ID":"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b","Type":"ContainerStarted","Data":"a503578e1044476ff8d78f4bd26aeb7e07dcabcb057375a4c33dc821c74e165b"} May 28 16:03:48.999034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:48.999000 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f795fcb49-jck66" May 28 16:03:49.022144 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.022085 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-sx668" podStartSLOduration=3.056354171 podStartE2EDuration="6.022065966s" podCreationTimestamp="2026-05-28 16:03:43 +0000 UTC" firstStartedPulling="2026-05-28 16:03:45.003515192 +0000 UTC m=+96.254430034" lastFinishedPulling="2026-05-28 16:03:47.969226981 +0000 UTC m=+99.220141829" observedRunningTime="2026-05-28 16:03:49.020043294 +0000 UTC m=+100.270958149" watchObservedRunningTime="2026-05-28 16:03:49.022065966 +0000 UTC m=+100.272980823" May 28 16:03:49.046126 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.046040 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-667pl" podStartSLOduration=2.966441155 podStartE2EDuration="6.04602257s" podCreationTimestamp="2026-05-28 16:03:43 +0000 UTC" firstStartedPulling="2026-05-28 16:03:44.080480825 +0000 UTC m=+95.331395666" lastFinishedPulling="2026-05-28 16:03:47.160062245 +0000 UTC m=+98.410977081" observedRunningTime="2026-05-28 16:03:49.042290959 +0000 UTC m=+100.293205818" watchObservedRunningTime="2026-05-28 16:03:49.04602257 +0000 UTC m=+100.296937426" May 28 16:03:49.123354 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.122650 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:03:49.224239 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.224193 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:49.455749 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.455696 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vjstp"] May 28 16:03:49.478821 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.478723 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:03:49.496500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.496468 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.496738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.496529 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:03:49.575831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.575794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.576027 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.575875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.576027 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.575930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.576027 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.575963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.576027 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.576006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.577392 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.576183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.577392 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.576279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck76g\" (UniqueName: \"kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.677948 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.677905 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck76g\" (UniqueName: \"kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678162 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678162 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678101 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678162 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678149 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678394 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678394 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678239 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.678394 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.678337 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.679704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.679436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.679704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.679513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.679704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.679655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.680223 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.680189 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.682895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.682852 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.683639 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.683543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.690406 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.690382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck76g\" (UniqueName: \"kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g\") pod \"console-9597789c6-8qdxv\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:49.811836 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:49.811738 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:50.013107 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.013065 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c7jb" event={"ID":"af4f4ab4-9a30-4758-a255-44317f1962ce","Type":"ContainerStarted","Data":"e9195d5ee5bde13ae2c20d0c22cf9fad395b7f53d1a9b45cb68e828cec9049e8"} May 28 16:03:50.013107 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.013109 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2c7jb" event={"ID":"af4f4ab4-9a30-4758-a255-44317f1962ce","Type":"ContainerStarted","Data":"0952b870b695c55785a2c2b5b8c73c03831c7a61471966cace4b98e1a08a9012"} May 28 16:03:50.027239 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.027195 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:03:50.045635 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.045582 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.054441 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.054408 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 16:03:50.054681 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.054661 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 16:03:50.054874 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.054857 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-70q98u8hf58us\"" May 28 16:03:50.055028 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.054411 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 16:03:50.055202 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.055184 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8wtlh\"" May 28 16:03:50.055710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.055672 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.055940 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.056165 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.056405 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.056503 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.056744 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 16:03:50.057657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.057145 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 16:03:50.058387 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.058177 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 16:03:50.064581 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.064340 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 16:03:50.065163 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.065130 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:03:50.065701 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.065650 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2c7jb" podStartSLOduration=4.36920496 podStartE2EDuration="7.065635452s" podCreationTimestamp="2026-05-28 16:03:43 +0000 UTC" firstStartedPulling="2026-05-28 16:03:44.467284565 +0000 UTC m=+95.718199401" lastFinishedPulling="2026-05-28 16:03:47.163715054 +0000 UTC m=+98.414629893" observedRunningTime="2026-05-28 16:03:50.063033637 +0000 UTC m=+101.313948493" watchObservedRunningTime="2026-05-28 16:03:50.065635452 +0000 UTC m=+101.316550308" May 28 16:03:50.082890 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.082857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083400 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083496 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083556 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083609 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083609 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083763 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083763 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.083860 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.083812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2jv\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084499 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084660 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084660 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084893 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084893 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.084893 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.084873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186179 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186413 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186413 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186349 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186413 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186404 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186439 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2jv\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186498 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186540 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186585 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186624 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186677 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186734 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.186996 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.186770 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.187670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.187171 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.187670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.187455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.187670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.187514 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.187670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.187535 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.187670 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.187623 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.188360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.188263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.189313 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.188708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.189313 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.188739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.189481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.189400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.191704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.191677 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.192706 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.192671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.193431 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.193382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.193533 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.193443 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.193597 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.193539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.193834 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.193775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.194426 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.194255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.195958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.195010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.195958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.195082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.195958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.195136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.195958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.195432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.196266 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.195994 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.197201 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.197175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.197797 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.197744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2jv\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv\") pod \"prometheus-k8s-0\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:50.288559 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:50.287279 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d77d95_cb9f_4b90_8c4d_e75b56b5e177.slice/crio-63f98be01a617939d80a2b3662ef718d2895ec1651bdc2c4f4fa6b7f9454d6c3 WatchSource:0}: Error finding container 63f98be01a617939d80a2b3662ef718d2895ec1651bdc2c4f4fa6b7f9454d6c3: Status 404 returned error can't find the container with id 63f98be01a617939d80a2b3662ef718d2895ec1651bdc2c4f4fa6b7f9454d6c3 May 28 16:03:50.366641 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:50.366607 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:03:51.024044 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:51.024004 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" event={"ID":"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177","Type":"ContainerStarted","Data":"63f98be01a617939d80a2b3662ef718d2895ec1651bdc2c4f4fa6b7f9454d6c3"} May 28 16:03:51.938588 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:51.938536 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:03:51.996627 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:51.996460 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:03:51.997142 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:03:51.997103 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5982e7_c65c_4c7a_9f17_a13dd894e2cf.slice/crio-668efbb503331bf12b008f8e3bde42dcee463b97c031c55b8c5b6fdbd98bf035 WatchSource:0}: Error finding container 668efbb503331bf12b008f8e3bde42dcee463b97c031c55b8c5b6fdbd98bf035: Status 404 returned error can't find the container with id 668efbb503331bf12b008f8e3bde42dcee463b97c031c55b8c5b6fdbd98bf035 May 28 16:03:52.036529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.036466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"9af1c05215c842078a898bd89e747bfab058c9bae489f5dcec7349547d746886"} May 28 16:03:52.040132 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.040099 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"668efbb503331bf12b008f8e3bde42dcee463b97c031c55b8c5b6fdbd98bf035"} May 28 16:03:52.044044 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.043879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9597789c6-8qdxv" event={"ID":"f01d3438-28bc-41a1-a30c-5055f97debaa","Type":"ContainerStarted","Data":"aa403937ae22668726260600c58e0299246e43f29cad6e8611e9f632b10af487"} May 28 16:03:52.048308 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.048268 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558"} May 28 16:03:52.050022 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.049952 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" event={"ID":"6b49c3ef-1fd5-4f5f-9821-eddb2395b65b","Type":"ContainerStarted","Data":"fbe779e70f7375f76cf37e565be9bd4ddba0c3d7bd5612262c37c8472d4eac6e"} May 28 16:03:52.084459 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:52.083746 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" podStartSLOduration=1.852510574 podStartE2EDuration="5.083726712s" podCreationTimestamp="2026-05-28 16:03:47 +0000 UTC" firstStartedPulling="2026-05-28 16:03:48.573497284 +0000 UTC m=+99.824412131" lastFinishedPulling="2026-05-28 16:03:51.804713434 +0000 UTC m=+103.055628269" observedRunningTime="2026-05-28 16:03:52.082657164 +0000 UTC m=+103.333572034" watchObservedRunningTime="2026-05-28 16:03:52.083726712 +0000 UTC m=+103.334641569" May 28 16:03:53.056657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.056608 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="160a7419a4ee028664bf31eba9cb6ca11948c37ea5b6e50f7de8874782c254c8" exitCode=0 May 28 16:03:53.057217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.056713 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"160a7419a4ee028664bf31eba9cb6ca11948c37ea5b6e50f7de8874782c254c8"} May 28 16:03:53.058421 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.058393 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9597789c6-8qdxv" event={"ID":"f01d3438-28bc-41a1-a30c-5055f97debaa","Type":"ContainerStarted","Data":"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40"} May 28 16:03:53.062340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.062288 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a"} May 28 16:03:53.062467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.062354 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f"} May 28 16:03:53.062467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.062412 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e"} May 28 16:03:53.062467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.062427 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432"} May 28 16:03:53.064476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.064437 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"8b67f92e0136453889a5876d4d11be5cc745fc050f6dc7cf24221dedbaf973f6"} May 28 16:03:53.064476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.064475 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"7d6177b4ce43e047c004145a016fda20a11a2069151d8659c96985089d82a7e0"} May 28 16:03:53.148399 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:53.148346 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9597789c6-8qdxv" podStartSLOduration=4.148331156 podStartE2EDuration="4.148331156s" podCreationTimestamp="2026-05-28 16:03:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:53.147117351 +0000 UTC m=+104.398032207" watchObservedRunningTime="2026-05-28 16:03:53.148331156 +0000 UTC m=+104.399246011" May 28 16:03:55.076904 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.076863 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerStarted","Data":"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b"} May 28 16:03:55.079847 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.079813 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"326bd0f8061ccc6ac19e6dee1a12168a0b1c486a7b822a14445fc790fde71e11"} May 28 16:03:55.080031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.079855 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"b657f6e91cd621c806287151c3d31bfde1cd8f6b0f0379a215ee98a45f5ab885"} May 28 16:03:55.080031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.079873 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" event={"ID":"5962ac23-aa42-42db-8436-082adb3e8482","Type":"ContainerStarted","Data":"180026161ac1af76f67ddc66282162cb71c5330be684076730ab55f1e3da0abd"} May 28 16:03:55.080139 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.080029 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:03:55.081493 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.081460 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" event={"ID":"d6d77d95-cb9f-4b90-8c4d-e75b56b5e177","Type":"ContainerStarted","Data":"94a36455b2fa361bae4c631a013044356cc9a83d2d2cb7c742571a32de219583"} May 28 16:03:55.081705 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.081687 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:55.087747 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.087717 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" May 28 16:03:55.110010 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.109921 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.304639389 podStartE2EDuration="11.109905411s" podCreationTimestamp="2026-05-28 16:03:44 +0000 UTC" firstStartedPulling="2026-05-28 16:03:45.171895517 +0000 UTC m=+96.422810353" lastFinishedPulling="2026-05-28 16:03:53.977161541 +0000 UTC m=+105.228076375" observedRunningTime="2026-05-28 16:03:55.107520373 +0000 UTC m=+106.358435230" watchObservedRunningTime="2026-05-28 16:03:55.109905411 +0000 UTC m=+106.360820266" May 28 16:03:55.126348 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.126253 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vjstp" podStartSLOduration=3.442264307 podStartE2EDuration="7.126237923s" podCreationTimestamp="2026-05-28 16:03:48 +0000 UTC" firstStartedPulling="2026-05-28 16:03:50.291781034 +0000 UTC m=+101.542695872" lastFinishedPulling="2026-05-28 16:03:53.975754641 +0000 UTC m=+105.226669488" observedRunningTime="2026-05-28 16:03:55.125336897 +0000 UTC m=+106.376251755" watchObservedRunningTime="2026-05-28 16:03:55.126237923 +0000 UTC m=+106.377152777" May 28 16:03:55.156046 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:55.155987 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" podStartSLOduration=3.668791477 podStartE2EDuration="10.155968873s" podCreationTimestamp="2026-05-28 16:03:45 +0000 UTC" firstStartedPulling="2026-05-28 16:03:47.488941443 +0000 UTC m=+98.739856281" lastFinishedPulling="2026-05-28 16:03:53.976118844 +0000 UTC m=+105.227033677" observedRunningTime="2026-05-28 16:03:55.154620426 +0000 UTC m=+106.405535306" watchObservedRunningTime="2026-05-28 16:03:55.155968873 +0000 UTC m=+106.406883730" May 28 16:03:57.092752 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:57.092721 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"74beae8c4b7e712609070f223613df391badcc2c67b2bd0bf9215ff481993f33"} May 28 16:03:57.093115 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:57.092759 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"7b0bf38f31758fa90825c3b05e935ab9d64fe093d99f8f34b3a37f5f5bea1584"} May 28 16:03:57.093115 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:57.092768 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"fc77b776c81a30069c09b0f827d03d7f3238d348738df660bca3eb38c2971caf"} May 28 16:03:57.093115 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:57.092777 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"9c03130b5f074ff35d1f1a74d326bf8039f7719473366bc6a3071ff600c28328"} May 28 16:03:58.099292 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:58.099258 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"c0cc86e44f234f6790f9bce7322420f4aed073ea8b58c5b260d5f8cad4e9c2aa"} May 28 16:03:58.099690 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:58.099315 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerStarted","Data":"f1ede01282290d60081ec2f159cbf961f68230f64950277541f0984d909f8f57"} May 28 16:03:58.126959 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:58.126902 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.765594108 podStartE2EDuration="9.126883691s" podCreationTimestamp="2026-05-28 16:03:49 +0000 UTC" firstStartedPulling="2026-05-28 16:03:53.058446638 +0000 UTC m=+104.309361482" lastFinishedPulling="2026-05-28 16:03:56.419736228 +0000 UTC m=+107.670651065" observedRunningTime="2026-05-28 16:03:58.12478864 +0000 UTC m=+109.375703495" watchObservedRunningTime="2026-05-28 16:03:58.126883691 +0000 UTC m=+109.377798552" May 28 16:03:59.812028 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:59.811983 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:59.812028 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:59.812025 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:03:59.816948 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:03:59.816926 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:04:00.112942 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:00.112915 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:04:00.161485 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:00.161453 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:04:00.367954 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:00.367875 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:04:01.091134 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:01.091106 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59b599bf55-fqqkg" May 28 16:04:04.833247 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:04.833184 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" podUID="82a72019-5c77-4ead-8939-d55510533bcb" containerName="registry" containerID="cri-o://c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22" gracePeriod=30 May 28 16:04:05.102357 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.102328 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:04:05.134778 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.134745 2575 generic.go:358] "Generic (PLEG): container finished" podID="82a72019-5c77-4ead-8939-d55510533bcb" containerID="c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22" exitCode=0 May 28 16:04:05.134932 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.134816 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" May 28 16:04:05.134932 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.134824 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" event={"ID":"82a72019-5c77-4ead-8939-d55510533bcb","Type":"ContainerDied","Data":"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22"} May 28 16:04:05.134932 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.134859 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c447d6448-qr5kc" event={"ID":"82a72019-5c77-4ead-8939-d55510533bcb","Type":"ContainerDied","Data":"86f2eb100fa6aa9b601bbc499f0c3965b41fef713da3a06967e132ea7001d924"} May 28 16:04:05.134932 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.134874 2575 scope.go:117] "RemoveContainer" containerID="c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22" May 28 16:04:05.144467 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.144445 2575 scope.go:117] "RemoveContainer" containerID="c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22" May 28 16:04:05.144760 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:04:05.144733 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22\": container with ID starting with c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22 not found: ID does not exist" containerID="c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22" May 28 16:04:05.144855 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.144774 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22"} err="failed to get container status \"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22\": rpc error: code = NotFound desc = could not find container \"c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22\": container with ID starting with c61041904f95b23da837cd6d60b5628c6dd6a11217b18521794a9c03259adc22 not found: ID does not exist" May 28 16:04:05.257402 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257359 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257577 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257412 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc4xm\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257577 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257458 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257577 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257488 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257577 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257551 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257598 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257659 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257697 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets\") pod \"82a72019-5c77-4ead-8939-d55510533bcb\" (UID: \"82a72019-5c77-4ead-8939-d55510533bcb\") " May 28 16:04:05.257941 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.257827 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:05.258586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.258110 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-trusted-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.258586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.258388 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:05.260190 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.260142 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:05.260190 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.260158 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:04:05.260388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.260254 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:04:05.260388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.260344 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:05.260503 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.260459 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm" (OuterVolumeSpecName: "kube-api-access-zc4xm") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "kube-api-access-zc4xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:04:05.266968 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.266943 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82a72019-5c77-4ead-8939-d55510533bcb" (UID: "82a72019-5c77-4ead-8939-d55510533bcb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359095 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-installation-pull-secrets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359124 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc4xm\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-kube-api-access-zc4xm\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359135 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-registry-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359145 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a72019-5c77-4ead-8939-d55510533bcb-image-registry-private-configuration\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359155 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a72019-5c77-4ead-8939-d55510533bcb-registry-certificates\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359163 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a72019-5c77-4ead-8939-d55510533bcb-bound-sa-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.359171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.359173 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a72019-5c77-4ead-8939-d55510533bcb-ca-trust-extracted\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:05.452993 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.452959 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:04:05.457526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:05.457500 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c447d6448-qr5kc"] May 28 16:04:07.311113 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:07.311083 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a72019-5c77-4ead-8939-d55510533bcb" path="/var/lib/kubelet/pods/82a72019-5c77-4ead-8939-d55510533bcb/volumes" May 28 16:04:08.146956 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:08.146917 2575 generic.go:358] "Generic (PLEG): container finished" podID="7ccdf75b-b009-448f-aab0-776c93289ac0" containerID="847d6acb7cf85a1f44a3b9fba399e38fbbc8d9c7941f0dcf6e4bbe6c6dad1c03" exitCode=0 May 28 16:04:08.147148 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:08.146989 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" event={"ID":"7ccdf75b-b009-448f-aab0-776c93289ac0","Type":"ContainerDied","Data":"847d6acb7cf85a1f44a3b9fba399e38fbbc8d9c7941f0dcf6e4bbe6c6dad1c03"} May 28 16:04:08.147456 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:08.147438 2575 scope.go:117] "RemoveContainer" containerID="847d6acb7cf85a1f44a3b9fba399e38fbbc8d9c7941f0dcf6e4bbe6c6dad1c03" May 28 16:04:08.369422 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:08.369393 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:04:08.369790 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:08.369461 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:04:09.031846 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:09.031819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fdf595458-kqvgd_2b991597-e3b6-4982-be46-b6a97ded5161/router/0.log" May 28 16:04:09.045352 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:09.045327 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6g8g4_33e463e3-113e-4e69-974c-bdb1b0b889c5/serve-healthcheck-canary/0.log" May 28 16:04:09.151841 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:09.151809 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-86tf6" event={"ID":"7ccdf75b-b009-448f-aab0-776c93289ac0","Type":"ContainerStarted","Data":"31970a4256974fd0f03adb977eb0857b87fbae916aa108cdfea583c38e629c08"} May 28 16:04:12.164184 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:12.164150 2575 generic.go:358] "Generic (PLEG): container finished" podID="16e6f5c3-dc9f-41c5-8648-35e679c765b3" containerID="ef5713131c3788f17bdf6bc946d9d8d52c35617bf6c127e1800ab14417c94eb1" exitCode=0 May 28 16:04:12.164567 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:12.164224 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" event={"ID":"16e6f5c3-dc9f-41c5-8648-35e679c765b3","Type":"ContainerDied","Data":"ef5713131c3788f17bdf6bc946d9d8d52c35617bf6c127e1800ab14417c94eb1"} May 28 16:04:12.164616 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:12.164606 2575 scope.go:117] "RemoveContainer" containerID="ef5713131c3788f17bdf6bc946d9d8d52c35617bf6c127e1800ab14417c94eb1" May 28 16:04:13.169936 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:13.169898 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bxzf7" event={"ID":"16e6f5c3-dc9f-41c5-8648-35e679c765b3","Type":"ContainerStarted","Data":"78b634112577ebfdf8c1457a94213e0dcbb03b31caf0232622c67cb251d465a0"} May 28 16:04:14.156751 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.156683 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f84986b44-7gjrw" podUID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" containerName="console" containerID="cri-o://50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d" gracePeriod=15 May 28 16:04:14.439968 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.439946 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f84986b44-7gjrw_72c4b33c-649d-4cf6-8196-1f52f9a8721f/console/0.log" May 28 16:04:14.440340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.440021 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:04:14.549624 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549590 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.549815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549668 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.549815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549697 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.549815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549736 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkxht\" (UniqueName: \"kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.549815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549795 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.550019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.549871 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert\") pod \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\" (UID: \"72c4b33c-649d-4cf6-8196-1f52f9a8721f\") " May 28 16:04:14.550102 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.550070 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config" (OuterVolumeSpecName: "console-config") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:14.550155 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.550093 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca" (OuterVolumeSpecName: "service-ca") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:14.550284 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.550267 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:14.550367 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.550288 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:14.550367 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.550289 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:14.552036 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.552011 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:14.552139 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.552097 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:14.552139 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.552108 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht" (OuterVolumeSpecName: "kube-api-access-lkxht") pod "72c4b33c-649d-4cf6-8196-1f52f9a8721f" (UID: "72c4b33c-649d-4cf6-8196-1f52f9a8721f"). InnerVolumeSpecName "kube-api-access-lkxht". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:04:14.651405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.651359 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkxht\" (UniqueName: \"kubernetes.io/projected/72c4b33c-649d-4cf6-8196-1f52f9a8721f-kube-api-access-lkxht\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:14.651405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.651398 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:14.651405 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.651413 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72c4b33c-649d-4cf6-8196-1f52f9a8721f-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:14.651639 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:14.651426 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c4b33c-649d-4cf6-8196-1f52f9a8721f-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:15.178950 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.178915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f84986b44-7gjrw_72c4b33c-649d-4cf6-8196-1f52f9a8721f/console/0.log" May 28 16:04:15.179120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.178954 2575 generic.go:358] "Generic (PLEG): container finished" podID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" containerID="50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d" exitCode=2 May 28 16:04:15.179120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.179020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f84986b44-7gjrw" event={"ID":"72c4b33c-649d-4cf6-8196-1f52f9a8721f","Type":"ContainerDied","Data":"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d"} May 28 16:04:15.179120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.179025 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f84986b44-7gjrw" May 28 16:04:15.179120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.179047 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f84986b44-7gjrw" event={"ID":"72c4b33c-649d-4cf6-8196-1f52f9a8721f","Type":"ContainerDied","Data":"c6829c8e17d0653d30a4e46e889c1e01cd7144073f49d0806df62eefb4fd7147"} May 28 16:04:15.179120 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.179061 2575 scope.go:117] "RemoveContainer" containerID="50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d" May 28 16:04:15.187899 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.187878 2575 scope.go:117] "RemoveContainer" containerID="50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d" May 28 16:04:15.188139 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:04:15.188122 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d\": container with ID starting with 50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d not found: ID does not exist" containerID="50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d" May 28 16:04:15.188192 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.188147 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d"} err="failed to get container status \"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d\": rpc error: code = NotFound desc = could not find container \"50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d\": container with ID starting with 50542f86e43b790c2dbadc9a1576b3c112836eddb2a742c392f67cc7eb0ba21d not found: ID does not exist" May 28 16:04:15.201745 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.201711 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:04:15.204745 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.204723 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f84986b44-7gjrw"] May 28 16:04:15.311492 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:15.311459 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" path="/var/lib/kubelet/pods/72c4b33c-649d-4cf6-8196-1f52f9a8721f/volumes" May 28 16:04:17.189234 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:17.189199 2575 generic.go:358] "Generic (PLEG): container finished" podID="7301293c-aa7c-499e-865c-59487a34a47e" containerID="7870902863e99f4d5d69284aa68fd833e8e7a78136f2adf352a6f66b47b0dc73" exitCode=0 May 28 16:04:17.189637 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:17.189272 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" event={"ID":"7301293c-aa7c-499e-865c-59487a34a47e","Type":"ContainerDied","Data":"7870902863e99f4d5d69284aa68fd833e8e7a78136f2adf352a6f66b47b0dc73"} May 28 16:04:17.189682 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:17.189664 2575 scope.go:117] "RemoveContainer" containerID="7870902863e99f4d5d69284aa68fd833e8e7a78136f2adf352a6f66b47b0dc73" May 28 16:04:18.196872 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:18.196839 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8bg96" event={"ID":"7301293c-aa7c-499e-865c-59487a34a47e","Type":"ContainerStarted","Data":"bcaf0ee16db5b276da076e415348d9f112b20cfba3a5ea49f68e3259e56f2834"} May 28 16:04:25.182431 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.182385 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f795fcb49-jck66" podUID="092976b5-867a-4d22-91bb-a4d5ad6546fe" containerName="console" containerID="cri-o://003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389" gracePeriod=15 May 28 16:04:25.476474 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.476451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f795fcb49-jck66_092976b5-867a-4d22-91bb-a4d5ad6546fe/console/0.log" May 28 16:04:25.476611 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.476511 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f795fcb49-jck66" May 28 16:04:25.558323 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558265 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558344 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558491 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558569 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558520 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558569 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558560 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558694 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558678 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w44g\" (UniqueName: \"kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558753 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558711 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert\") pod \"092976b5-867a-4d22-91bb-a4d5ad6546fe\" (UID: \"092976b5-867a-4d22-91bb-a4d5ad6546fe\") " May 28 16:04:25.558814 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558789 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:25.558870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558812 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config" (OuterVolumeSpecName: "console-config") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:25.558870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558852 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:25.558971 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.558901 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:04:25.559117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.559098 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.559117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.559116 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.559553 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.559126 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.559553 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.559141 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092976b5-867a-4d22-91bb-a4d5ad6546fe-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.560825 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.560789 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:25.560913 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.560826 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g" (OuterVolumeSpecName: "kube-api-access-2w44g") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "kube-api-access-2w44g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:04:25.560913 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.560855 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "092976b5-867a-4d22-91bb-a4d5ad6546fe" (UID: "092976b5-867a-4d22-91bb-a4d5ad6546fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:04:25.659717 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.659682 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w44g\" (UniqueName: \"kubernetes.io/projected/092976b5-867a-4d22-91bb-a4d5ad6546fe-kube-api-access-2w44g\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.659717 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.659711 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:25.659717 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:25.659721 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092976b5-867a-4d22-91bb-a4d5ad6546fe-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:04:26.229288 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f795fcb49-jck66_092976b5-867a-4d22-91bb-a4d5ad6546fe/console/0.log" May 28 16:04:26.229710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229323 2575 generic.go:358] "Generic (PLEG): container finished" podID="092976b5-867a-4d22-91bb-a4d5ad6546fe" containerID="003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389" exitCode=2 May 28 16:04:26.229710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229385 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f795fcb49-jck66" May 28 16:04:26.229710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229411 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f795fcb49-jck66" event={"ID":"092976b5-867a-4d22-91bb-a4d5ad6546fe","Type":"ContainerDied","Data":"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389"} May 28 16:04:26.229710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229445 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f795fcb49-jck66" event={"ID":"092976b5-867a-4d22-91bb-a4d5ad6546fe","Type":"ContainerDied","Data":"fff73ab88bcfc16bf8a5e159f114e1edf021a323a771b39c9c6fcd7ad2c588ac"} May 28 16:04:26.229710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.229461 2575 scope.go:117] "RemoveContainer" containerID="003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389" May 28 16:04:26.238451 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.238428 2575 scope.go:117] "RemoveContainer" containerID="003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389" May 28 16:04:26.238692 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:04:26.238674 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389\": container with ID starting with 003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389 not found: ID does not exist" containerID="003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389" May 28 16:04:26.238737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.238700 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389"} err="failed to get container status \"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389\": rpc error: code = NotFound desc = could not find container \"003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389\": container with ID starting with 003c695f337aab0cfa4173ba34c277442eed45b6524bc892523d6e1048cd0389 not found: ID does not exist" May 28 16:04:26.251798 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.251771 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:04:26.257672 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:26.257651 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f795fcb49-jck66"] May 28 16:04:27.310835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:27.310804 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092976b5-867a-4d22-91bb-a4d5ad6546fe" path="/var/lib/kubelet/pods/092976b5-867a-4d22-91bb-a4d5ad6546fe/volumes" May 28 16:04:28.374203 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:28.374172 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:04:28.378253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:28.378229 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79b586d48b-tdfrf" May 28 16:04:50.367451 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:50.367414 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:04:50.383373 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:50.383348 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:04:51.339895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:04:51.339826 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:05:03.923311 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923269 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:05:03.923793 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923724 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="alertmanager" containerID="cri-o://eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558" gracePeriod=120 May 28 16:05:03.923861 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923802 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-metric" containerID="cri-o://83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a" gracePeriod=120 May 28 16:05:03.923914 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923832 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy" containerID="cri-o://51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f" gracePeriod=120 May 28 16:05:03.923914 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923877 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="prom-label-proxy" containerID="cri-o://903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b" gracePeriod=120 May 28 16:05:03.923914 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923833 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-web" containerID="cri-o://1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e" gracePeriod=120 May 28 16:05:03.924061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:03.923837 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="config-reloader" containerID="cri-o://bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432" gracePeriod=120 May 28 16:05:04.372895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372863 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b" exitCode=0 May 28 16:05:04.372895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372889 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a" exitCode=0 May 28 16:05:04.372895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372897 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f" exitCode=0 May 28 16:05:04.372895 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372903 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432" exitCode=0 May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372912 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558" exitCode=0 May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372933 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b"} May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372965 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a"} May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372975 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f"} May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372984 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432"} May 28 16:05:04.373159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:04.372993 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558"} May 28 16:05:05.193582 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.193556 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 16:05:05.350946 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.350921 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351126 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.350978 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351126 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351007 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351250 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351117 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351250 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351175 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkv6d\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351250 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351205 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351257 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351284 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351388 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351404 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:05.351440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351415 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351700 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351507 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351700 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351572 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.351700 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351657 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"72e253bc-8705-4b33-9617-89b1b434f8fd\" (UID: \"72e253bc-8705-4b33-9617-89b1b434f8fd\") " May 28 16:05:05.352238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.351874 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:05:05.352238 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.352192 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:05.352855 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.352833 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-metrics-client-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.352949 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.352860 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-main-db\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.352949 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.352878 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e253bc-8705-4b33-9617-89b1b434f8fd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.354567 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.354531 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:05:05.355171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355142 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume" (OuterVolumeSpecName: "config-volume") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.355288 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355165 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d" (OuterVolumeSpecName: "kube-api-access-bkv6d") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "kube-api-access-bkv6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:05:05.355288 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355201 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.355424 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355317 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.355468 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355444 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.355542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355508 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.355622 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.355601 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out" (OuterVolumeSpecName: "config-out") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:05:05.360584 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.360562 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.367805 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.367782 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config" (OuterVolumeSpecName: "web-config") pod "72e253bc-8705-4b33-9617-89b1b434f8fd" (UID: "72e253bc-8705-4b33-9617-89b1b434f8fd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:05.380383 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.380359 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerID="1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e" exitCode=0 May 28 16:05:05.380500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.380442 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e"} May 28 16:05:05.380500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.380462 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 28 16:05:05.380500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.380484 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72e253bc-8705-4b33-9617-89b1b434f8fd","Type":"ContainerDied","Data":"d43076a9ae091e427c00aeb922b9b96fed76935b99aa7ea421bcb40b08819b7e"} May 28 16:05:05.380500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.380500 2575 scope.go:117] "RemoveContainer" containerID="903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b" May 28 16:05:05.388449 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.388428 2575 scope.go:117] "RemoveContainer" containerID="83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a" May 28 16:05:05.395918 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.395902 2575 scope.go:117] "RemoveContainer" containerID="51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f" May 28 16:05:05.403051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.403035 2575 scope.go:117] "RemoveContainer" containerID="1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e" May 28 16:05:05.408140 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.408116 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:05:05.411462 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.411415 2575 scope.go:117] "RemoveContainer" containerID="bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432" May 28 16:05:05.415466 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.415443 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 28 16:05:05.419362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.419345 2575 scope.go:117] "RemoveContainer" containerID="eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558" May 28 16:05:05.426367 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.426349 2575 scope.go:117] "RemoveContainer" containerID="8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c" May 28 16:05:05.433262 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.433234 2575 scope.go:117] "RemoveContainer" containerID="903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b" May 28 16:05:05.433547 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.433528 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b\": container with ID starting with 903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b not found: ID does not exist" containerID="903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b" May 28 16:05:05.433603 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.433555 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b"} err="failed to get container status \"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b\": rpc error: code = NotFound desc = could not find container \"903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b\": container with ID starting with 903a9f93210b881254ead868aba25356a2744e9ba9d17ff8d0340a05496ac77b not found: ID does not exist" May 28 16:05:05.433603 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.433575 2575 scope.go:117] "RemoveContainer" containerID="83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a" May 28 16:05:05.433817 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.433790 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a\": container with ID starting with 83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a not found: ID does not exist" containerID="83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a" May 28 16:05:05.433858 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.433824 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a"} err="failed to get container status \"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a\": rpc error: code = NotFound desc = could not find container \"83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a\": container with ID starting with 83924d919c3218ed47345774b8b8de84d8c0555bdb918540de50e2b8834ce44a not found: ID does not exist" May 28 16:05:05.433858 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.433842 2575 scope.go:117] "RemoveContainer" containerID="51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f" May 28 16:05:05.434064 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.434050 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f\": container with ID starting with 51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f not found: ID does not exist" containerID="51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f" May 28 16:05:05.434099 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434068 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f"} err="failed to get container status \"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f\": rpc error: code = NotFound desc = could not find container \"51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f\": container with ID starting with 51a9154e10220b0ddd6d80384e21ce6674d6de1a2d25c4b95ad53a29115b251f not found: ID does not exist" May 28 16:05:05.434099 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434084 2575 scope.go:117] "RemoveContainer" containerID="1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e" May 28 16:05:05.434283 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.434268 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e\": container with ID starting with 1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e not found: ID does not exist" containerID="1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e" May 28 16:05:05.434391 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434288 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e"} err="failed to get container status \"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e\": rpc error: code = NotFound desc = could not find container \"1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e\": container with ID starting with 1fc68d6a17528e64be561e0be28c45d1209e9e73387d6dabe1cae28e3e67f99e not found: ID does not exist" May 28 16:05:05.434391 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434318 2575 scope.go:117] "RemoveContainer" containerID="bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432" May 28 16:05:05.434582 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.434556 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432\": container with ID starting with bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432 not found: ID does not exist" containerID="bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432" May 28 16:05:05.434620 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434591 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432"} err="failed to get container status \"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432\": rpc error: code = NotFound desc = could not find container \"bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432\": container with ID starting with bf71d117189c54cfc7735662ac0cf01e303dbd96941e7659ccea63032864f432 not found: ID does not exist" May 28 16:05:05.434620 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434608 2575 scope.go:117] "RemoveContainer" containerID="eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558" May 28 16:05:05.434806 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.434792 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558\": container with ID starting with eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558 not found: ID does not exist" containerID="eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558" May 28 16:05:05.434845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434808 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558"} err="failed to get container status \"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558\": rpc error: code = NotFound desc = could not find container \"eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558\": container with ID starting with eaa3f8b8b1614471c48eae2649145ccbbb2ff1d0db49acd37405311670378558 not found: ID does not exist" May 28 16:05:05.434845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.434819 2575 scope.go:117] "RemoveContainer" containerID="8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c" May 28 16:05:05.435044 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:05.435025 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c\": container with ID starting with 8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c not found: ID does not exist" containerID="8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c" May 28 16:05:05.435089 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.435051 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c"} err="failed to get container status \"8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c\": rpc error: code = NotFound desc = could not find container \"8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c\": container with ID starting with 8d4dc55af466dacc07f0aa751a4fc7bce0f97460d73d5265dd85393d096d532c not found: ID does not exist" May 28 16:05:05.454599 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454553 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454599 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454591 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-tls-assets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454609 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-cluster-tls-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454622 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454633 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkv6d\" (UniqueName: \"kubernetes.io/projected/72e253bc-8705-4b33-9617-89b1b434f8fd-kube-api-access-bkv6d\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454642 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-main-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454652 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e253bc-8705-4b33-9617-89b1b434f8fd-config-out\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454660 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-config-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454668 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:05.454789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:05.454677 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e253bc-8705-4b33-9617-89b1b434f8fd-web-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:07.316663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:07.316628 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" path="/var/lib/kubelet/pods/72e253bc-8705-4b33-9617-89b1b434f8fd/volumes" May 28 16:05:08.256005 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.255961 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256587 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="prometheus" containerID="cri-o://9c03130b5f074ff35d1f1a74d326bf8039f7719473366bc6a3071ff600c28328" gracePeriod=600 May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256605 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy" containerID="cri-o://c0cc86e44f234f6790f9bce7322420f4aed073ea8b58c5b260d5f8cad4e9c2aa" gracePeriod=600 May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256632 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-web" containerID="cri-o://74beae8c4b7e712609070f223613df391badcc2c67b2bd0bf9215ff481993f33" gracePeriod=600 May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256633 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="config-reloader" containerID="cri-o://fc77b776c81a30069c09b0f827d03d7f3238d348738df660bca3eb38c2971caf" gracePeriod=600 May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256682 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f1ede01282290d60081ec2f159cbf961f68230f64950277541f0984d909f8f57" gracePeriod=600 May 28 16:05:08.256786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.256605 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="thanos-sidecar" containerID="cri-o://7b0bf38f31758fa90825c3b05e935ab9d64fe093d99f8f34b3a37f5f5bea1584" gracePeriod=600 May 28 16:05:08.398748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398717 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="f1ede01282290d60081ec2f159cbf961f68230f64950277541f0984d909f8f57" exitCode=0 May 28 16:05:08.398748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398743 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="c0cc86e44f234f6790f9bce7322420f4aed073ea8b58c5b260d5f8cad4e9c2aa" exitCode=0 May 28 16:05:08.398748 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398750 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="74beae8c4b7e712609070f223613df391badcc2c67b2bd0bf9215ff481993f33" exitCode=0 May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398758 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="7b0bf38f31758fa90825c3b05e935ab9d64fe093d99f8f34b3a37f5f5bea1584" exitCode=0 May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398764 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="fc77b776c81a30069c09b0f827d03d7f3238d348738df660bca3eb38c2971caf" exitCode=0 May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398770 2575 generic.go:358] "Generic (PLEG): container finished" podID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerID="9c03130b5f074ff35d1f1a74d326bf8039f7719473366bc6a3071ff600c28328" exitCode=0 May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398799 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"f1ede01282290d60081ec2f159cbf961f68230f64950277541f0984d909f8f57"} May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398846 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"c0cc86e44f234f6790f9bce7322420f4aed073ea8b58c5b260d5f8cad4e9c2aa"} May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398859 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"74beae8c4b7e712609070f223613df391badcc2c67b2bd0bf9215ff481993f33"} May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"7b0bf38f31758fa90825c3b05e935ab9d64fe093d99f8f34b3a37f5f5bea1584"} May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398883 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"fc77b776c81a30069c09b0f827d03d7f3238d348738df660bca3eb38c2971caf"} May 28 16:05:08.399174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.398897 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"9c03130b5f074ff35d1f1a74d326bf8039f7719473366bc6a3071ff600c28328"} May 28 16:05:08.537668 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.537641 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:05:08.685232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685197 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685232 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685237 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q2jv\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685261 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685329 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685446 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685493 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685540 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685572 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685601 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685640 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685679 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685720 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685742 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685768 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685803 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685835 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685888 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:08.685962 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685901 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.686321 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.685983 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\" (UID: \"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf\") " May 28 16:05:08.686413 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.686394 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.687393 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.687361 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:08.688327 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.688283 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv" (OuterVolumeSpecName: "kube-api-access-8q2jv") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "kube-api-access-8q2jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:05:08.688507 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.688475 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:08.689598 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.688592 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:08.689598 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.688596 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:05:08.689598 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.688867 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689821 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689716 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689821 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689776 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:05:08.689821 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689797 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689984 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689831 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689984 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689849 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config" (OuterVolumeSpecName: "config") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689984 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689876 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.689984 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.689905 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:08.690211 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.690185 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.690636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.690617 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out" (OuterVolumeSpecName: "config-out") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:05:08.690814 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.690790 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.702349 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.702320 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config" (OuterVolumeSpecName: "web-config") pod "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" (UID: "ed5982e7-c65c-4c7a-9f17-a13dd894e2cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786898 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786945 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-web-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786957 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config-out\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786966 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786976 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786986 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.786994 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-prometheus-k8s-db\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787003 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787012 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787023 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-tls-assets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787031 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q2jv\" (UniqueName: \"kubernetes.io/projected/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-kube-api-access-8q2jv\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787039 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-metrics-client-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787048 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787057 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-kube-rbac-proxy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787066 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787075 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-configmap-metrics-client-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:08.787428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:08.787083 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf-secret-grpc-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:09.404385 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.404344 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed5982e7-c65c-4c7a-9f17-a13dd894e2cf","Type":"ContainerDied","Data":"668efbb503331bf12b008f8e3bde42dcee463b97c031c55b8c5b6fdbd98bf035"} May 28 16:05:09.404874 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.404412 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 16:05:09.404874 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.404400 2575 scope.go:117] "RemoveContainer" containerID="f1ede01282290d60081ec2f159cbf961f68230f64950277541f0984d909f8f57" May 28 16:05:09.412478 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.412457 2575 scope.go:117] "RemoveContainer" containerID="c0cc86e44f234f6790f9bce7322420f4aed073ea8b58c5b260d5f8cad4e9c2aa" May 28 16:05:09.419491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.419459 2575 scope.go:117] "RemoveContainer" containerID="74beae8c4b7e712609070f223613df391badcc2c67b2bd0bf9215ff481993f33" May 28 16:05:09.426788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.426765 2575 scope.go:117] "RemoveContainer" containerID="7b0bf38f31758fa90825c3b05e935ab9d64fe093d99f8f34b3a37f5f5bea1584" May 28 16:05:09.428164 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.428139 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:05:09.432779 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.432754 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 16:05:09.434952 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.434935 2575 scope.go:117] "RemoveContainer" containerID="fc77b776c81a30069c09b0f827d03d7f3238d348738df660bca3eb38c2971caf" May 28 16:05:09.441637 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.441620 2575 scope.go:117] "RemoveContainer" containerID="9c03130b5f074ff35d1f1a74d326bf8039f7719473366bc6a3071ff600c28328" May 28 16:05:09.448492 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:09.448473 2575 scope.go:117] "RemoveContainer" containerID="160a7419a4ee028664bf31eba9cb6ca11948c37ea5b6e50f7de8874782c254c8" May 28 16:05:11.313511 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.313473 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" path="/var/lib/kubelet/pods/ed5982e7-c65c-4c7a-9f17-a13dd894e2cf/volumes" May 28 16:05:11.561338 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561287 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:05:11.561685 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561672 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092976b5-867a-4d22-91bb-a4d5ad6546fe" containerName="console" May 28 16:05:11.561727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561689 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="092976b5-867a-4d22-91bb-a4d5ad6546fe" containerName="console" May 28 16:05:11.561727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561702 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="config-reloader" May 28 16:05:11.561727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561708 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="config-reloader" May 28 16:05:11.561727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561716 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-web" May 28 16:05:11.561727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561723 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-web" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561733 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-metric" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561738 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-metric" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561746 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="prometheus" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561751 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="prometheus" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561758 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="init-config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561765 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="init-config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561776 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="prom-label-proxy" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561782 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="prom-label-proxy" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561823 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-web" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561830 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-web" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561840 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561848 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561859 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="init-config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561865 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="init-config-reloader" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561870 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-thanos" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561875 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-thanos" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561886 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561891 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561896 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a72019-5c77-4ead-8939-d55510533bcb" containerName="registry" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561901 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a72019-5c77-4ead-8939-d55510533bcb" containerName="registry" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561907 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" containerName="console" May 28 16:05:11.561902 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561912 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" containerName="console" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561936 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="alertmanager" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561956 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="alertmanager" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561961 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="thanos-sidecar" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561966 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="thanos-sidecar" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561979 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.561986 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562060 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72c4b33c-649d-4cf6-8196-1f52f9a8721f" containerName="console" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562096 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="thanos-sidecar" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562109 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-web" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562121 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="alertmanager" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562127 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="prom-label-proxy" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562137 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="prometheus" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562148 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562168 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="config-reloader" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562182 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy-thanos" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562191 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="092976b5-867a-4d22-91bb-a4d5ad6546fe" containerName="console" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562198 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="config-reloader" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562204 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-web" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562212 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="82a72019-5c77-4ead-8939-d55510533bcb" containerName="registry" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562222 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72e253bc-8705-4b33-9617-89b1b434f8fd" containerName="kube-rbac-proxy-metric" May 28 16:05:11.562852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.562231 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed5982e7-c65c-4c7a-9f17-a13dd894e2cf" containerName="kube-rbac-proxy" May 28 16:05:11.567469 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.567400 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.578025 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.577999 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:05:11.714730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.714919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.714919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.714919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.715068 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.715068 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.714941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22smr\" (UniqueName: \"kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.715068 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.715036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816516 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816516 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816519 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816542 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816563 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22smr\" (UniqueName: \"kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816592 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816652 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.816772 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.816691 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.817435 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.817406 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.817570 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.817526 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.817627 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.817573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.817627 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.817573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.818994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.818970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.819074 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.819019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.824901 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.824878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22smr\" (UniqueName: \"kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr\") pod \"console-6ddc586d54-b8fsv\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:11.878964 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:11.878922 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:12.007765 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:12.007710 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:05:12.010007 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:05:12.009980 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb089c9_91b3_43c4_99c9_8be3516afcf5.slice/crio-d4d13d54113e34d8ce3b99c5f099f9ae188f6438e9a28b0a4b979dc81cbb81fc WatchSource:0}: Error finding container d4d13d54113e34d8ce3b99c5f099f9ae188f6438e9a28b0a4b979dc81cbb81fc: Status 404 returned error can't find the container with id d4d13d54113e34d8ce3b99c5f099f9ae188f6438e9a28b0a4b979dc81cbb81fc May 28 16:05:12.417602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:12.417568 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddc586d54-b8fsv" event={"ID":"8eb089c9-91b3-43c4-99c9-8be3516afcf5","Type":"ContainerStarted","Data":"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2"} May 28 16:05:12.417602 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:12.417605 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddc586d54-b8fsv" event={"ID":"8eb089c9-91b3-43c4-99c9-8be3516afcf5","Type":"ContainerStarted","Data":"d4d13d54113e34d8ce3b99c5f099f9ae188f6438e9a28b0a4b979dc81cbb81fc"} May 28 16:05:12.441775 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:12.441719 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6ddc586d54-b8fsv" podStartSLOduration=1.441703881 podStartE2EDuration="1.441703881s" podCreationTimestamp="2026-05-28 16:05:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:05:12.440395829 +0000 UTC m=+183.691310686" watchObservedRunningTime="2026-05-28 16:05:12.441703881 +0000 UTC m=+183.692618735" May 28 16:05:21.879452 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:21.879404 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:21.879452 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:21.879460 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:21.884265 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:21.884240 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:22.457019 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:22.456988 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:05:22.506124 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:22.506087 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:05:47.527996 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.527924 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9597789c6-8qdxv" podUID="f01d3438-28bc-41a1-a30c-5055f97debaa" containerName="console" containerID="cri-o://24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40" gracePeriod=15 May 28 16:05:47.795526 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.795500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9597789c6-8qdxv_f01d3438-28bc-41a1-a30c-5055f97debaa/console/0.log" May 28 16:05:47.795667 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.795569 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:05:47.945071 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945033 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945071 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945073 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945110 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck76g\" (UniqueName: \"kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945130 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945176 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945224 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945286 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945259 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert\") pod \"f01d3438-28bc-41a1-a30c-5055f97debaa\" (UID: \"f01d3438-28bc-41a1-a30c-5055f97debaa\") " May 28 16:05:47.945668 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945622 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:47.945668 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945644 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca" (OuterVolumeSpecName: "service-ca") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:47.945668 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945652 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config" (OuterVolumeSpecName: "console-config") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:47.945999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.945855 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:05:47.947325 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.947290 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:47.947474 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.947450 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g" (OuterVolumeSpecName: "kube-api-access-ck76g") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "kube-api-access-ck76g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:05:47.947557 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:47.947471 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f01d3438-28bc-41a1-a30c-5055f97debaa" (UID: "f01d3438-28bc-41a1-a30c-5055f97debaa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046045 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046077 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046087 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046097 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f01d3438-28bc-41a1-a30c-5055f97debaa-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046107 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046116 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck76g\" (UniqueName: \"kubernetes.io/projected/f01d3438-28bc-41a1-a30c-5055f97debaa-kube-api-access-ck76g\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.046131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.046126 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f01d3438-28bc-41a1-a30c-5055f97debaa-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:05:48.547655 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9597789c6-8qdxv_f01d3438-28bc-41a1-a30c-5055f97debaa/console/0.log" May 28 16:05:48.548051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547669 2575 generic.go:358] "Generic (PLEG): container finished" podID="f01d3438-28bc-41a1-a30c-5055f97debaa" containerID="24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40" exitCode=2 May 28 16:05:48.548051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547736 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9597789c6-8qdxv" May 28 16:05:48.548051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547743 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9597789c6-8qdxv" event={"ID":"f01d3438-28bc-41a1-a30c-5055f97debaa","Type":"ContainerDied","Data":"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40"} May 28 16:05:48.548051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547773 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9597789c6-8qdxv" event={"ID":"f01d3438-28bc-41a1-a30c-5055f97debaa","Type":"ContainerDied","Data":"aa403937ae22668726260600c58e0299246e43f29cad6e8611e9f632b10af487"} May 28 16:05:48.548051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.547788 2575 scope.go:117] "RemoveContainer" containerID="24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40" May 28 16:05:48.559093 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.559066 2575 scope.go:117] "RemoveContainer" containerID="24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40" May 28 16:05:48.559529 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:48.559504 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40\": container with ID starting with 24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40 not found: ID does not exist" containerID="24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40" May 28 16:05:48.559613 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.559538 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40"} err="failed to get container status \"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40\": rpc error: code = NotFound desc = could not find container \"24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40\": container with ID starting with 24c79aeb71cf8947a284ddd9074391a24ba622b574608b7ab3cb588ff2121a40 not found: ID does not exist" May 28 16:05:48.570453 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.570425 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:05:48.574451 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:48.574421 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9597789c6-8qdxv"] May 28 16:05:49.311245 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:49.311216 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f01d3438-28bc-41a1-a30c-5055f97debaa" path="/var/lib/kubelet/pods/f01d3438-28bc-41a1-a30c-5055f97debaa/volumes" May 28 16:05:56.102450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.102413 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ktnz5"] May 28 16:05:56.103009 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.102959 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01d3438-28bc-41a1-a30c-5055f97debaa" containerName="console" May 28 16:05:56.103009 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.103010 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01d3438-28bc-41a1-a30c-5055f97debaa" containerName="console" May 28 16:05:56.103224 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.103203 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="f01d3438-28bc-41a1-a30c-5055f97debaa" containerName="console" May 28 16:05:56.106555 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.106534 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.108913 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.108882 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 16:05:56.109008 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.108882 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 16:05:56.109062 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.108981 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-67m8x\"" May 28 16:05:56.116447 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.116425 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktnz5"] May 28 16:05:56.214718 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.214685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-crio-socket\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.214718 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.214719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.214917 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.214746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-data-volume\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.214917 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.214835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98dsj\" (UniqueName: \"kubernetes.io/projected/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-api-access-98dsj\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.214984 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.214947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315421 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315386 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315444 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-crio-socket\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315472 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315508 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-data-volume\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:56.315512 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-crio-socket\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315586 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:05:56.315571 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls podName:62d3bfc7-60eb-441c-bd4c-0ff0567b67ca nodeName:}" failed. No retries permitted until 2026-05-28 16:05:56.815550501 +0000 UTC m=+228.066465335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ktnz5" (UID: "62d3bfc7-60eb-441c-bd4c-0ff0567b67ca") : secret "insights-runtime-extractor-tls" not found May 28 16:05:56.315900 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315597 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98dsj\" (UniqueName: \"kubernetes.io/projected/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-api-access-98dsj\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.315900 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.315821 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-data-volume\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.316114 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.316094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.323835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.323814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98dsj\" (UniqueName: \"kubernetes.io/projected/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-kube-api-access-98dsj\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.821142 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.821101 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:56.823433 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:56.823406 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62d3bfc7-60eb-441c-bd4c-0ff0567b67ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktnz5\" (UID: \"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca\") " pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:57.017173 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:57.017122 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktnz5" May 28 16:05:57.149995 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:57.149968 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktnz5"] May 28 16:05:57.152660 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:05:57.152621 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d3bfc7_60eb_441c_bd4c_0ff0567b67ca.slice/crio-3e311afa323ee0aa49666d9df33b5312ed0246cbe39bd9bb74eddc9d45280455 WatchSource:0}: Error finding container 3e311afa323ee0aa49666d9df33b5312ed0246cbe39bd9bb74eddc9d45280455: Status 404 returned error can't find the container with id 3e311afa323ee0aa49666d9df33b5312ed0246cbe39bd9bb74eddc9d45280455 May 28 16:05:57.584369 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:57.584329 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktnz5" event={"ID":"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca","Type":"ContainerStarted","Data":"f4df934fbd85d2fe73f45c996a39d99a87735bd38f18283d8bfaff12887ccabe"} May 28 16:05:57.584369 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:57.584375 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktnz5" event={"ID":"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca","Type":"ContainerStarted","Data":"3e311afa323ee0aa49666d9df33b5312ed0246cbe39bd9bb74eddc9d45280455"} May 28 16:05:58.590464 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:58.590421 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktnz5" event={"ID":"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca","Type":"ContainerStarted","Data":"610cfc8782ba70c9bc86f520432caa2acbec1b032f90b495cf9614f2d9fe1e7f"} May 28 16:05:59.595730 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:59.595688 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktnz5" event={"ID":"62d3bfc7-60eb-441c-bd4c-0ff0567b67ca","Type":"ContainerStarted","Data":"14fe3290c54afb3ece6d6d86e7b0f0b264408ae368b3c838bf88f9d43ff33e91"} May 28 16:05:59.616241 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:05:59.616194 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ktnz5" podStartSLOduration=1.6225732320000001 podStartE2EDuration="3.616181094s" podCreationTimestamp="2026-05-28 16:05:56 +0000 UTC" firstStartedPulling="2026-05-28 16:05:57.210352404 +0000 UTC m=+228.461267239" lastFinishedPulling="2026-05-28 16:05:59.203960268 +0000 UTC m=+230.454875101" observedRunningTime="2026-05-28 16:05:59.614414994 +0000 UTC m=+230.865329860" watchObservedRunningTime="2026-05-28 16:05:59.616181094 +0000 UTC m=+230.867095950" May 28 16:06:25.710123 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.710037 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:06:25.713827 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.713801 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.726186 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.726157 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:06:25.774911 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.774866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.774943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5tw\" (UniqueName: \"kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.774991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.775030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775101 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.775071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775289 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.775199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.775289 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.775235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876501 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876461 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5tw\" (UniqueName: \"kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876512 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876537 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876568 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876613 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.876945 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.876796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.877340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.877316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.877464 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.877348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.877510 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.877482 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.877608 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.877585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.878981 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.878949 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.879152 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.879131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:25.883891 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:25.883873 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5tw\" (UniqueName: \"kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw\") pod \"console-6ff8977d7b-6r7tv\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:26.024630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:26.024541 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:26.154924 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:26.154899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:06:26.157126 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:06:26.157097 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32652e5_3e9a_4e54_9195_859e766dc325.slice/crio-224487691d998d3c92ddf0261033b5864c6c9729bb88e13279d6f11ada93dadc WatchSource:0}: Error finding container 224487691d998d3c92ddf0261033b5864c6c9729bb88e13279d6f11ada93dadc: Status 404 returned error can't find the container with id 224487691d998d3c92ddf0261033b5864c6c9729bb88e13279d6f11ada93dadc May 28 16:06:26.699168 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:26.699122 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8977d7b-6r7tv" event={"ID":"c32652e5-3e9a-4e54-9195-859e766dc325","Type":"ContainerStarted","Data":"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572"} May 28 16:06:26.699168 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:26.699171 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8977d7b-6r7tv" event={"ID":"c32652e5-3e9a-4e54-9195-859e766dc325","Type":"ContainerStarted","Data":"224487691d998d3c92ddf0261033b5864c6c9729bb88e13279d6f11ada93dadc"} May 28 16:06:26.718912 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:26.718863 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6ff8977d7b-6r7tv" podStartSLOduration=1.7188494730000001 podStartE2EDuration="1.718849473s" podCreationTimestamp="2026-05-28 16:06:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:06:26.716958165 +0000 UTC m=+257.967873032" watchObservedRunningTime="2026-05-28 16:06:26.718849473 +0000 UTC m=+257.969764328" May 28 16:06:36.024919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:36.024867 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:36.024919 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:36.024924 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:36.031028 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:36.031004 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:36.737532 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:36.737503 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:06:36.785619 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:06:36.785554 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:07:01.809148 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:01.809089 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6ddc586d54-b8fsv" podUID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" containerName="console" containerID="cri-o://073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2" gracePeriod=15 May 28 16:07:02.057686 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.057659 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddc586d54-b8fsv_8eb089c9-91b3-43c4-99c9-8be3516afcf5/console/0.log" May 28 16:07:02.057817 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.057718 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:07:02.107059 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107028 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107082 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107120 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107139 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107157 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107181 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22smr\" (UniqueName: \"kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107385 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert\") pod \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\" (UID: \"8eb089c9-91b3-43c4-99c9-8be3516afcf5\") " May 28 16:07:02.107609 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107580 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:07:02.107737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107647 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:07:02.107800 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107727 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config" (OuterVolumeSpecName: "console-config") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:07:02.107940 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107918 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.108016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107946 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.108016 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.107960 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.108103 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.108024 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca" (OuterVolumeSpecName: "service-ca") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:07:02.109575 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.109549 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:07:02.109669 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.109580 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:07:02.110036 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.110020 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr" (OuterVolumeSpecName: "kube-api-access-22smr") pod "8eb089c9-91b3-43c4-99c9-8be3516afcf5" (UID: "8eb089c9-91b3-43c4-99c9-8be3516afcf5"). InnerVolumeSpecName "kube-api-access-22smr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:07:02.208835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.208800 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.208835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.208831 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb089c9-91b3-43c4-99c9-8be3516afcf5-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.208835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.208843 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22smr\" (UniqueName: \"kubernetes.io/projected/8eb089c9-91b3-43c4-99c9-8be3516afcf5-kube-api-access-22smr\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.209070 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.208852 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eb089c9-91b3-43c4-99c9-8be3516afcf5-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:07:02.823060 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823033 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddc586d54-b8fsv_8eb089c9-91b3-43c4-99c9-8be3516afcf5/console/0.log" May 28 16:07:02.823562 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823071 2575 generic.go:358] "Generic (PLEG): container finished" podID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" containerID="073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2" exitCode=2 May 28 16:07:02.823562 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823112 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddc586d54-b8fsv" event={"ID":"8eb089c9-91b3-43c4-99c9-8be3516afcf5","Type":"ContainerDied","Data":"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2"} May 28 16:07:02.823562 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823133 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddc586d54-b8fsv" event={"ID":"8eb089c9-91b3-43c4-99c9-8be3516afcf5","Type":"ContainerDied","Data":"d4d13d54113e34d8ce3b99c5f099f9ae188f6438e9a28b0a4b979dc81cbb81fc"} May 28 16:07:02.823562 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823149 2575 scope.go:117] "RemoveContainer" containerID="073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2" May 28 16:07:02.823562 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.823149 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddc586d54-b8fsv" May 28 16:07:02.832097 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.832080 2575 scope.go:117] "RemoveContainer" containerID="073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2" May 28 16:07:02.832374 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:07:02.832356 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2\": container with ID starting with 073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2 not found: ID does not exist" containerID="073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2" May 28 16:07:02.832420 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.832383 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2"} err="failed to get container status \"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2\": rpc error: code = NotFound desc = could not find container \"073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2\": container with ID starting with 073a043ec05950ebb656c55a2978b540eacf6de276e9cd3b05ca27ff98ecdfe2 not found: ID does not exist" May 28 16:07:02.845414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.845386 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:07:02.852377 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:02.852354 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ddc586d54-b8fsv"] May 28 16:07:03.310787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:03.310704 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" path="/var/lib/kubelet/pods/8eb089c9-91b3-43c4-99c9-8be3516afcf5/volumes" May 28 16:07:09.255542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:09.255509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:07:09.256061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:09.255614 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:07:09.260647 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:09.260625 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:07:09.260806 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:09.260787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:07:09.272764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:07:09.272730 2575 kubelet.go:1628] "Image garbage collection succeeded" May 28 16:08:34.906226 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.906189 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq"] May 28 16:08:34.906722 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.906620 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" containerName="console" May 28 16:08:34.906722 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.906632 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" containerName="console" May 28 16:08:34.906722 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.906702 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eb089c9-91b3-43c4-99c9-8be3516afcf5" containerName="console" May 28 16:08:34.909808 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.909787 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:34.914410 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.914388 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 16:08:34.914851 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.914836 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jvznl\"" May 28 16:08:34.915061 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.915046 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 16:08:34.915327 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.915309 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 16:08:34.915815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.915798 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 16:08:34.929853 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.929831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:34.929968 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.929867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:34.929968 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.929891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z75k\" (UniqueName: \"kubernetes.io/projected/b2a55bf7-9192-45b0-b459-a6107234caa4-kube-api-access-2z75k\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:34.938121 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:34.938103 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq"] May 28 16:08:35.030831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.030797 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.030831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.030837 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.031050 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.030894 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z75k\" (UniqueName: \"kubernetes.io/projected/b2a55bf7-9192-45b0-b459-a6107234caa4-kube-api-access-2z75k\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.033312 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.033275 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.033432 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.033363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a55bf7-9192-45b0-b459-a6107234caa4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.047059 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.047031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z75k\" (UniqueName: \"kubernetes.io/projected/b2a55bf7-9192-45b0-b459-a6107234caa4-kube-api-access-2z75k\") pod \"opendatahub-operator-controller-manager-864b4b584-4lnmq\" (UID: \"b2a55bf7-9192-45b0-b459-a6107234caa4\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.219852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.219760 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:35.400933 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.400872 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq"] May 28 16:08:35.405426 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:08:35.405398 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a55bf7_9192_45b0_b459_a6107234caa4.slice/crio-95ea75d2f3893a9aa5fd032e316c1751d6e0a2153c7cf9b7a7d1c1eeaff3eabc WatchSource:0}: Error finding container 95ea75d2f3893a9aa5fd032e316c1751d6e0a2153c7cf9b7a7d1c1eeaff3eabc: Status 404 returned error can't find the container with id 95ea75d2f3893a9aa5fd032e316c1751d6e0a2153c7cf9b7a7d1c1eeaff3eabc May 28 16:08:35.407650 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:35.407634 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:08:36.138214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:36.138173 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" event={"ID":"b2a55bf7-9192-45b0-b459-a6107234caa4","Type":"ContainerStarted","Data":"95ea75d2f3893a9aa5fd032e316c1751d6e0a2153c7cf9b7a7d1c1eeaff3eabc"} May 28 16:08:38.148057 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:38.148013 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" event={"ID":"b2a55bf7-9192-45b0-b459-a6107234caa4","Type":"ContainerStarted","Data":"e0ac28407bb1c88fd5485cf52088a17f5d71da9040b8407908f69ede71ac3123"} May 28 16:08:38.148505 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:38.148113 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:38.186106 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:38.186053 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" podStartSLOduration=1.7978578920000001 podStartE2EDuration="4.186037908s" podCreationTimestamp="2026-05-28 16:08:34 +0000 UTC" firstStartedPulling="2026-05-28 16:08:35.407793651 +0000 UTC m=+386.658708487" lastFinishedPulling="2026-05-28 16:08:37.795973657 +0000 UTC m=+389.046888503" observedRunningTime="2026-05-28 16:08:38.183557327 +0000 UTC m=+389.434472193" watchObservedRunningTime="2026-05-28 16:08:38.186037908 +0000 UTC m=+389.436952764" May 28 16:08:49.154850 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:49.154816 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-4lnmq" May 28 16:08:54.148327 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.148254 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-779556875f-tb42t"] May 28 16:08:54.152353 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.152333 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.155642 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.155618 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 28 16:08:54.155758 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.155621 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dkjm4\"" May 28 16:08:54.155758 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.155623 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 28 16:08:54.161900 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.161875 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779556875f-tb42t"] May 28 16:08:54.213524 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.213490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83302d09-06f7-4454-8a0b-817fdc06a748-tls-certs\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.213673 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.213611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69pm\" (UniqueName: \"kubernetes.io/projected/83302d09-06f7-4454-8a0b-817fdc06a748-kube-api-access-l69pm\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.213673 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.213663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83302d09-06f7-4454-8a0b-817fdc06a748-tmp\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.314606 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.314567 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l69pm\" (UniqueName: \"kubernetes.io/projected/83302d09-06f7-4454-8a0b-817fdc06a748-kube-api-access-l69pm\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.314801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.314625 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83302d09-06f7-4454-8a0b-817fdc06a748-tmp\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.314801 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.314684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83302d09-06f7-4454-8a0b-817fdc06a748-tls-certs\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.316912 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.316884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83302d09-06f7-4454-8a0b-817fdc06a748-tmp\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.317225 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.317203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83302d09-06f7-4454-8a0b-817fdc06a748-tls-certs\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.322694 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.322669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69pm\" (UniqueName: \"kubernetes.io/projected/83302d09-06f7-4454-8a0b-817fdc06a748-kube-api-access-l69pm\") pod \"kube-auth-proxy-779556875f-tb42t\" (UID: \"83302d09-06f7-4454-8a0b-817fdc06a748\") " pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.462680 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.462589 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" May 28 16:08:54.593031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:54.593003 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779556875f-tb42t"] May 28 16:08:54.595557 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:08:54.595525 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83302d09_06f7_4454_8a0b_817fdc06a748.slice/crio-92321ac938512349e8baed66c5778a57090411ab8acb393b43705e3bc642957d WatchSource:0}: Error finding container 92321ac938512349e8baed66c5778a57090411ab8acb393b43705e3bc642957d: Status 404 returned error can't find the container with id 92321ac938512349e8baed66c5778a57090411ab8acb393b43705e3bc642957d May 28 16:08:55.218712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:55.218674 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" event={"ID":"83302d09-06f7-4454-8a0b-817fdc06a748","Type":"ContainerStarted","Data":"92321ac938512349e8baed66c5778a57090411ab8acb393b43705e3bc642957d"} May 28 16:08:58.231552 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:58.231458 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" event={"ID":"83302d09-06f7-4454-8a0b-817fdc06a748","Type":"ContainerStarted","Data":"6a8d5f9b8bbddd2c37c3edc919c0c5bebbeb85c90de2488472f9e6322b4dd5b6"} May 28 16:08:58.250118 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:08:58.250063 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-779556875f-tb42t" podStartSLOduration=0.916249883 podStartE2EDuration="4.250050937s" podCreationTimestamp="2026-05-28 16:08:54 +0000 UTC" firstStartedPulling="2026-05-28 16:08:54.597529508 +0000 UTC m=+405.848444344" lastFinishedPulling="2026-05-28 16:08:57.931330561 +0000 UTC m=+409.182245398" observedRunningTime="2026-05-28 16:08:58.248165207 +0000 UTC m=+409.499080062" watchObservedRunningTime="2026-05-28 16:08:58.250050937 +0000 UTC m=+409.500965792" May 28 16:09:01.987973 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:01.987938 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-b9znv"] May 28 16:09:01.991710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:01.991690 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:01.995010 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:01.994987 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-68l9z\"" May 28 16:09:01.995597 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:01.995574 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 28 16:09:02.003696 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.003637 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-b9znv"] May 28 16:09:02.095042 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.095009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnwk8\" (UniqueName: \"kubernetes.io/projected/cd63278c-8c00-4636-af7d-7e6c38afd30a-kube-api-access-wnwk8\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.095217 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.095129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.196667 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.196625 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnwk8\" (UniqueName: \"kubernetes.io/projected/cd63278c-8c00-4636-af7d-7e6c38afd30a-kube-api-access-wnwk8\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.196868 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.196755 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.196932 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:09:02.196890 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 28 16:09:02.196989 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:09:02.196947 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert podName:cd63278c-8c00-4636-af7d-7e6c38afd30a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:02.696931694 +0000 UTC m=+413.947846534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert") pod "kserve-controller-manager-856948b99f-b9znv" (UID: "cd63278c-8c00-4636-af7d-7e6c38afd30a") : secret "kserve-webhook-server-cert" not found May 28 16:09:02.209334 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.209273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnwk8\" (UniqueName: \"kubernetes.io/projected/cd63278c-8c00-4636-af7d-7e6c38afd30a-kube-api-access-wnwk8\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.702577 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.702535 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.704903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.704879 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd63278c-8c00-4636-af7d-7e6c38afd30a-cert\") pod \"kserve-controller-manager-856948b99f-b9znv\" (UID: \"cd63278c-8c00-4636-af7d-7e6c38afd30a\") " pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:02.904826 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:02.904780 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:03.033532 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:03.033506 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-b9znv"] May 28 16:09:03.036162 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:09:03.036129 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd63278c_8c00_4636_af7d_7e6c38afd30a.slice/crio-e906d6a2b3a3c67c3409788af5b1c3eaf97c470e6f8ffeb48fdad5f200721bdf WatchSource:0}: Error finding container e906d6a2b3a3c67c3409788af5b1c3eaf97c470e6f8ffeb48fdad5f200721bdf: Status 404 returned error can't find the container with id e906d6a2b3a3c67c3409788af5b1c3eaf97c470e6f8ffeb48fdad5f200721bdf May 28 16:09:03.250960 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:03.250879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" event={"ID":"cd63278c-8c00-4636-af7d-7e6c38afd30a","Type":"ContainerStarted","Data":"e906d6a2b3a3c67c3409788af5b1c3eaf97c470e6f8ffeb48fdad5f200721bdf"} May 28 16:09:07.270031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:07.269999 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" event={"ID":"cd63278c-8c00-4636-af7d-7e6c38afd30a","Type":"ContainerStarted","Data":"fab92c337b022d9e62725bceaeb4cd5f003b302950e6860371c592e00b852a80"} May 28 16:09:07.270434 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:07.270116 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:07.288156 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:07.288099 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" podStartSLOduration=2.151073058 podStartE2EDuration="6.288085728s" podCreationTimestamp="2026-05-28 16:09:01 +0000 UTC" firstStartedPulling="2026-05-28 16:09:03.037626616 +0000 UTC m=+414.288541449" lastFinishedPulling="2026-05-28 16:09:07.174639284 +0000 UTC m=+418.425554119" observedRunningTime="2026-05-28 16:09:07.286894753 +0000 UTC m=+418.537809607" watchObservedRunningTime="2026-05-28 16:09:07.288085728 +0000 UTC m=+418.539000589" May 28 16:09:19.662027 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.661995 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:19.671214 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.671190 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.673903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.673876 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-79pj4\"" May 28 16:09:19.674073 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.674051 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 16:09:19.681422 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.681397 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:19.763245 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsdc\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763433 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763433 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763433 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763433 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.763661 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.763577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865126 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865086 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsdc\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865145 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865179 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865210 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865258 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865575 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865334 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865575 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865361 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865575 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865427 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865575 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865501 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865756 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.865917 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.865882 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.866026 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.866006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.866149 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.866094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.867752 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.867733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.868008 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.867991 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.875404 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.875380 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.876186 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.876159 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsdc\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc4492nbk\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:19.901382 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.901350 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c"] May 28 16:09:19.906178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.906158 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.917173 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.917147 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c"] May 28 16:09:19.966035 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.965997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966035 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb1d566-5b23-45ae-8966-457defd453a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966240 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5hx\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-kube-api-access-7d5hx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.966408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.966392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb1d566-5b23-45ae-8966-457defd453a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:19.985876 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:19.985840 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:20.067192 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067160 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb1d566-5b23-45ae-8966-457defd453a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067230 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067384 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067367 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5hx\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-kube-api-access-7d5hx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067417 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067463 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb1d566-5b23-45ae-8966-457defd453a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067542 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067571 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.067634 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.068017 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.067996 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb1d566-5b23-45ae-8966-457defd453a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.068256 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.068119 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.068256 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.068142 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.068256 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.068220 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.070034 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.070011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb1d566-5b23-45ae-8966-457defd453a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.070112 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.070056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb1d566-5b23-45ae-8966-457defd453a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.076569 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.076515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.077258 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.077217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5hx\" (UniqueName: \"kubernetes.io/projected/9eb1d566-5b23-45ae-8966-457defd453a3-kube-api-access-7d5hx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5q42c\" (UID: \"9eb1d566-5b23-45ae-8966-457defd453a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.129817 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.129792 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:20.131748 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:09:20.131722 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e604fe_c45d_4078_99f1_56c14c6d536b.slice/crio-c68b867f4d02220ddae5a64242f526c43f6e6e5b2baf7b120fcc1b2e58d7e56f WatchSource:0}: Error finding container c68b867f4d02220ddae5a64242f526c43f6e6e5b2baf7b120fcc1b2e58d7e56f: Status 404 returned error can't find the container with id c68b867f4d02220ddae5a64242f526c43f6e6e5b2baf7b120fcc1b2e58d7e56f May 28 16:09:20.218434 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.218354 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:20.317209 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.317170 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" event={"ID":"45e604fe-c45d-4078-99f1-56c14c6d536b","Type":"ContainerStarted","Data":"c68b867f4d02220ddae5a64242f526c43f6e6e5b2baf7b120fcc1b2e58d7e56f"} May 28 16:09:20.351915 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:20.351852 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c"] May 28 16:09:20.354153 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:09:20.354117 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb1d566_5b23_45ae_8966_457defd453a3.slice/crio-bb36355ca74a22067dec480db9bb00f3bbee1f1a46c462a4b2623719ec69c12b WatchSource:0}: Error finding container bb36355ca74a22067dec480db9bb00f3bbee1f1a46c462a4b2623719ec69c12b: Status 404 returned error can't find the container with id bb36355ca74a22067dec480db9bb00f3bbee1f1a46c462a4b2623719ec69c12b May 28 16:09:21.322107 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:21.322032 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" event={"ID":"9eb1d566-5b23-45ae-8966-457defd453a3","Type":"ContainerStarted","Data":"bb36355ca74a22067dec480db9bb00f3bbee1f1a46c462a4b2623719ec69c12b"} May 28 16:09:23.401658 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.401612 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:23.401955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.401703 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:23.401955 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.401744 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:23.407233 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.407209 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:23.407290 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.407265 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:23.407346 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:23.407293 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:09:24.342018 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.341976 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" event={"ID":"9eb1d566-5b23-45ae-8966-457defd453a3","Type":"ContainerStarted","Data":"233db0ed5a0796fbb64f2aafbda15588676ffe5d83421db3ecaff64fc366e645"} May 28 16:09:24.343437 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.343410 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" event={"ID":"45e604fe-c45d-4078-99f1-56c14c6d536b","Type":"ContainerStarted","Data":"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3"} May 28 16:09:24.362436 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.362391 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" podStartSLOduration=2.31138182 podStartE2EDuration="5.362379572s" podCreationTimestamp="2026-05-28 16:09:19 +0000 UTC" firstStartedPulling="2026-05-28 16:09:20.356032803 +0000 UTC m=+431.606947639" lastFinishedPulling="2026-05-28 16:09:23.407030544 +0000 UTC m=+434.657945391" observedRunningTime="2026-05-28 16:09:24.360510775 +0000 UTC m=+435.611425641" watchObservedRunningTime="2026-05-28 16:09:24.362379572 +0000 UTC m=+435.613294426" May 28 16:09:24.378822 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.378775 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" podStartSLOduration=2.110939649 podStartE2EDuration="5.3787629s" podCreationTimestamp="2026-05-28 16:09:19 +0000 UTC" firstStartedPulling="2026-05-28 16:09:20.133463233 +0000 UTC m=+431.384378067" lastFinishedPulling="2026-05-28 16:09:23.401286478 +0000 UTC m=+434.652201318" observedRunningTime="2026-05-28 16:09:24.377861893 +0000 UTC m=+435.628776745" watchObservedRunningTime="2026-05-28 16:09:24.3787629 +0000 UTC m=+435.629677755" May 28 16:09:24.986886 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.986850 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:24.988445 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.988419 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= May 28 16:09:24.988572 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:24.988471 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" May 28 16:09:25.219340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.219279 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:25.223716 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.223690 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:25.346935 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.346901 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:25.347757 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.347737 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5q42c" May 28 16:09:25.398876 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.398844 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:25.986934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.986901 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= May 28 16:09:25.987340 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:25.986964 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" May 28 16:09:26.987177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:26.987138 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= May 28 16:09:26.987603 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:26.987209 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" May 28 16:09:27.354165 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:27.354122 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" containerID="cri-o://e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3" gracePeriod=30 May 28 16:09:32.594838 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.594810 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:32.689831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.689738 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hsdc\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.689831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.689780 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.689831 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.689815 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.689882 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.689932 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690003 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690037 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690063 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690117 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690100 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data\") pod \"45e604fe-c45d-4078-99f1-56c14c6d536b\" (UID: \"45e604fe-c45d-4078-99f1-56c14c6d536b\") " May 28 16:09:32.690465 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690201 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:32.690465 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690280 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:32.690576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data" (OuterVolumeSpecName: "istio-data") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:32.690576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690498 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.690576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690545 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.690576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690477 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:09:32.690576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.690536 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:32.692171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.692145 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token" (OuterVolumeSpecName: "istio-token") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:09:32.692274 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.692220 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:32.692457 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.692435 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" May 28 16:09:32.692516 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.692448 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc" (OuterVolumeSpecName: "kube-api-access-4hsdc") pod "45e604fe-c45d-4078-99f1-56c14c6d536b" (UID: "45e604fe-c45d-4078-99f1-56c14c6d536b"). InnerVolumeSpecName "kube-api-access-4hsdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:09:32.791756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791716 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e604fe-c45d-4078-99f1-56c14c6d536b-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.791756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791745 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.791756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791754 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.791756 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791762 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.792003 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791771 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hsdc\" (UniqueName: \"kubernetes.io/projected/45e604fe-c45d-4078-99f1-56c14c6d536b-kube-api-access-4hsdc\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.792003 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791782 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:32.792003 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:32.791790 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e604fe-c45d-4078-99f1-56c14c6d536b-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:09:33.376554 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.376524 2575 generic.go:358] "Generic (PLEG): container finished" podID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerID="e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3" exitCode=0 May 28 16:09:33.376738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.376593 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" May 28 16:09:33.376738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.376605 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" event={"ID":"45e604fe-c45d-4078-99f1-56c14c6d536b","Type":"ContainerDied","Data":"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3"} May 28 16:09:33.376738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.376652 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk" event={"ID":"45e604fe-c45d-4078-99f1-56c14c6d536b","Type":"ContainerDied","Data":"c68b867f4d02220ddae5a64242f526c43f6e6e5b2baf7b120fcc1b2e58d7e56f"} May 28 16:09:33.376738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.376668 2575 scope.go:117] "RemoveContainer" containerID="e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3" May 28 16:09:33.384963 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.384945 2575 scope.go:117] "RemoveContainer" containerID="e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3" May 28 16:09:33.385207 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:09:33.385189 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3\": container with ID starting with e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3 not found: ID does not exist" containerID="e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3" May 28 16:09:33.385277 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.385218 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3"} err="failed to get container status \"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3\": rpc error: code = NotFound desc = could not find container \"e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3\": container with ID starting with e0637acb7c6ff707eb8f37f69c2b7672d06f7b6ab8617717a70792e4ea59c8a3 not found: ID does not exist" May 28 16:09:33.395570 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.395539 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:33.398406 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:33.398386 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc4492nbk"] May 28 16:09:35.311183 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:35.311145 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" path="/var/lib/kubelet/pods/45e604fe-c45d-4078-99f1-56c14c6d536b/volumes" May 28 16:09:38.278653 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:38.278620 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-b9znv" May 28 16:09:52.512755 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.512720 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9xsbb"] May 28 16:09:52.513122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.513115 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" May 28 16:09:52.513165 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.513125 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" May 28 16:09:52.513215 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.513204 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="45e604fe-c45d-4078-99f1-56c14c6d536b" containerName="istio-proxy" May 28 16:09:52.516248 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.516231 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:09:52.518724 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.518707 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 16:09:52.518783 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.518707 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 16:09:52.519413 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.519388 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zv24t\"" May 28 16:09:52.523093 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.523068 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9xsbb"] May 28 16:09:52.578270 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.578233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxpwp\" (UniqueName: \"kubernetes.io/projected/a625fac9-20cf-45ed-8988-c746785474b8-kube-api-access-hxpwp\") pod \"kuadrant-operator-catalog-9xsbb\" (UID: \"a625fac9-20cf-45ed-8988-c746785474b8\") " pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:09:52.679696 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.679659 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxpwp\" (UniqueName: \"kubernetes.io/projected/a625fac9-20cf-45ed-8988-c746785474b8-kube-api-access-hxpwp\") pod \"kuadrant-operator-catalog-9xsbb\" (UID: \"a625fac9-20cf-45ed-8988-c746785474b8\") " pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:09:52.688509 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.688484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxpwp\" (UniqueName: \"kubernetes.io/projected/a625fac9-20cf-45ed-8988-c746785474b8-kube-api-access-hxpwp\") pod \"kuadrant-operator-catalog-9xsbb\" (UID: \"a625fac9-20cf-45ed-8988-c746785474b8\") " pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:09:52.828208 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.828173 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:09:52.966522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:52.966493 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9xsbb"] May 28 16:09:52.968329 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:09:52.968275 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda625fac9_20cf_45ed_8988_c746785474b8.slice/crio-54ac5dc90130d167571ce877761433202c7044a50991b4af35d8cfd20f2b12ff WatchSource:0}: Error finding container 54ac5dc90130d167571ce877761433202c7044a50991b4af35d8cfd20f2b12ff: Status 404 returned error can't find the container with id 54ac5dc90130d167571ce877761433202c7044a50991b4af35d8cfd20f2b12ff May 28 16:09:53.450481 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:53.450444 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" event={"ID":"a625fac9-20cf-45ed-8988-c746785474b8","Type":"ContainerStarted","Data":"54ac5dc90130d167571ce877761433202c7044a50991b4af35d8cfd20f2b12ff"} May 28 16:09:55.461606 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:55.461568 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" event={"ID":"a625fac9-20cf-45ed-8988-c746785474b8","Type":"ContainerStarted","Data":"c7a61f3a604dc5a5d7005aab97cb0812ecc62e5a74100aa1f08dbb754d08c5d5"} May 28 16:09:55.480124 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:09:55.480074 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" podStartSLOduration=1.187702814 podStartE2EDuration="3.480057509s" podCreationTimestamp="2026-05-28 16:09:52 +0000 UTC" firstStartedPulling="2026-05-28 16:09:52.969694163 +0000 UTC m=+464.220609000" lastFinishedPulling="2026-05-28 16:09:55.26204886 +0000 UTC m=+466.512963695" observedRunningTime="2026-05-28 16:09:55.478247142 +0000 UTC m=+466.729161999" watchObservedRunningTime="2026-05-28 16:09:55.480057509 +0000 UTC m=+466.730972367" May 28 16:10:02.828679 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:02.828639 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:10:02.829078 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:02.828731 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:10:02.850787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:02.850754 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:10:03.511159 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:03.511131 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9xsbb" May 28 16:10:20.608918 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.608868 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64dd85bf5c-876mp"] May 28 16:10:20.614036 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.613990 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.623345 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.623319 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dd85bf5c-876mp"] May 28 16:10:20.739278 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-service-ca\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739278 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-oauth-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwj5\" (UniqueName: \"kubernetes.io/projected/f76aeb87-697c-45a5-95b4-ca69334df62f-kube-api-access-gxwj5\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-trusted-ca-bundle\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-oauth-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.739629 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.739551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-console-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841053 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-console-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-service-ca\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841149 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-oauth-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841179 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwj5\" (UniqueName: \"kubernetes.io/projected/f76aeb87-697c-45a5-95b4-ca69334df62f-kube-api-access-gxwj5\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-trusted-ca-bundle\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841242 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-oauth-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841267 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.841883 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841849 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-console-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.842001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-service-ca\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.842001 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.841980 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-oauth-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.842178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.842158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76aeb87-697c-45a5-95b4-ca69334df62f-trusted-ca-bundle\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.844257 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.844232 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-oauth-config\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.844365 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.844348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76aeb87-697c-45a5-95b4-ca69334df62f-console-serving-cert\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.849124 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.849101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwj5\" (UniqueName: \"kubernetes.io/projected/f76aeb87-697c-45a5-95b4-ca69334df62f-kube-api-access-gxwj5\") pod \"console-64dd85bf5c-876mp\" (UID: \"f76aeb87-697c-45a5-95b4-ca69334df62f\") " pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:20.927253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:20.927166 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:21.065045 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:21.063879 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dd85bf5c-876mp"] May 28 16:10:21.559574 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:21.559536 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd85bf5c-876mp" event={"ID":"f76aeb87-697c-45a5-95b4-ca69334df62f","Type":"ContainerStarted","Data":"4ae09e020ded8a4386ae74c85fdf8d0eb8ccdb7095c828b780e6894ff123fde9"} May 28 16:10:21.559574 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:21.559579 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd85bf5c-876mp" event={"ID":"f76aeb87-697c-45a5-95b4-ca69334df62f","Type":"ContainerStarted","Data":"9189294715c5a37b9a0dd02aacb0896920f8d95c87e84bbd46f1daca3b61ec4c"} May 28 16:10:21.578277 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:21.578215 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64dd85bf5c-876mp" podStartSLOduration=1.578202101 podStartE2EDuration="1.578202101s" podCreationTimestamp="2026-05-28 16:10:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:10:21.576859488 +0000 UTC m=+492.827774368" watchObservedRunningTime="2026-05-28 16:10:21.578202101 +0000 UTC m=+492.829116955" May 28 16:10:23.226060 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.226025 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-nprp6"] May 28 16:10:23.229500 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.229483 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:23.231829 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.231804 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z8znh\"" May 28 16:10:23.238903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.238877 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-nprp6"] May 28 16:10:23.365263 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.365228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdm7t\" (UniqueName: \"kubernetes.io/projected/acea1aff-9d9a-4073-95c9-16409a27b96d-kube-api-access-vdm7t\") pod \"authorino-operator-657f44b778-nprp6\" (UID: \"acea1aff-9d9a-4073-95c9-16409a27b96d\") " pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:23.466349 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.466285 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdm7t\" (UniqueName: \"kubernetes.io/projected/acea1aff-9d9a-4073-95c9-16409a27b96d-kube-api-access-vdm7t\") pod \"authorino-operator-657f44b778-nprp6\" (UID: \"acea1aff-9d9a-4073-95c9-16409a27b96d\") " pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:23.477580 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.477498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdm7t\" (UniqueName: \"kubernetes.io/projected/acea1aff-9d9a-4073-95c9-16409a27b96d-kube-api-access-vdm7t\") pod \"authorino-operator-657f44b778-nprp6\" (UID: \"acea1aff-9d9a-4073-95c9-16409a27b96d\") " pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:23.541533 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.541495 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:23.688328 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:23.688289 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-nprp6"] May 28 16:10:23.691009 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:10:23.690983 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacea1aff_9d9a_4073_95c9_16409a27b96d.slice/crio-fc2ef3ac549d4c0d850cd4def49dad67a1f0bed0443103d0bb0f55bbc1b2458d WatchSource:0}: Error finding container fc2ef3ac549d4c0d850cd4def49dad67a1f0bed0443103d0bb0f55bbc1b2458d: Status 404 returned error can't find the container with id fc2ef3ac549d4c0d850cd4def49dad67a1f0bed0443103d0bb0f55bbc1b2458d May 28 16:10:24.572055 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:24.572020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" event={"ID":"acea1aff-9d9a-4073-95c9-16409a27b96d","Type":"ContainerStarted","Data":"fc2ef3ac549d4c0d850cd4def49dad67a1f0bed0443103d0bb0f55bbc1b2458d"} May 28 16:10:26.581903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:26.581866 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" event={"ID":"acea1aff-9d9a-4073-95c9-16409a27b96d","Type":"ContainerStarted","Data":"5341753643b680c12212d6c855458e85326ced9ea5a2c8469e86635658929c3c"} May 28 16:10:26.582399 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:26.581991 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:26.614686 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:26.614625 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" podStartSLOduration=1.6666064999999999 podStartE2EDuration="3.614609347s" podCreationTimestamp="2026-05-28 16:10:23 +0000 UTC" firstStartedPulling="2026-05-28 16:10:23.692954902 +0000 UTC m=+494.943869736" lastFinishedPulling="2026-05-28 16:10:25.640957739 +0000 UTC m=+496.891872583" observedRunningTime="2026-05-28 16:10:26.612011695 +0000 UTC m=+497.862926550" watchObservedRunningTime="2026-05-28 16:10:26.614609347 +0000 UTC m=+497.865524201" May 28 16:10:30.927637 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:30.927596 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:30.927637 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:30.927646 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:30.932398 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:30.932372 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:31.604687 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:31.604657 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64dd85bf5c-876mp" May 28 16:10:31.659282 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:31.659246 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:10:34.857558 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.857516 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv"] May 28 16:10:34.864137 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.864113 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:34.867172 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.867149 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2f94d\"" May 28 16:10:34.873536 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.873513 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv"] May 28 16:10:34.975604 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.975570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5zl\" (UniqueName: \"kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:34.975604 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:34.975612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.076938 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.076904 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5zl\" (UniqueName: \"kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.077119 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.076949 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.077414 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.077393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.087618 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.087589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5zl\" (UniqueName: \"kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.175726 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.175638 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:35.337882 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.337853 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv"] May 28 16:10:35.348531 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:10:35.348501 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5bad51_80d1_457b_a92c_918e1eb7dd80.slice/crio-c633106ce2dbaf12e53691869c0c8d7295c29e19788d20d80ae0c26a2c8d378c WatchSource:0}: Error finding container c633106ce2dbaf12e53691869c0c8d7295c29e19788d20d80ae0c26a2c8d378c: Status 404 returned error can't find the container with id c633106ce2dbaf12e53691869c0c8d7295c29e19788d20d80ae0c26a2c8d378c May 28 16:10:35.616903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:35.616868 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" event={"ID":"fd5bad51-80d1-457b-a92c-918e1eb7dd80","Type":"ContainerStarted","Data":"c633106ce2dbaf12e53691869c0c8d7295c29e19788d20d80ae0c26a2c8d378c"} May 28 16:10:37.589118 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:37.589071 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-nprp6" May 28 16:10:40.644583 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:40.644537 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" event={"ID":"fd5bad51-80d1-457b-a92c-918e1eb7dd80","Type":"ContainerStarted","Data":"e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5"} May 28 16:10:40.644992 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:40.644702 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:40.662697 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:40.662635 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" podStartSLOduration=1.740312493 podStartE2EDuration="6.662622298s" podCreationTimestamp="2026-05-28 16:10:34 +0000 UTC" firstStartedPulling="2026-05-28 16:10:35.350797101 +0000 UTC m=+506.601711938" lastFinishedPulling="2026-05-28 16:10:40.27310691 +0000 UTC m=+511.524021743" observedRunningTime="2026-05-28 16:10:40.661514031 +0000 UTC m=+511.912428886" watchObservedRunningTime="2026-05-28 16:10:40.662622298 +0000 UTC m=+511.913537153" May 28 16:10:51.650795 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:51.650715 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:52.990398 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:52.990362 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w"] May 28 16:10:52.994313 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:52.994282 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.006813 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.006788 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w"] May 28 16:10:53.157914 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.157878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfb66\" (UniqueName: \"kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.158088 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.157982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.259161 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.259066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfb66\" (UniqueName: \"kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.259348 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.259171 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.259543 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.259526 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.267204 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.267172 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfb66\" (UniqueName: \"kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66\") pod \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.305802 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.305754 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.371207 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.371174 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv"] May 28 16:10:53.371946 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.371486 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" containerName="manager" containerID="cri-o://e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5" gracePeriod=2 May 28 16:10:53.380427 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.380371 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv"] May 28 16:10:53.390885 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.390853 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w"] May 28 16:10:53.396689 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.396638 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w"] May 28 16:10:53.400273 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.400252 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:10:53.401065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.401042 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" containerName="manager" May 28 16:10:53.401165 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.401068 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" containerName="manager" May 28 16:10:53.401231 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.401214 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" containerName="manager" May 28 16:10:53.404497 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.404475 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.407139 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.407108 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.412815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.412786 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:10:53.418047 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.418026 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:10:53.418282 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.418207 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.435425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.435386 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:10:53.441177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.441136 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.561976 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.561944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.562123 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.562060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snbp9\" (UniqueName: \"kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.562123 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.562101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.562253 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.562143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkrj\" (UniqueName: \"kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.592070 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:10:53.592039 2575 log.go:32] "RunPodSandbox from runtime service failed" err=< May 28 16:10:53.592070 ip-10-0-136-8 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-84b657d985-xpk6w_kuadrant-system_ff75aab7-b034-49aa-af2d-9e93ddba9204_0(65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-84b657d985-xpk6w to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d" Netns:"/var/run/netns/0f053a23-ed0c-4962-b0bc-5a2aeb0bc8a4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-84b657d985-xpk6w;K8S_POD_INFRA_CONTAINER_ID=65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d;K8S_POD_UID=ff75aab7-b034-49aa-af2d-9e93ddba9204" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w] networking: [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w/ff75aab7-b034-49aa-af2d-9e93ddba9204:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w 65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d network default NAD default] [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w 65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:33 [10.132.0.51/23] May 28 16:10:53.592070 ip-10-0-136-8 kubenswrapper[2575]: ' May 28 16:10:53.592070 ip-10-0-136-8 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} May 28 16:10:53.592070 ip-10-0-136-8 kubenswrapper[2575]: > May 28 16:10:53.592341 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:10:53.592110 2575 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err=< May 28 16:10:53.592341 ip-10-0-136-8 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-84b657d985-xpk6w_kuadrant-system_ff75aab7-b034-49aa-af2d-9e93ddba9204_0(65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-84b657d985-xpk6w to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d" Netns:"/var/run/netns/0f053a23-ed0c-4962-b0bc-5a2aeb0bc8a4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-84b657d985-xpk6w;K8S_POD_INFRA_CONTAINER_ID=65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d;K8S_POD_UID=ff75aab7-b034-49aa-af2d-9e93ddba9204" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w] networking: [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w/ff75aab7-b034-49aa-af2d-9e93ddba9204:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w 65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d network default NAD default] [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w 65f3fd9763af080941b7dff6bd175ed7c1cd9cf0c26d63082e9d6e5e9f03794d network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:33 [10.132.0.51/23] May 28 16:10:53.592341 ip-10-0-136-8 kubenswrapper[2575]: ' May 28 16:10:53.592341 ip-10-0-136-8 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} May 28 16:10:53.592341 ip-10-0-136-8 kubenswrapper[2575]: > pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.604060 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.604030 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:53.606491 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.606455 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.663126 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663093 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkrj\" (UniqueName: \"kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.663280 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663155 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.663280 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snbp9\" (UniqueName: \"kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.663280 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663238 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.663596 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663577 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.663636 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.663594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.677617 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.677589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkrj\" (UniqueName: \"kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f8rdk\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.677704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.677668 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snbp9\" (UniqueName: \"kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9\") pod \"kuadrant-operator-controller-manager-84b657d985-hjvpn\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.695588 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.695563 2575 generic.go:358] "Generic (PLEG): container finished" podID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" containerID="e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5" exitCode=0 May 28 16:10:53.695733 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.695617 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" May 28 16:10:53.695733 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.695667 2575 scope.go:117] "RemoveContainer" containerID="e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5" May 28 16:10:53.695866 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.695758 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.700696 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.700677 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:53.700996 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.700972 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.702978 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.702946 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.706609 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.706585 2575 scope.go:117] "RemoveContainer" containerID="e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5" May 28 16:10:53.706704 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.706626 2575 status_manager.go:895] "Failed to get status for pod" podUID="ff75aab7-b034-49aa-af2d-9e93ddba9204" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" err="pods \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:53.707071 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:10:53.707046 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5\": container with ID starting with e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5 not found: ID does not exist" containerID="e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5" May 28 16:10:53.707135 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.707081 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5"} err="failed to get container status \"e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5\": rpc error: code = NotFound desc = could not find container \"e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5\": container with ID starting with e26fb97048913d1004f93e81bf0d11e08f1b5d1d87a4444aa9a12ad862fe9aa5 not found: ID does not exist" May 28 16:10:53.754505 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.754465 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:53.763416 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.763390 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:53.763645 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.763625 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume\") pod \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " May 28 16:10:53.763757 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.763745 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk5zl\" (UniqueName: \"kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl\") pod \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\" (UID: \"fd5bad51-80d1-457b-a92c-918e1eb7dd80\") " May 28 16:10:53.764272 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.764076 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd5bad51-80d1-457b-a92c-918e1eb7dd80" (UID: "fd5bad51-80d1-457b-a92c-918e1eb7dd80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:53.765889 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.765863 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl" (OuterVolumeSpecName: "kube-api-access-sk5zl") pod "fd5bad51-80d1-457b-a92c-918e1eb7dd80" (UID: "fd5bad51-80d1-457b-a92c-918e1eb7dd80"). InnerVolumeSpecName "kube-api-access-sk5zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:53.864788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.864720 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfb66\" (UniqueName: \"kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66\") pod \"ff75aab7-b034-49aa-af2d-9e93ddba9204\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " May 28 16:10:53.864788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.864783 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume\") pod \"ff75aab7-b034-49aa-af2d-9e93ddba9204\" (UID: \"ff75aab7-b034-49aa-af2d-9e93ddba9204\") " May 28 16:10:53.865207 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.865188 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk5zl\" (UniqueName: \"kubernetes.io/projected/fd5bad51-80d1-457b-a92c-918e1eb7dd80-kube-api-access-sk5zl\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:53.865277 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.865215 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5bad51-80d1-457b-a92c-918e1eb7dd80-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:53.865428 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.865406 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff75aab7-b034-49aa-af2d-9e93ddba9204" (UID: "ff75aab7-b034-49aa-af2d-9e93ddba9204"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:53.867003 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.866976 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66" (OuterVolumeSpecName: "kube-api-access-cfb66") pod "ff75aab7-b034-49aa-af2d-9e93ddba9204" (UID: "ff75aab7-b034-49aa-af2d-9e93ddba9204"). InnerVolumeSpecName "kube-api-access-cfb66". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:53.915789 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.915755 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:10:53.921022 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:10:53.920995 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4b3801_c5fc_42a6_9a4c_0a04ebf3a024.slice/crio-f6f7c51dc79abbda7f350e229c3008e6466d3156f14533d379206fdfd71d8c67 WatchSource:0}: Error finding container f6f7c51dc79abbda7f350e229c3008e6466d3156f14533d379206fdfd71d8c67: Status 404 returned error can't find the container with id f6f7c51dc79abbda7f350e229c3008e6466d3156f14533d379206fdfd71d8c67 May 28 16:10:53.943051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.943015 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:10:53.954514 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:10:53.954490 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4923e8dc_d896_4aea_8b93_822085a66b09.slice/crio-bc4197629a45e14be8cad5003d98c5e7ba9008be0cfb9a38ace3865b2bc1d50b WatchSource:0}: Error finding container bc4197629a45e14be8cad5003d98c5e7ba9008be0cfb9a38ace3865b2bc1d50b: Status 404 returned error can't find the container with id bc4197629a45e14be8cad5003d98c5e7ba9008be0cfb9a38ace3865b2bc1d50b May 28 16:10:53.966713 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.966689 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfb66\" (UniqueName: \"kubernetes.io/projected/ff75aab7-b034-49aa-af2d-9e93ddba9204-kube-api-access-cfb66\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:53.966713 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:53.966714 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff75aab7-b034-49aa-af2d-9e93ddba9204-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:54.006792 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.006765 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.008574 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.008543 2575 status_manager.go:895] "Failed to get status for pod" podUID="ff75aab7-b034-49aa-af2d-9e93ddba9204" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" err="pods \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.701515 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.701469 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" event={"ID":"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024","Type":"ContainerStarted","Data":"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c"} May 28 16:10:54.701515 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.701517 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" event={"ID":"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024","Type":"ContainerStarted","Data":"f6f7c51dc79abbda7f350e229c3008e6466d3156f14533d379206fdfd71d8c67"} May 28 16:10:54.701734 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.701594 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:10:54.703529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.703504 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.703693 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.703674 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" event={"ID":"4923e8dc-d896-4aea-8b93-822085a66b09","Type":"ContainerStarted","Data":"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e"} May 28 16:10:54.703749 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.703689 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" May 28 16:10:54.703749 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.703700 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" event={"ID":"4923e8dc-d896-4aea-8b93-822085a66b09","Type":"ContainerStarted","Data":"bc4197629a45e14be8cad5003d98c5e7ba9008be0cfb9a38ace3865b2bc1d50b"} May 28 16:10:54.703864 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.703850 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:10:54.705174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.705159 2575 status_manager.go:895] "Failed to get status for pod" podUID="ff75aab7-b034-49aa-af2d-9e93ddba9204" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" err="pods \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.727000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.726949 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" podStartSLOduration=1.726938246 podStartE2EDuration="1.726938246s" podCreationTimestamp="2026-05-28 16:10:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:10:54.725567291 +0000 UTC m=+525.976482143" watchObservedRunningTime="2026-05-28 16:10:54.726938246 +0000 UTC m=+525.977853100" May 28 16:10:54.727726 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.727699 2575 status_manager.go:895] "Failed to get status for pod" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h99bv" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h99bv\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.729787 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.729758 2575 status_manager.go:895] "Failed to get status for pod" podUID="ff75aab7-b034-49aa-af2d-9e93ddba9204" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xpk6w" err="pods \"kuadrant-operator-controller-manager-84b657d985-xpk6w\" is forbidden: User \"system:node:ip-10-0-136-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-8.ec2.internal' and this object" May 28 16:10:54.752627 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:54.752581 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" podStartSLOduration=1.7525674420000001 podStartE2EDuration="1.752567442s" podCreationTimestamp="2026-05-28 16:10:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:10:54.75097231 +0000 UTC m=+526.001887166" watchObservedRunningTime="2026-05-28 16:10:54.752567442 +0000 UTC m=+526.003482275" May 28 16:10:55.311745 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:55.311705 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5bad51-80d1-457b-a92c-918e1eb7dd80" path="/var/lib/kubelet/pods/fd5bad51-80d1-457b-a92c-918e1eb7dd80/volumes" May 28 16:10:55.312269 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:55.312248 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff75aab7-b034-49aa-af2d-9e93ddba9204" path="/var/lib/kubelet/pods/ff75aab7-b034-49aa-af2d-9e93ddba9204/volumes" May 28 16:10:56.682023 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:56.681964 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6ff8977d7b-6r7tv" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" containerName="console" containerID="cri-o://5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572" gracePeriod=15 May 28 16:10:56.735169 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:56.735140 2575 patch_prober.go:28] interesting pod/console-6ff8977d7b-6r7tv container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.41:8443/health\": dial tcp 10.132.0.41:8443: connect: connection refused" start-of-body= May 28 16:10:56.735335 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:56.735194 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6ff8977d7b-6r7tv" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" containerName="console" probeResult="failure" output="Get \"https://10.132.0.41:8443/health\": dial tcp 10.132.0.41:8443: connect: connection refused" May 28 16:10:56.938254 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:56.938196 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff8977d7b-6r7tv_c32652e5-3e9a-4e54-9195-859e766dc325/console/0.log" May 28 16:10:56.938380 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:56.938262 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:10:57.096056 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096022 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096056 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096060 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn5tw\" (UniqueName: \"kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096084 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096179 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096228 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096251 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096337 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096277 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config\") pod \"c32652e5-3e9a-4e54-9195-859e766dc325\" (UID: \"c32652e5-3e9a-4e54-9195-859e766dc325\") " May 28 16:10:57.096637 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096440 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca" (OuterVolumeSpecName: "service-ca") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:10:57.096697 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096667 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:10:57.096752 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096730 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.096829 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096717 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:10:57.096885 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.096859 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config" (OuterVolumeSpecName: "console-config") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:10:57.098393 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.098366 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:10:57.098663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.098636 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:10:57.098737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.098692 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw" (OuterVolumeSpecName: "kube-api-access-vn5tw") pod "c32652e5-3e9a-4e54-9195-859e766dc325" (UID: "c32652e5-3e9a-4e54-9195-859e766dc325"). InnerVolumeSpecName "kube-api-access-vn5tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197553 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197581 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197592 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197601 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c32652e5-3e9a-4e54-9195-859e766dc325-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197612 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5tw\" (UniqueName: \"kubernetes.io/projected/c32652e5-3e9a-4e54-9195-859e766dc325-kube-api-access-vn5tw\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.197630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.197621 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c32652e5-3e9a-4e54-9195-859e766dc325-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:10:57.716542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716512 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff8977d7b-6r7tv_c32652e5-3e9a-4e54-9195-859e766dc325/console/0.log" May 28 16:10:57.716937 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716554 2575 generic.go:358] "Generic (PLEG): container finished" podID="c32652e5-3e9a-4e54-9195-859e766dc325" containerID="5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572" exitCode=2 May 28 16:10:57.716937 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716636 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8977d7b-6r7tv" May 28 16:10:57.716937 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716628 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8977d7b-6r7tv" event={"ID":"c32652e5-3e9a-4e54-9195-859e766dc325","Type":"ContainerDied","Data":"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572"} May 28 16:10:57.716937 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716758 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8977d7b-6r7tv" event={"ID":"c32652e5-3e9a-4e54-9195-859e766dc325","Type":"ContainerDied","Data":"224487691d998d3c92ddf0261033b5864c6c9729bb88e13279d6f11ada93dadc"} May 28 16:10:57.716937 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.716778 2575 scope.go:117] "RemoveContainer" containerID="5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572" May 28 16:10:57.727538 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.727519 2575 scope.go:117] "RemoveContainer" containerID="5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572" May 28 16:10:57.727936 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:10:57.727914 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572\": container with ID starting with 5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572 not found: ID does not exist" containerID="5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572" May 28 16:10:57.728002 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.727947 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572"} err="failed to get container status \"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572\": rpc error: code = NotFound desc = could not find container \"5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572\": container with ID starting with 5a8c1c42a25738641c88834150e5b3efa227e1d9634357851f1c7e38c2a73572 not found: ID does not exist" May 28 16:10:57.734579 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.734557 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:10:57.740188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:57.740166 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff8977d7b-6r7tv"] May 28 16:10:59.311440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:10:59.311403 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" path="/var/lib/kubelet/pods/c32652e5-3e9a-4e54-9195-859e766dc325/volumes" May 28 16:11:05.709663 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:05.709633 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:11:05.710141 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:05.709692 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:11:05.780380 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:05.780349 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:11:05.780598 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:05.780546 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" podUID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" containerName="manager" containerID="cri-o://b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c" gracePeriod=10 May 28 16:11:06.040557 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.040532 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:11:06.084350 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.084316 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkkrj\" (UniqueName: \"kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj\") pod \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " May 28 16:11:06.084512 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.084442 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume\") pod \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\" (UID: \"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024\") " May 28 16:11:06.084809 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.084784 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" (UID: "2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:11:06.086201 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.086181 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj" (OuterVolumeSpecName: "kube-api-access-tkkrj") pod "2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" (UID: "2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024"). InnerVolumeSpecName "kube-api-access-tkkrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:11:06.109472 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.109441 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:11:06.109888 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.109876 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" containerName="console" May 28 16:11:06.109931 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.109889 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" containerName="console" May 28 16:11:06.109931 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.109904 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" containerName="manager" May 28 16:11:06.109931 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.109911 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" containerName="manager" May 28 16:11:06.110023 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.110007 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c32652e5-3e9a-4e54-9195-859e766dc325" containerName="console" May 28 16:11:06.110023 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.110018 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" containerName="manager" May 28 16:11:06.113703 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.113686 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.127994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.127963 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:11:06.185170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.185136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6826b\" (UniqueName: \"kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.185364 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.185183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.185364 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.185235 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkkrj\" (UniqueName: \"kubernetes.io/projected/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-kube-api-access-tkkrj\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:11:06.185364 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.185246 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:11:06.286358 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.286246 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6826b\" (UniqueName: \"kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.286519 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.286369 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.286773 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.286751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.300043 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.300020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6826b\" (UniqueName: \"kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bdsfj\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.424563 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.424523 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.558410 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.558381 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:11:06.561367 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:11:06.561335 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8161044e_3469_4a93_bd6e_1f909e54f2b0.slice/crio-f4e6a8e98d7af1d7a0b5a8f61e77e92d16c9de58cb121e734ab29bb0e80bb4c5 WatchSource:0}: Error finding container f4e6a8e98d7af1d7a0b5a8f61e77e92d16c9de58cb121e734ab29bb0e80bb4c5: Status 404 returned error can't find the container with id f4e6a8e98d7af1d7a0b5a8f61e77e92d16c9de58cb121e734ab29bb0e80bb4c5 May 28 16:11:06.755712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.755676 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" event={"ID":"8161044e-3469-4a93-bd6e-1f909e54f2b0","Type":"ContainerStarted","Data":"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a"} May 28 16:11:06.755712 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.755716 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" event={"ID":"8161044e-3469-4a93-bd6e-1f909e54f2b0","Type":"ContainerStarted","Data":"f4e6a8e98d7af1d7a0b5a8f61e77e92d16c9de58cb121e734ab29bb0e80bb4c5"} May 28 16:11:06.756171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.755772 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:06.756913 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.756892 2575 generic.go:358] "Generic (PLEG): container finished" podID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" containerID="b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c" exitCode=0 May 28 16:11:06.757013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.756919 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" event={"ID":"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024","Type":"ContainerDied","Data":"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c"} May 28 16:11:06.757013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.756948 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" event={"ID":"2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024","Type":"ContainerDied","Data":"f6f7c51dc79abbda7f350e229c3008e6466d3156f14533d379206fdfd71d8c67"} May 28 16:11:06.757013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.756963 2575 scope.go:117] "RemoveContainer" containerID="b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c" May 28 16:11:06.757013 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.756972 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk" May 28 16:11:06.766779 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.766764 2575 scope.go:117] "RemoveContainer" containerID="b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c" May 28 16:11:06.767020 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:11:06.767000 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c\": container with ID starting with b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c not found: ID does not exist" containerID="b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c" May 28 16:11:06.767065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.767029 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c"} err="failed to get container status \"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c\": rpc error: code = NotFound desc = could not find container \"b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c\": container with ID starting with b2bbf0ffe2f598b0959a716df88a6288d0a6f1a4447ab32eefd246e5e2c1bc0c not found: ID does not exist" May 28 16:11:06.775450 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.775411 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" podStartSLOduration=0.77539868 podStartE2EDuration="775.39868ms" podCreationTimestamp="2026-05-28 16:11:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:11:06.774571026 +0000 UTC m=+538.025485882" watchObservedRunningTime="2026-05-28 16:11:06.77539868 +0000 UTC m=+538.026313535" May 28 16:11:06.795884 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.795861 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:11:06.805211 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:06.805189 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f8rdk"] May 28 16:11:07.311040 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:07.310999 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024" path="/var/lib/kubelet/pods/2f4b3801-c5fc-42a6-9a4c-0a04ebf3a024/volumes" May 28 16:11:17.764065 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:17.764027 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:11:17.822698 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:17.822668 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:11:17.822952 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:17.822914 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" podUID="4923e8dc-d896-4aea-8b93-822085a66b09" containerName="manager" containerID="cri-o://422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e" gracePeriod=10 May 28 16:11:18.069883 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.069860 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:11:18.102683 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.102651 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snbp9\" (UniqueName: \"kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9\") pod \"4923e8dc-d896-4aea-8b93-822085a66b09\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " May 28 16:11:18.102835 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.102736 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume\") pod \"4923e8dc-d896-4aea-8b93-822085a66b09\" (UID: \"4923e8dc-d896-4aea-8b93-822085a66b09\") " May 28 16:11:18.103171 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.103143 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4923e8dc-d896-4aea-8b93-822085a66b09" (UID: "4923e8dc-d896-4aea-8b93-822085a66b09"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:11:18.104762 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.104732 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9" (OuterVolumeSpecName: "kube-api-access-snbp9") pod "4923e8dc-d896-4aea-8b93-822085a66b09" (UID: "4923e8dc-d896-4aea-8b93-822085a66b09"). InnerVolumeSpecName "kube-api-access-snbp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:11:18.203542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.203505 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snbp9\" (UniqueName: \"kubernetes.io/projected/4923e8dc-d896-4aea-8b93-822085a66b09-kube-api-access-snbp9\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:11:18.203542 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.203537 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4923e8dc-d896-4aea-8b93-822085a66b09-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:11:18.805071 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.805035 2575 generic.go:358] "Generic (PLEG): container finished" podID="4923e8dc-d896-4aea-8b93-822085a66b09" containerID="422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e" exitCode=0 May 28 16:11:18.805560 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.805097 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" May 28 16:11:18.805560 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.805124 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" event={"ID":"4923e8dc-d896-4aea-8b93-822085a66b09","Type":"ContainerDied","Data":"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e"} May 28 16:11:18.805560 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.805174 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn" event={"ID":"4923e8dc-d896-4aea-8b93-822085a66b09","Type":"ContainerDied","Data":"bc4197629a45e14be8cad5003d98c5e7ba9008be0cfb9a38ace3865b2bc1d50b"} May 28 16:11:18.805560 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.805195 2575 scope.go:117] "RemoveContainer" containerID="422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e" May 28 16:11:18.814283 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.814269 2575 scope.go:117] "RemoveContainer" containerID="422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e" May 28 16:11:18.814530 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:11:18.814512 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e\": container with ID starting with 422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e not found: ID does not exist" containerID="422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e" May 28 16:11:18.814584 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.814538 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e"} err="failed to get container status \"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e\": rpc error: code = NotFound desc = could not find container \"422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e\": container with ID starting with 422914f271e3dbc0b697985160a6186e6c7bf1119ee0d0db7b070e35330af10e not found: ID does not exist" May 28 16:11:18.827971 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.827947 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:11:18.838660 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:18.838639 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hjvpn"] May 28 16:11:19.310920 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:19.310888 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4923e8dc-d896-4aea-8b93-822085a66b09" path="/var/lib/kubelet/pods/4923e8dc-d896-4aea-8b93-822085a66b09/volumes" May 28 16:11:22.025166 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.025128 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9"] May 28 16:11:22.026250 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.026226 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4923e8dc-d896-4aea-8b93-822085a66b09" containerName="manager" May 28 16:11:22.026250 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.026253 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4923e8dc-d896-4aea-8b93-822085a66b09" containerName="manager" May 28 16:11:22.026520 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.026504 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="4923e8dc-d896-4aea-8b93-822085a66b09" containerName="manager" May 28 16:11:22.032735 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.032701 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.035557 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.035531 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lxsbt\"" May 28 16:11:22.041259 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.041229 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9"] May 28 16:11:22.138761 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138761 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqj2j\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-kube-api-access-jqj2j\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d482b0f-171f-4d76-8fed-ea33b2834083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.138947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.139131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.138954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.139131 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.139031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.239770 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239730 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d482b0f-171f-4d76-8fed-ea33b2834083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.239951 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239782 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.239951 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.239951 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239873 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.239951 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239927 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.239996 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqj2j\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-kube-api-access-jqj2j\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240106 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240177 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240463 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240501 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240460 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240545 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.240600 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.240544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d482b0f-171f-4d76-8fed-ea33b2834083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.242309 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.242272 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.242410 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.242391 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.247842 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.247816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.248037 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.248017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqj2j\" (UniqueName: \"kubernetes.io/projected/8d482b0f-171f-4d76-8fed-ea33b2834083-kube-api-access-jqj2j\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-wcdj9\" (UID: \"8d482b0f-171f-4d76-8fed-ea33b2834083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.347476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.347437 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:22.484174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.484147 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9"] May 28 16:11:22.486444 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:11:22.486415 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d482b0f_171f_4d76_8fed_ea33b2834083.slice/crio-58989d97544bb273bb423dd905a30b287c7eacaaaba414afa9d51fa267ff11ad WatchSource:0}: Error finding container 58989d97544bb273bb423dd905a30b287c7eacaaaba414afa9d51fa267ff11ad: Status 404 returned error can't find the container with id 58989d97544bb273bb423dd905a30b287c7eacaaaba414afa9d51fa267ff11ad May 28 16:11:22.488611 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.488559 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:11:22.488702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.488647 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:11:22.488702 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.488678 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 16:11:22.821903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.821871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" event={"ID":"8d482b0f-171f-4d76-8fed-ea33b2834083","Type":"ContainerStarted","Data":"2c4537ecb2dc1962fa01a1df4111af0a2a2bb5f07206ec392ef6a4198bf7f98b"} May 28 16:11:22.821903 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.821907 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" event={"ID":"8d482b0f-171f-4d76-8fed-ea33b2834083","Type":"ContainerStarted","Data":"58989d97544bb273bb423dd905a30b287c7eacaaaba414afa9d51fa267ff11ad"} May 28 16:11:22.841201 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:22.841160 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" podStartSLOduration=0.841145492 podStartE2EDuration="841.145492ms" podCreationTimestamp="2026-05-28 16:11:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:11:22.840358773 +0000 UTC m=+554.091273629" watchObservedRunningTime="2026-05-28 16:11:22.841145492 +0000 UTC m=+554.092060347" May 28 16:11:23.348205 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:23.348165 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:23.353585 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:23.353560 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:23.825381 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:23.825346 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:11:23.826285 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:11:23.826266 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-wcdj9" May 28 16:12:09.290057 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:09.290019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:12:09.292665 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:09.292638 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:12:09.294604 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:09.294585 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:12:09.297522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:09.297500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:12:12.026408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.026371 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:12:12.031197 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.031177 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.034655 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.034490 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p8wpm\"" May 28 16:12:12.034932 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.034913 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 16:12:12.037504 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.037480 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:12:12.127349 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.127288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.127524 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.127420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddpp\" (UniqueName: \"kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.228958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.228928 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kddpp\" (UniqueName: \"kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.229150 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.229044 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.231567 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.231529 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.236886 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.236857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddpp\" (UniqueName: \"kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp\") pod \"authorino-68449856cc-xq6bw\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.342581 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.342553 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:12:12.479004 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:12.478963 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:12:12.481340 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:12:12.481311 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb63f0049_27c1_4707_91a7_4fcd624e5fc9.slice/crio-089c1c5f1a4ad235391358401651a03331e168256d65de29fabeeeae3fcb7a95 WatchSource:0}: Error finding container 089c1c5f1a4ad235391358401651a03331e168256d65de29fabeeeae3fcb7a95: Status 404 returned error can't find the container with id 089c1c5f1a4ad235391358401651a03331e168256d65de29fabeeeae3fcb7a95 May 28 16:12:13.008135 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:13.008096 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68449856cc-xq6bw" event={"ID":"b63f0049-27c1-4707-91a7-4fcd624e5fc9","Type":"ContainerStarted","Data":"089c1c5f1a4ad235391358401651a03331e168256d65de29fabeeeae3fcb7a95"} May 28 16:12:16.020546 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:16.020513 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68449856cc-xq6bw" event={"ID":"b63f0049-27c1-4707-91a7-4fcd624e5fc9","Type":"ContainerStarted","Data":"54a750fda263612954b1339bb18ea5143326a2bfc44b60fce4243ca892cb6a12"} May 28 16:12:16.038978 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:12:16.038931 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-68449856cc-xq6bw" podStartSLOduration=1.133821905 podStartE2EDuration="4.038916902s" podCreationTimestamp="2026-05-28 16:12:12 +0000 UTC" firstStartedPulling="2026-05-28 16:12:12.482834299 +0000 UTC m=+603.733749136" lastFinishedPulling="2026-05-28 16:12:15.387929295 +0000 UTC m=+606.638844133" observedRunningTime="2026-05-28 16:12:16.036508105 +0000 UTC m=+607.287422961" watchObservedRunningTime="2026-05-28 16:12:16.038916902 +0000 UTC m=+607.289831801" May 28 16:13:11.584423 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.584381 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd"] May 28 16:13:11.590349 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.590323 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.593546 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.593524 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 16:13:11.593738 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.593720 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 16:13:11.593877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.593646 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-685vc\"" May 28 16:13:11.594005 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.593598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 28 16:13:11.594922 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.594898 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd"] May 28 16:13:11.701144 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c7b8a-6894-42fe-86af-7a0508946fc6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.701352 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dp6t\" (UniqueName: \"kubernetes.io/projected/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kube-api-access-8dp6t\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.701352 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.701476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.701529 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.701576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.701524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.802938 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.802907 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.802938 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.802941 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.802961 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803021 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c7b8a-6894-42fe-86af-7a0508946fc6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803049 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dp6t\" (UniqueName: \"kubernetes.io/projected/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kube-api-access-8dp6t\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803170 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803142 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803408 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803484 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.803537 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.803489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.805279 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.805255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1c7b8a-6894-42fe-86af-7a0508946fc6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.805503 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.805489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1c7b8a-6894-42fe-86af-7a0508946fc6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.810958 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.810938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dp6t\" (UniqueName: \"kubernetes.io/projected/0f1c7b8a-6894-42fe-86af-7a0508946fc6-kube-api-access-8dp6t\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd\" (UID: \"0f1c7b8a-6894-42fe-86af-7a0508946fc6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:11.904351 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:11.904226 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:12.047448 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:12.047423 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd"] May 28 16:13:12.049513 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:13:12.049471 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1c7b8a_6894_42fe_86af_7a0508946fc6.slice/crio-72102c653a82bef1abf3f38f904c783710c590f511d95b10cfd473045fbab88a WatchSource:0}: Error finding container 72102c653a82bef1abf3f38f904c783710c590f511d95b10cfd473045fbab88a: Status 404 returned error can't find the container with id 72102c653a82bef1abf3f38f904c783710c590f511d95b10cfd473045fbab88a May 28 16:13:12.245595 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:12.245510 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" event={"ID":"0f1c7b8a-6894-42fe-86af-7a0508946fc6","Type":"ContainerStarted","Data":"72102c653a82bef1abf3f38f904c783710c590f511d95b10cfd473045fbab88a"} May 28 16:13:20.282469 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:20.282429 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" event={"ID":"0f1c7b8a-6894-42fe-86af-7a0508946fc6","Type":"ContainerStarted","Data":"a6add8f21cf174828c37cd063b231c4470bff167187ccc64f891158b230cceaf"} May 28 16:13:26.306591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:26.306553 2575 generic.go:358] "Generic (PLEG): container finished" podID="0f1c7b8a-6894-42fe-86af-7a0508946fc6" containerID="a6add8f21cf174828c37cd063b231c4470bff167187ccc64f891158b230cceaf" exitCode=0 May 28 16:13:26.307173 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:26.306611 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" event={"ID":"0f1c7b8a-6894-42fe-86af-7a0508946fc6","Type":"ContainerDied","Data":"a6add8f21cf174828c37cd063b231c4470bff167187ccc64f891158b230cceaf"} May 28 16:13:28.315260 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:28.315224 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" event={"ID":"0f1c7b8a-6894-42fe-86af-7a0508946fc6","Type":"ContainerStarted","Data":"d0661ca53359eb83d0c0c6de6880defaba68e785649d9c38faeaa0d6d7703f94"} May 28 16:13:28.315672 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:28.315450 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:13:28.335344 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:28.335279 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" podStartSLOduration=1.713270291 podStartE2EDuration="17.33526205s" podCreationTimestamp="2026-05-28 16:13:11 +0000 UTC" firstStartedPulling="2026-05-28 16:13:12.051394393 +0000 UTC m=+663.302309230" lastFinishedPulling="2026-05-28 16:13:27.673386137 +0000 UTC m=+678.924300989" observedRunningTime="2026-05-28 16:13:28.333359452 +0000 UTC m=+679.584274310" watchObservedRunningTime="2026-05-28 16:13:28.33526205 +0000 UTC m=+679.586176906" May 28 16:13:39.335000 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:13:39.334965 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd" May 28 16:14:18.786282 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.786199 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk"] May 28 16:14:18.790229 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.790211 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.792740 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.792721 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 28 16:14:18.798219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.798198 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk"] May 28 16:14:18.905031 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.904993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.905219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.905055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.905219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.905140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb2hg\" (UniqueName: \"kubernetes.io/projected/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kube-api-access-sb2hg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.905219 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.905181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.905409 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.905324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:18.905409 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:18.905362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b664e5-32d9-4bd9-b6a1-24243bb81e45-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006766 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006730 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006766 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006769 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b664e5-32d9-4bd9-b6a1-24243bb81e45-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006852 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006891 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb2hg\" (UniqueName: \"kubernetes.io/projected/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kube-api-access-sb2hg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.006999 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.006916 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.007239 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.007214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.007371 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.007351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.007371 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.007361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.008968 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.008948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48b664e5-32d9-4bd9-b6a1-24243bb81e45-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.009521 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.009502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48b664e5-32d9-4bd9-b6a1-24243bb81e45-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.015498 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.015474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb2hg\" (UniqueName: \"kubernetes.io/projected/48b664e5-32d9-4bd9-b6a1-24243bb81e45-kube-api-access-sb2hg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk\" (UID: \"48b664e5-32d9-4bd9-b6a1-24243bb81e45\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.101264 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.101220 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:19.244723 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.244687 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk"] May 28 16:14:19.245326 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:14:19.245268 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b664e5_32d9_4bd9_b6a1_24243bb81e45.slice/crio-4b7ce80a3a28a9c38add29a7bf276cd3d8fe7149ffd6b8246a9a5eddf8950da9 WatchSource:0}: Error finding container 4b7ce80a3a28a9c38add29a7bf276cd3d8fe7149ffd6b8246a9a5eddf8950da9: Status 404 returned error can't find the container with id 4b7ce80a3a28a9c38add29a7bf276cd3d8fe7149ffd6b8246a9a5eddf8950da9 May 28 16:14:19.247247 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.247230 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:14:19.515643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.515556 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" event={"ID":"48b664e5-32d9-4bd9-b6a1-24243bb81e45","Type":"ContainerStarted","Data":"7c236faee9b31dc713ea0b099b11ef2b146f8b8406491e9c81cac05ce867bb1c"} May 28 16:14:19.515643 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:19.515601 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" event={"ID":"48b664e5-32d9-4bd9-b6a1-24243bb81e45","Type":"ContainerStarted","Data":"4b7ce80a3a28a9c38add29a7bf276cd3d8fe7149ffd6b8246a9a5eddf8950da9"} May 28 16:14:29.558184 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:29.558151 2575 generic.go:358] "Generic (PLEG): container finished" podID="48b664e5-32d9-4bd9-b6a1-24243bb81e45" containerID="7c236faee9b31dc713ea0b099b11ef2b146f8b8406491e9c81cac05ce867bb1c" exitCode=0 May 28 16:14:29.558645 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:29.558228 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" event={"ID":"48b664e5-32d9-4bd9-b6a1-24243bb81e45","Type":"ContainerDied","Data":"7c236faee9b31dc713ea0b099b11ef2b146f8b8406491e9c81cac05ce867bb1c"} May 28 16:14:30.563522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:30.563419 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" event={"ID":"48b664e5-32d9-4bd9-b6a1-24243bb81e45","Type":"ContainerStarted","Data":"94f5fe0de63ddd08d13a54baf00c85d54a95f5c7db94e0b0786947ef26f9fa67"} May 28 16:14:30.563873 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:30.563619 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:14:30.584591 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:30.584458 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" podStartSLOduration=12.048173266 podStartE2EDuration="12.584441418s" podCreationTimestamp="2026-05-28 16:14:18 +0000 UTC" firstStartedPulling="2026-05-28 16:14:29.558919499 +0000 UTC m=+740.809834332" lastFinishedPulling="2026-05-28 16:14:30.095187651 +0000 UTC m=+741.346102484" observedRunningTime="2026-05-28 16:14:30.583967722 +0000 UTC m=+741.834882601" watchObservedRunningTime="2026-05-28 16:14:30.584441418 +0000 UTC m=+741.835356274" May 28 16:14:41.581073 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:14:41.581040 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk" May 28 16:15:00.486355 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.486314 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:15:00.486954 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.486595 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-68449856cc-xq6bw" podUID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" containerName="authorino" containerID="cri-o://54a750fda263612954b1339bb18ea5143326a2bfc44b60fce4243ca892cb6a12" gracePeriod=30 May 28 16:15:00.687078 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.687040 2575 generic.go:358] "Generic (PLEG): container finished" podID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" containerID="54a750fda263612954b1339bb18ea5143326a2bfc44b60fce4243ca892cb6a12" exitCode=0 May 28 16:15:00.687376 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.687117 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68449856cc-xq6bw" event={"ID":"b63f0049-27c1-4707-91a7-4fcd624e5fc9","Type":"ContainerDied","Data":"54a750fda263612954b1339bb18ea5143326a2bfc44b60fce4243ca892cb6a12"} May 28 16:15:00.755421 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.755397 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:15:00.842665 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.842634 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert\") pod \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " May 28 16:15:00.842877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.842721 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kddpp\" (UniqueName: \"kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp\") pod \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\" (UID: \"b63f0049-27c1-4707-91a7-4fcd624e5fc9\") " May 28 16:15:00.844941 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.844910 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp" (OuterVolumeSpecName: "kube-api-access-kddpp") pod "b63f0049-27c1-4707-91a7-4fcd624e5fc9" (UID: "b63f0049-27c1-4707-91a7-4fcd624e5fc9"). InnerVolumeSpecName "kube-api-access-kddpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:15:00.854466 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.854432 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b63f0049-27c1-4707-91a7-4fcd624e5fc9" (UID: "b63f0049-27c1-4707-91a7-4fcd624e5fc9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 16:15:00.944425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.944389 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b63f0049-27c1-4707-91a7-4fcd624e5fc9-tls-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:15:00.944425 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:00.944423 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kddpp\" (UniqueName: \"kubernetes.io/projected/b63f0049-27c1-4707-91a7-4fcd624e5fc9-kube-api-access-kddpp\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:15:01.692680 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:01.692646 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68449856cc-xq6bw" May 28 16:15:01.692680 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:01.692648 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68449856cc-xq6bw" event={"ID":"b63f0049-27c1-4707-91a7-4fcd624e5fc9","Type":"ContainerDied","Data":"089c1c5f1a4ad235391358401651a03331e168256d65de29fabeeeae3fcb7a95"} May 28 16:15:01.693174 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:01.692711 2575 scope.go:117] "RemoveContainer" containerID="54a750fda263612954b1339bb18ea5143326a2bfc44b60fce4243ca892cb6a12" May 28 16:15:01.708674 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:01.708644 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:15:01.710649 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:01.710626 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68449856cc-xq6bw"] May 28 16:15:03.312063 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:15:03.312019 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" path="/var/lib/kubelet/pods/b63f0049-27c1-4707-91a7-4fcd624e5fc9/volumes" May 28 16:17:09.321849 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:17:09.321819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:17:09.325455 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:17:09.325430 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:17:09.326992 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:17:09.326974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:17:09.330608 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:17:09.330584 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:22:09.352870 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:22:09.352836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:22:09.358038 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:22:09.358012 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:22:09.359874 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:22:09.359844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:22:09.364547 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:22:09.364531 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:26:47.283345 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:47.283292 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:26:47.285764 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:47.283536 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerName="manager" containerID="cri-o://94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a" gracePeriod=10 May 28 16:26:47.762728 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:47.762688 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.54:8081/readyz\": dial tcp 10.132.0.54:8081: connect: connection refused" May 28 16:26:47.942476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:47.942450 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:26:48.077723 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.077692 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume\") pod \"8161044e-3469-4a93-bd6e-1f909e54f2b0\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " May 28 16:26:48.077924 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.077756 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6826b\" (UniqueName: \"kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b\") pod \"8161044e-3469-4a93-bd6e-1f909e54f2b0\" (UID: \"8161044e-3469-4a93-bd6e-1f909e54f2b0\") " May 28 16:26:48.078154 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.078131 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8161044e-3469-4a93-bd6e-1f909e54f2b0" (UID: "8161044e-3469-4a93-bd6e-1f909e54f2b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:26:48.079887 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.079847 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b" (OuterVolumeSpecName: "kube-api-access-6826b") pod "8161044e-3469-4a93-bd6e-1f909e54f2b0" (UID: "8161044e-3469-4a93-bd6e-1f909e54f2b0"). InnerVolumeSpecName "kube-api-access-6826b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:26:48.178938 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.178898 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8161044e-3469-4a93-bd6e-1f909e54f2b0-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:26:48.178938 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.178930 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6826b\" (UniqueName: \"kubernetes.io/projected/8161044e-3469-4a93-bd6e-1f909e54f2b0-kube-api-access-6826b\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" May 28 16:26:48.439236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.439153 2575 generic.go:358] "Generic (PLEG): container finished" podID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerID="94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a" exitCode=0 May 28 16:26:48.439236 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.439212 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" May 28 16:26:48.439692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.439236 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" event={"ID":"8161044e-3469-4a93-bd6e-1f909e54f2b0","Type":"ContainerDied","Data":"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a"} May 28 16:26:48.439692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.439273 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj" event={"ID":"8161044e-3469-4a93-bd6e-1f909e54f2b0","Type":"ContainerDied","Data":"f4e6a8e98d7af1d7a0b5a8f61e77e92d16c9de58cb121e734ab29bb0e80bb4c5"} May 28 16:26:48.439692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.439289 2575 scope.go:117] "RemoveContainer" containerID="94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a" May 28 16:26:48.449194 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.449175 2575 scope.go:117] "RemoveContainer" containerID="94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a" May 28 16:26:48.449447 ip-10-0-136-8 kubenswrapper[2575]: E0528 16:26:48.449429 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a\": container with ID starting with 94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a not found: ID does not exist" containerID="94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a" May 28 16:26:48.449522 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.449454 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a"} err="failed to get container status \"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a\": rpc error: code = NotFound desc = could not find container \"94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a\": container with ID starting with 94a7d825657ecfe8dc8c8ccf40ad2c3925eca439f01145d2fd689e289021591a not found: ID does not exist" May 28 16:26:48.461880 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.461856 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:26:48.465440 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:48.465418 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bdsfj"] May 28 16:26:49.311657 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:26:49.311628 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" path="/var/lib/kubelet/pods/8161044e-3469-4a93-bd6e-1f909e54f2b0/volumes" May 28 16:27:09.382904 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:09.382875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:27:09.388322 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:09.388270 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:27:09.390693 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:09.390672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:27:09.395549 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:09.395526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:27:53.419076 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419042 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22"] May 28 16:27:53.419727 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419706 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" containerName="authorino" May 28 16:27:53.419811 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419730 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" containerName="authorino" May 28 16:27:53.419811 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419766 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerName="manager" May 28 16:27:53.419811 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419776 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerName="manager" May 28 16:27:53.419973 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419892 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8161044e-3469-4a93-bd6e-1f909e54f2b0" containerName="manager" May 28 16:27:53.419973 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.419911 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b63f0049-27c1-4707-91a7-4fcd624e5fc9" containerName="authorino" May 28 16:27:53.423155 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.423132 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.425961 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.425942 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2f94d\"" May 28 16:27:53.432915 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.432893 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22"] May 28 16:27:53.522791 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.522754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t762m\" (UniqueName: \"kubernetes.io/projected/f4052b68-5852-4376-b4bf-4426c6ca15af-kube-api-access-t762m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.522994 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.522913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4052b68-5852-4376-b4bf-4426c6ca15af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.623430 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.623394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t762m\" (UniqueName: \"kubernetes.io/projected/f4052b68-5852-4376-b4bf-4426c6ca15af-kube-api-access-t762m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.623630 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.623513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4052b68-5852-4376-b4bf-4426c6ca15af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.623863 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.623844 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4052b68-5852-4376-b4bf-4426c6ca15af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.634963 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.634936 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t762m\" (UniqueName: \"kubernetes.io/projected/f4052b68-5852-4376-b4bf-4426c6ca15af-kube-api-access-t762m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vvf22\" (UID: \"f4052b68-5852-4376-b4bf-4426c6ca15af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.735468 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.735362 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:53.880033 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.879993 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22"] May 28 16:27:53.883405 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:27:53.883375 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4052b68_5852_4376_b4bf_4426c6ca15af.slice/crio-c99f05477a1c6bc535de2ba7271fdef40d125c47270b9daec7284118de442f1e WatchSource:0}: Error finding container c99f05477a1c6bc535de2ba7271fdef40d125c47270b9daec7284118de442f1e: Status 404 returned error can't find the container with id c99f05477a1c6bc535de2ba7271fdef40d125c47270b9daec7284118de442f1e May 28 16:27:53.885669 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:53.885651 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:27:54.695845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:54.695788 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" event={"ID":"f4052b68-5852-4376-b4bf-4426c6ca15af","Type":"ContainerStarted","Data":"b4d73173146748b96af6d7d78e59af15469c09b5faad803c07b1306c6bf4de96"} May 28 16:27:54.695845 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:54.695836 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" event={"ID":"f4052b68-5852-4376-b4bf-4426c6ca15af","Type":"ContainerStarted","Data":"c99f05477a1c6bc535de2ba7271fdef40d125c47270b9daec7284118de442f1e"} May 28 16:27:54.696291 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:54.695892 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:27:54.716048 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:27:54.716001 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" podStartSLOduration=1.715985593 podStartE2EDuration="1.715985593s" podCreationTimestamp="2026-05-28 16:27:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:27:54.713133725 +0000 UTC m=+1545.964048578" watchObservedRunningTime="2026-05-28 16:27:54.715985593 +0000 UTC m=+1545.966900447" May 28 16:28:05.701692 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:28:05.701659 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vvf22" May 28 16:32:09.414178 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:32:09.414140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:32:09.419221 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:32:09.419194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:32:09.422385 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:32:09.422366 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:32:09.427269 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:32:09.427250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:37:09.451057 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:09.451029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:37:09.456618 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:09.456595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:37:09.460051 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:09.460022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:37:09.464710 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:09.464693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:37:38.374190 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:38.374142 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-b9znv_cd63278c-8c00-4636-af7d-7e6c38afd30a/manager/0.log" May 28 16:37:39.072715 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:39.072680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-864b4b584-4lnmq_b2a55bf7-9192-45b0-b459-a6107234caa4/manager/0.log" May 28 16:37:40.766496 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:40.766464 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-nprp6_acea1aff-9d9a-4073-95c9-16409a27b96d/manager/0.log" May 28 16:37:41.104786 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:41.104756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9xsbb_a625fac9-20cf-45ed-8988-c746785474b8/registry-server/0.log" May 28 16:37:41.224116 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:41.224086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vvf22_f4052b68-5852-4376-b4bf-4426c6ca15af/manager/0.log" May 28 16:37:41.798261 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:41.798224 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5q42c_9eb1d566-5b23-45ae-8966-457defd453a3/istio-proxy/0.log" May 28 16:37:42.125395 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:42.125364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779556875f-tb42t_83302d09-06f7-4454-8a0b-817fdc06a748/kube-auth-proxy/0.log" May 28 16:37:42.247947 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:42.247907 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-wcdj9_8d482b0f-171f-4d76-8fed-ea33b2834083/istio-proxy/0.log" May 28 16:37:42.480229 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:42.480149 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fdf595458-kqvgd_2b991597-e3b6-4982-be46-b6a97ded5161/router/0.log" May 28 16:37:42.830012 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:42.829969 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd_0f1c7b8a-6894-42fe-86af-7a0508946fc6/main/0.log" May 28 16:37:42.841017 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:42.840986 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-6f5kd_0f1c7b8a-6894-42fe-86af-7a0508946fc6/storage-initializer/0.log" May 28 16:37:43.414418 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:43.414392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk_48b664e5-32d9-4bd9-b6a1-24243bb81e45/storage-initializer/0.log" May 28 16:37:43.422114 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:43.422091 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nkmgk_48b664e5-32d9-4bd9-b6a1-24243bb81e45/main/0.log" May 28 16:37:50.589708 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:50.589676 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-swqsb_43b181aa-edbd-46c6-8290-f513a4bad451/global-pull-secret-syncer/0.log" May 28 16:37:50.734504 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:50.734472 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hk6g2_cea25699-9b7a-43c4-9c50-7dc9a4937359/konnectivity-agent/0.log" May 28 16:37:50.830122 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:50.830084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-8.ec2.internal_0410c5901f1d12b6ff4640234fe0fc00/haproxy/0.log" May 28 16:37:55.071788 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:55.071755 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-nprp6_acea1aff-9d9a-4073-95c9-16409a27b96d/manager/0.log" May 28 16:37:55.162933 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:55.162887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9xsbb_a625fac9-20cf-45ed-8988-c746785474b8/registry-server/0.log" May 28 16:37:55.253616 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:55.253583 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vvf22_f4052b68-5852-4376-b4bf-4426c6ca15af/manager/0.log" May 28 16:37:56.944327 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:56.944271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-ksv6t_f52a7ac3-de62-4237-b8d8-725fcc942b2d/cluster-monitoring-operator/0.log" May 28 16:37:56.973906 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:56.973879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-667pl_ef4a0ce6-e9c1-442a-89dd-b2a1d5549404/kube-state-metrics/0.log" May 28 16:37:56.988112 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:56.988084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-667pl_ef4a0ce6-e9c1-442a-89dd-b2a1d5549404/kube-rbac-proxy-main/0.log" May 28 16:37:57.005407 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.005379 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-667pl_ef4a0ce6-e9c1-442a-89dd-b2a1d5549404/kube-rbac-proxy-self/0.log" May 28 16:37:57.034581 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.034547 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79b586d48b-tdfrf_6b49c3ef-1fd5-4f5f-9821-eddb2395b65b/metrics-server/0.log" May 28 16:37:57.059204 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.059173 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-vjstp_d6d77d95-cb9f-4b90-8c4d-e75b56b5e177/monitoring-plugin/0.log" May 28 16:37:57.088476 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.088446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c7jb_af4f4ab4-9a30-4758-a255-44317f1962ce/node-exporter/0.log" May 28 16:37:57.105707 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.105667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c7jb_af4f4ab4-9a30-4758-a255-44317f1962ce/kube-rbac-proxy/0.log" May 28 16:37:57.123362 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.123338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2c7jb_af4f4ab4-9a30-4758-a255-44317f1962ce/init-textfile/0.log" May 28 16:37:57.297364 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.297273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-sx668_cc824ed3-b6a4-4d28-bc7b-c340d617c02c/kube-rbac-proxy-main/0.log" May 28 16:37:57.315975 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.315928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-sx668_cc824ed3-b6a4-4d28-bc7b-c340d617c02c/kube-rbac-proxy-self/0.log" May 28 16:37:57.335132 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.335102 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-sx668_cc824ed3-b6a4-4d28-bc7b-c340d617c02c/openshift-state-metrics/0.log" May 28 16:37:57.513088 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.513048 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7cdbn_83683591-5b18-44c9-8fa4-df02b47f71a9/prometheus-operator/0.log" May 28 16:37:57.527815 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.527787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7cdbn_83683591-5b18-44c9-8fa4-df02b47f71a9/kube-rbac-proxy/0.log" May 28 16:37:57.550814 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.550739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-84g7v_058c5e5c-def2-42d0-bf7c-16229ba10e41/prometheus-operator-admission-webhook/0.log" May 28 16:37:57.658548 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.658517 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/thanos-query/0.log" May 28 16:37:57.678248 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.678221 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/kube-rbac-proxy-web/0.log" May 28 16:37:57.696589 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.696565 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/kube-rbac-proxy/0.log" May 28 16:37:57.719010 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.718980 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/prom-label-proxy/0.log" May 28 16:37:57.737287 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.737258 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/kube-rbac-proxy-rules/0.log" May 28 16:37:57.755060 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:57.755035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b599bf55-fqqkg_5962ac23-aa42-42db-8436-082adb3e8482/kube-rbac-proxy-metrics/0.log" May 28 16:37:58.807669 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:58.807639 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-l5jkr_7e761cb6-3403-43ee-8509-6c31f7b4b6fc/networking-console-plugin/0.log" May 28 16:37:59.170877 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.170842 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh"] May 28 16:37:59.174737 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.174717 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.176888 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.176864 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8x6z2\"/\"kube-root-ca.crt\"" May 28 16:37:59.177017 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.176864 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8x6z2\"/\"openshift-service-ca.crt\"" May 28 16:37:59.177017 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.176916 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8x6z2\"/\"default-dockercfg-fd2fx\"" May 28 16:37:59.185331 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.185289 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh"] May 28 16:37:59.274268 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.274226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-podres\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.274490 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.274283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8qn\" (UniqueName: \"kubernetes.io/projected/dbe0354b-7dee-4868-94a0-0ea4276b6804-kube-api-access-7k8qn\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.274490 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.274390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-sys\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.274593 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.274505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-lib-modules\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.274593 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.274545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-proc\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.311992 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.311960 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/1.log" May 28 16:37:59.320905 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.320865 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wxl59_58c0a118-055a-4aa4-9107-26b53796ad93/console-operator/2.log" May 28 16:37:59.375389 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-lib-modules\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375395 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-proc\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-podres\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8qn\" (UniqueName: \"kubernetes.io/projected/dbe0354b-7dee-4868-94a0-0ea4276b6804-kube-api-access-7k8qn\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375499 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-sys\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-proc\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-lib-modules\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375576 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-sys\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.375901 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.375624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbe0354b-7dee-4868-94a0-0ea4276b6804-podres\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.382501 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.382478 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8qn\" (UniqueName: \"kubernetes.io/projected/dbe0354b-7dee-4868-94a0-0ea4276b6804-kube-api-access-7k8qn\") pod \"perf-node-gather-daemonset-c24dh\" (UID: \"dbe0354b-7dee-4868-94a0-0ea4276b6804\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.485862 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.485771 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:37:59.618188 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.618163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh"] May 28 16:37:59.620051 ip-10-0-136-8 kubenswrapper[2575]: W0528 16:37:59.620021 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddbe0354b_7dee_4868_94a0_0ea4276b6804.slice/crio-08b65d23c496978871767be0e2faf48f8a3a8ada3925d67863284a59bd8e5d3a WatchSource:0}: Error finding container 08b65d23c496978871767be0e2faf48f8a3a8ada3925d67863284a59bd8e5d3a: Status 404 returned error can't find the container with id 08b65d23c496978871767be0e2faf48f8a3a8ada3925d67863284a59bd8e5d3a May 28 16:37:59.621759 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.621741 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:37:59.802264 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.802237 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64dd85bf5c-876mp_f76aeb87-697c-45a5-95b4-ca69334df62f/console/0.log" May 28 16:37:59.837106 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:37:59.837070 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-6r8t6_5a1c87ef-5b56-4c71-8d46-d16a269683d1/download-server/0.log" May 28 16:38:00.026244 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:00.026148 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" event={"ID":"dbe0354b-7dee-4868-94a0-0ea4276b6804","Type":"ContainerStarted","Data":"49e8ccf18ca69b2d59884b5eac88a42c738e8aa70eada19fb61a42c491c0f504"} May 28 16:38:00.026244 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:00.026184 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" event={"ID":"dbe0354b-7dee-4868-94a0-0ea4276b6804","Type":"ContainerStarted","Data":"08b65d23c496978871767be0e2faf48f8a3a8ada3925d67863284a59bd8e5d3a"} May 28 16:38:00.026244 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:00.026207 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:38:00.041767 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:00.041706 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" podStartSLOduration=1.041690127 podStartE2EDuration="1.041690127s" podCreationTimestamp="2026-05-28 16:37:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:38:00.039042549 +0000 UTC m=+2151.289957406" watchObservedRunningTime="2026-05-28 16:38:00.041690127 +0000 UTC m=+2151.292604982" May 28 16:38:00.292680 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:00.292580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-qmzgq_8d7db7ec-0d1b-4717-a764-06c0a5a4e3f1/volume-data-source-validator/0.log" May 28 16:38:01.049916 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:01.049890 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-247qz_6554cc8a-2ea1-44b7-ba35-084707c1d3bd/dns/0.log" May 28 16:38:01.068010 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:01.067983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-247qz_6554cc8a-2ea1-44b7-ba35-084707c1d3bd/kube-rbac-proxy/0.log" May 28 16:38:01.207843 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:01.207813 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntrj8_71a02dd1-1758-41d7-98b9-cb335cfd49a6/dns-node-resolver/0.log" May 28 16:38:01.639668 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:01.639616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55f8dc8f48-5js4j_58f53d8c-23a0-44fa-9fad-660c20af0afc/registry/0.log" May 28 16:38:01.662649 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:01.662616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jtlv5_2141721f-b955-4f96-b756-5c000b93280d/node-ca/0.log" May 28 16:38:02.441934 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:02.441891 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5q42c_9eb1d566-5b23-45ae-8966-457defd453a3/istio-proxy/0.log" May 28 16:38:02.575587 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:02.575558 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779556875f-tb42t_83302d09-06f7-4454-8a0b-817fdc06a748/kube-auth-proxy/0.log" May 28 16:38:02.656370 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:02.656308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-wcdj9_8d482b0f-171f-4d76-8fed-ea33b2834083/istio-proxy/0.log" May 28 16:38:02.726502 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:02.726416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fdf595458-kqvgd_2b991597-e3b6-4982-be46-b6a97ded5161/router/0.log" May 28 16:38:03.218281 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.218250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6g8g4_33e463e3-113e-4e69-974c-bdb1b0b889c5/serve-healthcheck-canary/0.log" May 28 16:38:03.709633 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.709597 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-86tf6_7ccdf75b-b009-448f-aab0-776c93289ac0/insights-operator/0.log" May 28 16:38:03.711263 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.711241 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-86tf6_7ccdf75b-b009-448f-aab0-776c93289ac0/insights-operator/1.log" May 28 16:38:03.851218 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.851189 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktnz5_62d3bfc7-60eb-441c-bd4c-0ff0567b67ca/kube-rbac-proxy/0.log" May 28 16:38:03.868616 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.868581 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktnz5_62d3bfc7-60eb-441c-bd4c-0ff0567b67ca/exporter/0.log" May 28 16:38:03.886470 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:03.886429 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktnz5_62d3bfc7-60eb-441c-bd4c-0ff0567b67ca/extractor/0.log" May 28 16:38:05.717263 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:05.717228 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-b9znv_cd63278c-8c00-4636-af7d-7e6c38afd30a/manager/0.log" May 28 16:38:05.929488 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:05.929441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-864b4b584-4lnmq_b2a55bf7-9192-45b0-b459-a6107234caa4/manager/0.log" May 28 16:38:06.040247 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:06.040169 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-c24dh" May 28 16:38:11.221355 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:11.221323 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7vl9b_bcee752e-a57b-4a5f-8feb-6898f0fda42c/migrator/0.log" May 28 16:38:11.239515 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:11.239484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7vl9b_bcee752e-a57b-4a5f-8feb-6898f0fda42c/graceful-termination/0.log" May 28 16:38:11.557314 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:11.557206 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-bxzf7_16e6f5c3-dc9f-41c5-8648-35e679c765b3/kube-storage-version-migrator-operator/1.log" May 28 16:38:11.558944 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:11.558907 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-bxzf7_16e6f5c3-dc9f-41c5-8648-35e679c765b3/kube-storage-version-migrator-operator/0.log" May 28 16:38:12.501388 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.501358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/kube-multus-additional-cni-plugins/0.log" May 28 16:38:12.519378 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.519353 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/egress-router-binary-copy/0.log" May 28 16:38:12.539149 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.539126 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/cni-plugins/0.log" May 28 16:38:12.558111 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.558088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/bond-cni-plugin/0.log" May 28 16:38:12.577033 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.577011 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/routeoverride-cni/0.log" May 28 16:38:12.595360 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.595338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/whereabouts-cni-bincopy/0.log" May 28 16:38:12.613128 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.613104 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9kcpf_cb6981b3-4b8b-44b9-bc69-f48d8b118884/whereabouts-cni/0.log" May 28 16:38:12.933144 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.933087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j7w94_358ed11c-d042-4e04-952f-9e76f82c0b4f/kube-multus/0.log" May 28 16:38:12.978266 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.978230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-njpw4_4bdc9f5c-9530-492c-afee-5c917f830aa4/network-metrics-daemon/0.log" May 28 16:38:12.992957 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:12.992933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-njpw4_4bdc9f5c-9530-492c-afee-5c917f830aa4/kube-rbac-proxy/0.log" May 28 16:38:14.531852 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.531791 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-controller/0.log" May 28 16:38:14.547111 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.547085 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/0.log" May 28 16:38:14.567583 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.567556 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovn-acl-logging/1.log" May 28 16:38:14.585419 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.585392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/kube-rbac-proxy-node/0.log" May 28 16:38:14.604708 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.604678 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/kube-rbac-proxy-ovn-metrics/0.log" May 28 16:38:14.625093 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.625069 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/northd/0.log" May 28 16:38:14.648537 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.648514 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/nbdb/0.log" May 28 16:38:14.667309 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.667269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/sbdb/0.log" May 28 16:38:14.829407 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:14.829364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk672_eb0b6881-dce5-483e-865c-e9de9c79224d/ovnkube-controller/0.log" May 28 16:38:15.852370 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:15.850918 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-vd8fx_dc18d335-6a46-4cda-8a3a-b19eca0fdffa/check-endpoints/0.log" May 28 16:38:15.918822 ip-10-0-136-8 kubenswrapper[2575]: I0528 16:38:15.918789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xtvnr_bb508ca5-6638-48e7-be0c-006c1dad8bb7/network-check-target-container/0.log"