May 21 14:35:34.600161 ip-10-0-140-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 14:35:34.600176 ip-10-0-140-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 14:35:34.600185 ip-10-0-140-221 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 14:35:34.600519 ip-10-0-140-221 systemd[1]: Failed to start Kubernetes Kubelet. May 21 14:35:44.712757 ip-10-0-140-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 14:35:44.712779 ip-10-0-140-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a9d93ca6839c43e8bd07b869de83b09c -- May 21 14:38:09.579326 ip-10-0-140-221 systemd[1]: Starting Kubernetes Kubelet... May 21 14:38:09.984618 ip-10-0-140-221 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:09.984618 ip-10-0-140-221 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:38:09.984618 ip-10-0-140-221 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:09.984618 ip-10-0-140-221 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:38:09.984618 ip-10-0-140-221 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:09.985820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.985454 2554 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:38:09.989166 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989151 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:09.989166 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989165 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989169 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989172 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989175 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989178 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989181 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989185 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989188 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989190 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989193 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989196 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989199 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989201 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989204 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989207 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989210 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989212 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989215 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989217 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989225 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:09.989228 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989228 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989231 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989234 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989237 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989240 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989243 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989246 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989250 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989253 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989256 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989259 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989262 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989264 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989267 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989270 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989273 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989275 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989278 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989280 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989283 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:09.989701 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989285 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989288 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989291 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989293 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989296 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989299 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989301 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989304 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989306 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989309 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989311 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989315 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989319 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989322 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989326 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989329 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989332 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989334 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989337 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:09.990198 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989340 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989342 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989345 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989347 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989350 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989352 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989355 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989357 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989360 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989363 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989365 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989368 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989370 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989373 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989375 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989377 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989380 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989382 2554 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989385 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989388 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:09.990659 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989391 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989393 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989396 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989398 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989401 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989403 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989770 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989776 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989779 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989782 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989785 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989787 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989790 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989793 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989796 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989798 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989801 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989803 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989806 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:09.991159 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989808 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989811 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989813 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989816 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989819 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989821 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989824 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989826 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989829 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989832 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989834 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989837 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989840 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989842 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989845 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989847 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989850 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989853 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989855 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989858 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:09.991627 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989862 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989866 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989869 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989871 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989874 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989877 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989879 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989883 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989887 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989890 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989893 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989895 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989898 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989900 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989903 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989906 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989909 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989911 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989914 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989916 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:09.992467 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989919 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989921 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989924 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989926 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989929 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989931 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989934 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989936 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989939 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989941 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989943 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989946 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989950 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989953 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989955 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989959 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989963 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989965 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989968 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989971 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:09.992998 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989973 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989976 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989978 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989981 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989983 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989986 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989988 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989991 2554 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989993 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989996 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.989998 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.990001 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.990003 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990943 2554 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990952 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990962 2554 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990966 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990972 2554 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990975 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990979 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990985 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:38:09.993516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990988 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990991 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990994 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.990998 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991002 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991005 2554 flags.go:64] FLAG: --cgroup-root="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991009 2554 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991012 2554 flags.go:64] FLAG: --client-ca-file="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991015 2554 flags.go:64] FLAG: --cloud-config="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991018 2554 flags.go:64] FLAG: --cloud-provider="external" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991021 2554 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991025 2554 flags.go:64] FLAG: --cluster-domain="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991028 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991031 2554 flags.go:64] FLAG: --config-dir="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991034 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991037 2554 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991041 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991044 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991047 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991050 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991053 2554 flags.go:64] FLAG: --contention-profiling="false" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991056 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991072 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991076 2554 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991079 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:38:09.994028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991083 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991086 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991089 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991092 2554 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991095 2554 flags.go:64] FLAG: --enable-server="true" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991098 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991104 2554 flags.go:64] FLAG: --event-burst="100" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991107 2554 flags.go:64] FLAG: --event-qps="50" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991110 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991113 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991116 2554 flags.go:64] FLAG: --eviction-hard="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991120 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991123 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991126 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991129 2554 flags.go:64] FLAG: --eviction-soft="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991132 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991135 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991138 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991141 2554 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991143 2554 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991146 2554 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991149 2554 flags.go:64] FLAG: --feature-gates="" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991153 2554 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991156 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991159 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:38:09.994661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991162 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991166 2554 flags.go:64] FLAG: --healthz-port="10248" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991169 2554 flags.go:64] FLAG: --help="false" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991172 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-140-221.ec2.internal" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991175 2554 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991178 2554 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991181 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991184 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991188 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991191 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991193 2554 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991196 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991199 2554 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991203 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991206 2554 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991208 2554 flags.go:64] FLAG: --kube-reserved="" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991211 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991214 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991217 2554 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991220 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991223 2554 flags.go:64] FLAG: --lock-file="" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991226 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991229 2554 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991232 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:38:09.995284 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991237 2554 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991240 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991243 2554 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991245 2554 flags.go:64] FLAG: --logging-format="text" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991248 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991252 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991254 2554 flags.go:64] FLAG: --manifest-url="" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991257 2554 flags.go:64] FLAG: --manifest-url-header="" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991262 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991265 2554 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991269 2554 flags.go:64] FLAG: --max-pods="110" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991272 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991275 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991278 2554 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991281 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991284 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991286 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991289 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991296 2554 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991299 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991302 2554 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991305 2554 flags.go:64] FLAG: --pod-cidr="" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991308 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:38:09.995860 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991315 2554 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991318 2554 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991322 2554 flags.go:64] FLAG: --pods-per-core="0" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991325 2554 flags.go:64] FLAG: --port="10250" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991328 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991330 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05f523a5bbe9b9b3c" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991334 2554 flags.go:64] FLAG: --qos-reserved="" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991337 2554 flags.go:64] FLAG: --read-only-port="10255" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991340 2554 flags.go:64] FLAG: --register-node="true" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991343 2554 flags.go:64] FLAG: --register-schedulable="true" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991346 2554 flags.go:64] FLAG: --register-with-taints="" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991354 2554 flags.go:64] FLAG: --registry-burst="10" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991357 2554 flags.go:64] FLAG: --registry-qps="5" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991360 2554 flags.go:64] FLAG: --reserved-cpus="" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991363 2554 flags.go:64] FLAG: --reserved-memory="" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991369 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991372 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991375 2554 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991377 2554 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991380 2554 flags.go:64] FLAG: --runonce="false" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991383 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991386 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991389 2554 flags.go:64] FLAG: --seccomp-default="false" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991392 2554 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991395 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991398 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:38:09.996433 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991401 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991404 2554 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991407 2554 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991409 2554 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991412 2554 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991415 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991418 2554 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991421 2554 flags.go:64] FLAG: --system-cgroups="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991426 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991432 2554 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991435 2554 flags.go:64] FLAG: --tls-cert-file="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991438 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991442 2554 flags.go:64] FLAG: --tls-min-version="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991445 2554 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991448 2554 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991451 2554 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991454 2554 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991457 2554 flags.go:64] FLAG: --v="2" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991461 2554 flags.go:64] FLAG: --version="false" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991466 2554 flags.go:64] FLAG: --vmodule="" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991470 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.991473 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994455 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994576 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:09.997053 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994584 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994589 2554 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994593 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994597 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994601 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994606 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994611 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994616 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994620 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994624 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994629 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994633 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994637 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994642 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994646 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994650 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994654 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994658 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994662 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994667 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:09.997670 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994671 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994675 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994680 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994684 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994689 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994693 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994697 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994702 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994706 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994710 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994714 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994720 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994724 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994729 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994733 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994737 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994741 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994745 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994749 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994753 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:09.998266 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994755 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994758 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994761 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994766 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994770 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994773 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994776 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994778 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994781 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994784 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994787 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994789 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994792 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994794 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994797 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994800 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994804 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994808 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994811 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:09.998757 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994814 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994817 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994819 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994823 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994827 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994830 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994833 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994836 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994838 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994841 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994843 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994846 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994848 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994851 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994853 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994856 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994858 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994861 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994864 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994867 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:09.999244 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994869 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:09.999733 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994872 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:09.999733 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994875 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:09.999733 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994877 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:09.999733 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:09.994879 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:09.999733 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:09.995592 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:10.002142 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.002123 2554 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:38:10.002187 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.002143 2554 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002189 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002195 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002198 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002201 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002204 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002207 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002210 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002213 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002215 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002218 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:10.002218 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002221 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002224 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002227 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002230 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002234 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002237 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002239 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002242 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002245 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002248 2554 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002250 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002253 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002255 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002258 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002260 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002263 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002265 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002268 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002271 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002273 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:10.002493 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002276 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002279 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002282 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002285 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002287 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002290 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002292 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002295 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002297 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002300 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002302 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002305 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002308 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002311 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002314 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002316 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002319 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002321 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002324 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:10.002969 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002327 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002330 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002332 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002335 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002337 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002340 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002342 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002345 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002347 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002350 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002352 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002355 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002357 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002360 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002362 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002372 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002375 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002378 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002380 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002383 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:10.003530 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002386 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002389 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002391 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002394 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002397 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002401 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002405 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002408 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002411 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002414 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002416 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002419 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002423 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002426 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002429 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002432 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:10.004023 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002434 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.002439 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002530 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002534 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002537 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002541 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002545 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002548 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002551 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002554 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002557 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002560 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002564 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002566 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002569 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:10.004434 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002573 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002576 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002578 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002581 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002584 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002586 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002589 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002592 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002594 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002597 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002600 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002604 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002607 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002609 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002612 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002615 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002617 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002620 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002622 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:10.004809 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002625 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002628 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002630 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002632 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002635 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002638 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002640 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002643 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002645 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002648 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002650 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002653 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002656 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002659 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002662 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002665 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002667 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002670 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002672 2554 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002674 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:10.005289 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002677 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002679 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002682 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002684 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002687 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002689 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002692 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002694 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002696 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002699 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002701 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002704 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002706 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002709 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002711 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002714 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002716 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002719 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002721 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002724 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:10.005770 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002726 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002729 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002731 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002734 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002737 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002739 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002742 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002745 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002747 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002750 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002752 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002755 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002757 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:10.002760 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.002764 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:10.006270 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.003587 2554 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:38:10.006826 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.006812 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:38:10.007736 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.007724 2554 server.go:1019] "Starting client certificate rotation" May 21 14:38:10.007846 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.007828 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:38:10.008567 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.008554 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:38:10.031184 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.031162 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:38:10.033217 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.033198 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:38:10.045089 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.045073 2554 log.go:25] "Validated CRI v1 runtime API" May 21 14:38:10.050014 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.050001 2554 log.go:25] "Validated CRI v1 image API" May 21 14:38:10.051964 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.051945 2554 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:38:10.056968 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.056949 2554 fs.go:135] Filesystem UUIDs: map[4c914cbd-2c58-4351-b8c5-b64d2120a3be:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bdc80a37-42b1-48ae-87c7-f40bd20ad7fe:/dev/nvme0n1p4] May 21 14:38:10.057043 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.056967 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:38:10.061288 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.061268 2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:38:10.061632 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.061535 2554 manager.go:217] Machine: {Timestamp:2026-05-21 14:38:10.060871501 +0000 UTC m=+0.374791009 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099926 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a06f3c87e09e50179ec90505732d1 SystemUUID:ec2a06f3-c87e-09e5-0179-ec90505732d1 BootID:a9d93ca6-839c-43e8-bd07-b869de83b09c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:ee:ff:4c:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:ee:ff:4c:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:22:5a:d5:26:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:38:10.062265 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.062254 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:38:10.062348 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.062329 2554 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:38:10.064049 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064027 2554 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:38:10.064205 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064049 2554 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:38:10.064252 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064215 2554 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:38:10.064252 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064223 2554 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:38:10.064252 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064231 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:38:10.064949 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.064939 2554 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:38:10.066387 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.066376 2554 state_mem.go:36] "Initialized new in-memory state store" May 21 14:38:10.066522 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.066512 2554 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:38:10.068548 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.068539 2554 kubelet.go:491] "Attempting to sync node with API server" May 21 14:38:10.068585 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.068552 2554 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:38:10.068585 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.068563 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:38:10.068585 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.068572 2554 kubelet.go:397] "Adding apiserver pod source" May 21 14:38:10.068585 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.068582 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:38:10.069774 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.069763 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:38:10.069824 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.069781 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:38:10.072408 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.072395 2554 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:38:10.074650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.074637 2554 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:38:10.076562 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076550 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076566 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076576 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076584 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076594 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076601 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:38:10.076604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076606 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:38:10.076749 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076612 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:38:10.076749 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076619 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:38:10.076749 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076624 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:38:10.076749 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076632 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:38:10.076749 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.076638 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:38:10.077261 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.077251 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:38:10.077291 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.077263 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:38:10.080430 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080415 2554 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:38:10.080496 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080489 2554 server.go:1295] "Started kubelet" May 21 14:38:10.080528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080503 2554 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:38:10.080575 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080416 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8hfn" May 21 14:38:10.080619 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080559 2554 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:38:10.080619 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.080600 2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:38:10.080683 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080651 2554 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:38:10.080683 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.080651 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:38:10.081335 ip-10-0-140-221 systemd[1]: Started Kubernetes Kubelet. May 21 14:38:10.084494 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.084463 2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:38:10.084650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.084632 2554 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:38:10.085797 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.085775 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8hfn" May 21 14:38:10.086787 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.086768 2554 server.go:317] "Adding debug handlers to kubelet server" May 21 14:38:10.092896 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.092875 2554 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:38:10.094335 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094241 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:38:10.094335 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094258 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:38:10.094530 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094521 2554 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:38:10.094595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094531 2554 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:38:10.094595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094580 2554 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:38:10.094677 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094665 2554 reconstruct.go:97] "Volume reconstruction finished" May 21 14:38:10.094677 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.094674 2554 reconciler.go:26] "Reconciler: start to sync state" May 21 14:38:10.095167 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.095149 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.095407 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095385 2554 factory.go:55] Registering systemd factory May 21 14:38:10.095407 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095405 2554 factory.go:223] Registration of the systemd container factory successfully May 21 14:38:10.095603 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095588 2554 factory.go:153] Registering CRI-O factory May 21 14:38:10.095603 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095605 2554 factory.go:223] Registration of the crio container factory successfully May 21 14:38:10.095752 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095653 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:38:10.095752 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095676 2554 factory.go:103] Registering Raw factory May 21 14:38:10.095752 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.095717 2554 manager.go:1196] Started watching for new ooms in manager May 21 14:38:10.096352 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.096335 2554 manager.go:319] Starting recovery of all containers May 21 14:38:10.097260 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.097238 2554 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:10.100266 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.100241 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-221.ec2.internal\" not found" node="ip-10-0-140-221.ec2.internal" May 21 14:38:10.101922 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.101886 2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:38:10.106411 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.106289 2554 manager.go:324] Recovery completed May 21 14:38:10.110631 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.110618 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.112551 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.112533 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.112641 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.112570 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.112641 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.112587 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.113106 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.113092 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:38:10.113106 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.113104 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:38:10.113220 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.113119 2554 state_mem.go:36] "Initialized new in-memory state store" May 21 14:38:10.115911 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.115900 2554 policy_none.go:49] "None policy: Start" May 21 14:38:10.115947 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.115916 2554 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:38:10.115947 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.115927 2554 state_mem.go:35] "Initializing new in-memory state store" May 21 14:38:10.150609 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.150593 2554 manager.go:341] "Starting Device Plugin manager" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.150654 2554 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.150695 2554 server.go:85] "Starting device plugin registration server" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.150907 2554 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.150918 2554 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.151031 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.151138 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.151149 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.151661 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:38:10.161955 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.151693 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.218920 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.218901 2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:38:10.219021 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.218932 2554 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:38:10.219021 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.218955 2554 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:38:10.219021 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.218965 2554 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:38:10.219021 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.219006 2554 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:38:10.222349 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.222334 2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:10.251353 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.251305 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.252109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.252095 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.252174 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.252129 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.252174 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.252143 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.252174 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.252169 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-221.ec2.internal" May 21 14:38:10.260309 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.260294 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-221.ec2.internal" May 21 14:38:10.260367 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.260317 2554 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-221.ec2.internal\": node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.274481 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.274460 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.319691 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.319663 2554 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal"] May 21 14:38:10.319771 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.319756 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.320735 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.320720 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.320817 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.320749 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.320817 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.320775 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.322130 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.322117 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.322300 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.322288 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.322337 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.322315 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.323560 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323539 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.323658 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323573 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.323658 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323586 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.323658 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323587 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.323658 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323606 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.323658 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.323617 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.324706 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.324692 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:10.324780 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.324716 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:10.325471 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.325457 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:10.325527 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.325477 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:10.325527 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.325487 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:10.354661 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.354642 2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-221.ec2.internal\" not found" node="ip-10-0-140-221.ec2.internal" May 21 14:38:10.357993 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.357974 2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-221.ec2.internal\" not found" node="ip-10-0-140-221.ec2.internal" May 21 14:38:10.375179 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.375160 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.396487 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.396464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.396552 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.396498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.396552 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.396517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d113bb90b30a0ad30c8cd3725255e56-config\") pod \"kube-apiserver-proxy-ip-10-0-140-221.ec2.internal\" (UID: \"6d113bb90b30a0ad30c8cd3725255e56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:10.476253 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.476214 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.497576 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497547 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.497693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497584 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.497693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497611 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d113bb90b30a0ad30c8cd3725255e56-config\") pod \"kube-apiserver-proxy-ip-10-0-140-221.ec2.internal\" (UID: \"6d113bb90b30a0ad30c8cd3725255e56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:10.497693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497662 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d113bb90b30a0ad30c8cd3725255e56-config\") pod \"kube-apiserver-proxy-ip-10-0-140-221.ec2.internal\" (UID: \"6d113bb90b30a0ad30c8cd3725255e56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:10.497693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.497842 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.497693 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70363879c7e7a02228ec6966e9295d64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal\" (UID: \"70363879c7e7a02228ec6966e9295d64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.576951 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.576895 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.658371 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.658345 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:10.661275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:10.661252 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:10.677314 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.677293 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.777789 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.777750 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.878341 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.878244 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:10.978720 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:10.978693 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-221.ec2.internal\" not found" May 21 14:38:11.008128 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.008110 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:38:11.008596 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.008265 2554 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:38:11.008596 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.008298 2554 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:38:11.028036 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.028014 2554 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:11.069274 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.069253 2554 apiserver.go:52] "Watching apiserver" May 21 14:38:11.080711 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.080688 2554 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:38:11.082485 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.082463 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-wgg4p","openshift-network-diagnostics/network-check-target-rzhlj","kube-system/konnectivity-agent-2xnpq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56","openshift-multus/multus-vd7d6","openshift-network-operator/iptables-alerter-24mg7","openshift-ovn-kubernetes/ovnkube-node-phmc2","openshift-cluster-node-tuning-operator/tuned-xpc84","openshift-image-registry/node-ca-2sk9b","openshift-multus/multus-additional-cni-plugins-c4vtg"] May 21 14:38:11.087491 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.087470 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.087587 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.087565 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:11.087664 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.087644 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:11.087738 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.087719 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:11.088298 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.088257 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:33:10 +0000 UTC" deadline="2028-01-22 06:22:19.029347172 +0000 UTC" May 21 14:38:11.088298 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.088289 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14655h44m7.941061499s" May 21 14:38:11.090194 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.090178 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.092732 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.092714 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:38:11.092867 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.092758 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:38:11.092867 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.092781 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f8bgt\"" May 21 14:38:11.094857 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.094841 2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" May 21 14:38:11.094937 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.094843 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:38:11.095489 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.095466 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.096160 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.095467 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vd7d6" May 21 14:38:11.098128 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.098110 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.098290 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.098271 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:38:11.099041 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099021 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:38:11.099295 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099269 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-65nlj\"" May 21 14:38:11.099385 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099315 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:38:11.099385 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099276 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:38:11.099385 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099375 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:38:11.099538 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099413 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:38:11.099603 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099588 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2vjsx\"" May 21 14:38:11.099911 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.099897 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:38:11.100073 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100124 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100124 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100187 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-conf-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100187 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzdn\" (UniqueName: \"kubernetes.io/projected/65b15b1f-0915-43fc-8d45-b356ed26504d-kube-api-access-kzzdn\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-k8s-cni-cncf-io\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-etc-kubernetes\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100218 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krs55\" (UniqueName: \"kubernetes.io/projected/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-kube-api-access-krs55\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-system-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100247 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-cni-binary-copy\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-netns\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100278 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-bin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-socket-dir-parent\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-kubelet\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-multus-certs\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxssf\" (UniqueName: \"kubernetes.io/projected/66211a43-a9aa-443c-9941-65435b44df5b-kube-api-access-lxssf\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-konnectivity-ca\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-device-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-multus\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-hostroot\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100542 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-agent-certs\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-cnibin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100664 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-os-release\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.100823 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-multus-daemon-config\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.101173 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.100892 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.101393 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.101378 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8sj56\"" May 21 14:38:11.101748 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.101730 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:38:11.101831 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.101761 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:11.101926 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.101905 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:38:11.103495 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.103481 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:38:11.103620 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.103583 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.103682 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.103642 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:38:11.103935 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.103919 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:38:11.104169 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.104157 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:38:11.104392 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.104365 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8gxmq\"" May 21 14:38:11.104476 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.104463 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:38:11.104524 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.104469 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:38:11.105818 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.105798 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:11.105933 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.105833 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h6vpm\"" May 21 14:38:11.106516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.106121 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:38:11.106516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.106384 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.108429 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.108413 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:38:11.108509 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.108494 2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" May 21 14:38:11.108723 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.108710 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:38:11.108891 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.108880 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:38:11.108926 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.108883 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8br47\"" May 21 14:38:11.109367 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.109349 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal"] May 21 14:38:11.109442 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.109379 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:38:11.109488 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.109446 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.110360 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.110345 2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:38:11.111744 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.111722 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:38:11.111884 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.111870 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:38:11.111921 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.111893 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lb25t\"" May 21 14:38:11.117643 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.117618 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:38:11.117796 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.117781 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal"] May 21 14:38:11.131735 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.131713 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m44h5" May 21 14:38:11.137430 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.137411 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m44h5" May 21 14:38:11.196169 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.196147 2554 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:38:11.200878 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz6m\" (UniqueName: \"kubernetes.io/projected/2825c367-c25d-4c56-a945-542017b4d809-kube-api-access-ldz6m\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.200954 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200889 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-system-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.200954 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200909 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-netns\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.200954 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200932 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.201052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5899e613-8f04-48c7-82c6-aa5a3dd6318c-host-slash\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.201052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-tuned\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200985 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-system-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.200995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-netns\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-script-lib\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201051 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-kubelet\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-config\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201113 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-kubelet\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-etc-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201213 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-log-socket\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-env-overrides\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201249 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201268 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-agent-certs\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysconfig\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201316 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201319 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hwdh\" (UniqueName: \"kubernetes.io/projected/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-kube-api-access-2hwdh\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201360 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-cnibin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201377 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-os-release\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201391 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-multus-daemon-config\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-kubernetes\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201427 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201447 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-conf\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201476 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-os-release\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-netns\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201496 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-cnibin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201524 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201533 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-sys-fs\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201541 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-registration-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-systemd\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-host\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-systemd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201604 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-k8s-cni-cncf-io\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-tmp\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.201694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201664 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-k8s-cni-cncf-io\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-ovn\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201741 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-cni-binary-copy\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201764 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-bin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-run\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-netd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201858 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-bin\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201884 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-socket-dir-parent\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201891 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-multus-daemon-config\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201904 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-multus-certs\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201938 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxssf\" (UniqueName: \"kubernetes.io/projected/66211a43-a9aa-443c-9941-65435b44df5b-kube-api-access-lxssf\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-socket-dir-parent\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201976 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-run-multus-certs\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.201978 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202026 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-konnectivity-ca\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.202757 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.202083 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-lib-modules\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.202154 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:11.702132474 +0000 UTC m=+2.016051976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202257 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-device-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202284 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-multus\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202287 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202309 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-hostroot\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202337 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202372 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-host-var-lib-cni-multus\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202393 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-hostroot\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202415 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-device-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-system-cni-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5899e613-8f04-48c7-82c6-aa5a3dd6318c-iptables-alerter-script\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxbbh\" (UniqueName: \"kubernetes.io/projected/5899e613-8f04-48c7-82c6-aa5a3dd6318c-kube-api-access-lxbbh\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202515 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-modprobe-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202279 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66211a43-a9aa-443c-9941-65435b44df5b-cni-binary-copy\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203416 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202542 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202591 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202646 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k92l\" (UniqueName: \"kubernetes.io/projected/ad907261-5481-4aac-8771-b71e51180755-kube-api-access-9k92l\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-var-lib-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202691 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-konnectivity-ca\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-bin\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqht9\" (UniqueName: \"kubernetes.io/projected/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-kube-api-access-fqht9\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-cni-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2825c367-c25d-4c56-a945-542017b4d809-host\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2825c367-c25d-4c56-a945-542017b4d809-serviceca\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202819 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202835 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-conf-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-os-release\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-kubelet\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-slash\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.203977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202892 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-multus-conf-dir\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202911 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65b15b1f-0915-43fc-8d45-b356ed26504d-socket-dir\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202911 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovn-node-metrics-cert\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-cnibin\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.202974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-sys\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-var-lib-kubelet\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-systemd-units\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203072 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzdn\" (UniqueName: \"kubernetes.io/projected/65b15b1f-0915-43fc-8d45-b356ed26504d-kube-api-access-kzzdn\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203094 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-etc-kubernetes\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203112 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krs55\" (UniqueName: \"kubernetes.io/projected/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-kube-api-access-krs55\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203168 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66211a43-a9aa-443c-9941-65435b44df5b-etc-kubernetes\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.204465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.203186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-node-log\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.206460 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.206444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36a8325d-5375-4c71-ae53-1d25d0a3c1d0-agent-certs\") pod \"konnectivity-agent-2xnpq\" (UID: \"36a8325d-5375-4c71-ae53-1d25d0a3c1d0\") " pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.208411 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.208395 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:11.208411 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.208412 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:11.208526 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.208424 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:11.208526 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.208491 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:11.708475339 +0000 UTC m=+2.022394835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:11.210318 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.210263 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxssf\" (UniqueName: \"kubernetes.io/projected/66211a43-a9aa-443c-9941-65435b44df5b-kube-api-access-lxssf\") pod \"multus-vd7d6\" (UID: \"66211a43-a9aa-443c-9941-65435b44df5b\") " pod="openshift-multus/multus-vd7d6" May 21 14:38:11.210874 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.210846 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzdn\" (UniqueName: \"kubernetes.io/projected/65b15b1f-0915-43fc-8d45-b356ed26504d-kube-api-access-kzzdn\") pod \"aws-ebs-csi-driver-node-hhv56\" (UID: \"65b15b1f-0915-43fc-8d45-b356ed26504d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.210967 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.210860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krs55\" (UniqueName: \"kubernetes.io/projected/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-kube-api-access-krs55\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.250314 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.250270 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70363879c7e7a02228ec6966e9295d64.slice/crio-acf08d452edde046a23f08d44f9e4202272a0c5e98a45a5d30e4d49f1082130c WatchSource:0}: Error finding container acf08d452edde046a23f08d44f9e4202272a0c5e98a45a5d30e4d49f1082130c: Status 404 returned error can't find the container with id acf08d452edde046a23f08d44f9e4202272a0c5e98a45a5d30e4d49f1082130c May 21 14:38:11.250637 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.250618 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d113bb90b30a0ad30c8cd3725255e56.slice/crio-6c82b825e9917b809ebd18e66f0871632f14e82d5899debdfce04fc8258280b7 WatchSource:0}: Error finding container 6c82b825e9917b809ebd18e66f0871632f14e82d5899debdfce04fc8258280b7: Status 404 returned error can't find the container with id 6c82b825e9917b809ebd18e66f0871632f14e82d5899debdfce04fc8258280b7 May 21 14:38:11.256032 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.256015 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:38:11.259009 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.258736 2554 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:11.303892 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303870 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-env-overrides\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.303967 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303899 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysconfig\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.303967 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303916 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hwdh\" (UniqueName: \"kubernetes.io/projected/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-kube-api-access-2hwdh\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.303967 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303940 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-kubernetes\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303994 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysconfig\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.303995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-kubernetes\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304016 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-conf\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304040 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-netns\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304087 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304110 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-conf\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304112 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-systemd\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304152 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-host\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304150 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-netns\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304176 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-systemd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304203 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-tmp\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304208 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-host\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-systemd\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304228 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304253 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-ovn\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304277 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304304 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-run\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304329 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304332 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304349 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304329 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-ovn\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304375 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-run\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304390 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-env-overrides\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304377 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-run-ovn-kubernetes\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304412 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-netd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.304490 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304462 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-lib-modules\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304487 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-netd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304504 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-system-cni-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304531 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5899e613-8f04-48c7-82c6-aa5a3dd6318c-iptables-alerter-script\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304551 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxbbh\" (UniqueName: \"kubernetes.io/projected/5899e613-8f04-48c7-82c6-aa5a3dd6318c-kube-api-access-lxbbh\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304561 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-system-cni-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304567 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-modprobe-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304599 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-lib-modules\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304606 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-run-systemd\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304603 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304643 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-modprobe-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304688 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k92l\" (UniqueName: \"kubernetes.io/projected/ad907261-5481-4aac-8771-b71e51180755-kube-api-access-9k92l\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304721 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-var-lib-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304743 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-bin\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304767 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqht9\" (UniqueName: \"kubernetes.io/projected/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-kube-api-access-fqht9\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304792 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2825c367-c25d-4c56-a945-542017b4d809-host\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.305370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304815 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2825c367-c25d-4c56-a945-542017b4d809-serviceca\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304817 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-var-lib-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304827 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-cni-bin\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304842 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-os-release\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-os-release\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304940 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-kubelet\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2825c367-c25d-4c56-a945-542017b4d809-host\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304965 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-slash\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-kubelet\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.304991 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovn-node-metrics-cert\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305016 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-cnibin\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305031 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-host-slash\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305040 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-sys\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305085 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-var-lib-kubelet\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305096 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-cnibin\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305109 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-systemd-units\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305138 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306179 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305145 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-sys\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305141 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5899e613-8f04-48c7-82c6-aa5a3dd6318c-iptables-alerter-script\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305159 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2825c367-c25d-4c56-a945-542017b4d809-serviceca\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305163 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-node-log\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305190 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz6m\" (UniqueName: \"kubernetes.io/projected/2825c367-c25d-4c56-a945-542017b4d809-kube-api-access-ldz6m\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305200 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-systemd-units\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305200 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-var-lib-kubelet\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305220 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305242 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-node-log\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305257 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5899e613-8f04-48c7-82c6-aa5a3dd6318c-host-slash\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305260 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad907261-5481-4aac-8771-b71e51180755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305287 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5899e613-8f04-48c7-82c6-aa5a3dd6318c-host-slash\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305308 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-tuned\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305325 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-script-lib\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305340 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-config\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305365 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305397 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-etc-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.306809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305422 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-log-socket\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305475 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-log-socket\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-sysctl-d\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305609 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-etc-openvswitch\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305660 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad907261-5481-4aac-8771-b71e51180755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305903 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-script-lib\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.305912 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovnkube-config\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.306745 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-tmp\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.307020 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-ovn-node-metrics-cert\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.307275 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.307227 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-etc-tuned\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.312888 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.312863 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxbbh\" (UniqueName: \"kubernetes.io/projected/5899e613-8f04-48c7-82c6-aa5a3dd6318c-kube-api-access-lxbbh\") pod \"iptables-alerter-24mg7\" (UID: \"5899e613-8f04-48c7-82c6-aa5a3dd6318c\") " pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.313254 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.313235 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqht9\" (UniqueName: \"kubernetes.io/projected/e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae-kube-api-access-fqht9\") pod \"tuned-xpc84\" (UID: \"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae\") " pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.313382 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.313367 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k92l\" (UniqueName: \"kubernetes.io/projected/ad907261-5481-4aac-8771-b71e51180755-kube-api-access-9k92l\") pod \"multus-additional-cni-plugins-c4vtg\" (UID: \"ad907261-5481-4aac-8771-b71e51180755\") " pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.313864 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.313845 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hwdh\" (UniqueName: \"kubernetes.io/projected/fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf-kube-api-access-2hwdh\") pod \"ovnkube-node-phmc2\" (UID: \"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf\") " pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.314236 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.314220 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz6m\" (UniqueName: \"kubernetes.io/projected/2825c367-c25d-4c56-a945-542017b4d809-kube-api-access-ldz6m\") pod \"node-ca-2sk9b\" (UID: \"2825c367-c25d-4c56-a945-542017b4d809\") " pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.427374 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.427300 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:11.433458 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.433438 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a8325d_5375_4c71_ae53_1d25d0a3c1d0.slice/crio-98ce72a82d20618aede230892b1e22f95147bdf02bb9f35f99301a5b6b704a3b WatchSource:0}: Error finding container 98ce72a82d20618aede230892b1e22f95147bdf02bb9f35f99301a5b6b704a3b: Status 404 returned error can't find the container with id 98ce72a82d20618aede230892b1e22f95147bdf02bb9f35f99301a5b6b704a3b May 21 14:38:11.436165 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.436146 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" May 21 14:38:11.441483 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.441462 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b15b1f_0915_43fc_8d45_b356ed26504d.slice/crio-cc3ccefad8fb583c40957cd18018a4cb2d2ecfbb656ec56cc54e02d8dd59a7de WatchSource:0}: Error finding container cc3ccefad8fb583c40957cd18018a4cb2d2ecfbb656ec56cc54e02d8dd59a7de: Status 404 returned error can't find the container with id cc3ccefad8fb583c40957cd18018a4cb2d2ecfbb656ec56cc54e02d8dd59a7de May 21 14:38:11.463478 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.463454 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vd7d6" May 21 14:38:11.469000 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.468977 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-24mg7" May 21 14:38:11.469765 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.469739 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66211a43_a9aa_443c_9941_65435b44df5b.slice/crio-85aa89179f4355b5052765829626c28d1603b822d3b7aac8f9abdddf2108132f WatchSource:0}: Error finding container 85aa89179f4355b5052765829626c28d1603b822d3b7aac8f9abdddf2108132f: Status 404 returned error can't find the container with id 85aa89179f4355b5052765829626c28d1603b822d3b7aac8f9abdddf2108132f May 21 14:38:11.474511 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.474494 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:11.475114 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.475087 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5899e613_8f04_48c7_82c6_aa5a3dd6318c.slice/crio-148183b8585f5078b9921e4f2f0643ea6f6126861b74881f09c7cec9aa07c6e9 WatchSource:0}: Error finding container 148183b8585f5078b9921e4f2f0643ea6f6126861b74881f09c7cec9aa07c6e9: Status 404 returned error can't find the container with id 148183b8585f5078b9921e4f2f0643ea6f6126861b74881f09c7cec9aa07c6e9 May 21 14:38:11.480717 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.480693 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec2ff92_8eae_4bb2_a76d_2e31dbde0ccf.slice/crio-a957251fce9295cf96e418acff2c289ace902bf79937acdd9005e2040ad60f68 WatchSource:0}: Error finding container a957251fce9295cf96e418acff2c289ace902bf79937acdd9005e2040ad60f68: Status 404 returned error can't find the container with id a957251fce9295cf96e418acff2c289ace902bf79937acdd9005e2040ad60f68 May 21 14:38:11.491549 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.491530 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xpc84" May 21 14:38:11.497270 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.497251 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ee5cd9_c0ba_4a22_85ff_1b24f5506dae.slice/crio-795a8ee8fa871ee7508e4e8376eb96bf8f59c1a7706441dfd68d9bc7374bed6b WatchSource:0}: Error finding container 795a8ee8fa871ee7508e4e8376eb96bf8f59c1a7706441dfd68d9bc7374bed6b: Status 404 returned error can't find the container with id 795a8ee8fa871ee7508e4e8376eb96bf8f59c1a7706441dfd68d9bc7374bed6b May 21 14:38:11.505169 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.505150 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sk9b" May 21 14:38:11.512774 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.512752 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2825c367_c25d_4c56_a945_542017b4d809.slice/crio-eb70dc3d45383ccd9811d4061d2d4b07c2c086f7bed7ee9b93f996cd74324dba WatchSource:0}: Error finding container eb70dc3d45383ccd9811d4061d2d4b07c2c086f7bed7ee9b93f996cd74324dba: Status 404 returned error can't find the container with id eb70dc3d45383ccd9811d4061d2d4b07c2c086f7bed7ee9b93f996cd74324dba May 21 14:38:11.517684 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.517667 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" May 21 14:38:11.523229 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:11.523207 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad907261_5481_4aac_8771_b71e51180755.slice/crio-a6384288e1a713983122bdef313f32115c203228d8391f12defb563ce7e2b1ff WatchSource:0}: Error finding container a6384288e1a713983122bdef313f32115c203228d8391f12defb563ce7e2b1ff: Status 404 returned error can't find the container with id a6384288e1a713983122bdef313f32115c203228d8391f12defb563ce7e2b1ff May 21 14:38:11.709109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.709020 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:11.709109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:11.709078 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709182 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709192 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709210 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709223 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709261 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:12.709241021 +0000 UTC m=+3.023160503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:11.709302 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:11.709286 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:12.709271653 +0000 UTC m=+3.023191136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:12.138263 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.138220 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:33:11 +0000 UTC" deadline="2028-03-07 11:32:01.54240791 +0000 UTC" May 21 14:38:12.138263 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.138262 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15740h53m49.40415026s" May 21 14:38:12.223219 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.222431 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:12.223219 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.222550 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:12.223219 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.222671 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:12.223219 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.222764 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:12.237010 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.236827 2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:12.238767 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.238718 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sk9b" event={"ID":"2825c367-c25d-4c56-a945-542017b4d809","Type":"ContainerStarted","Data":"eb70dc3d45383ccd9811d4061d2d4b07c2c086f7bed7ee9b93f996cd74324dba"} May 21 14:38:12.256224 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.256193 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"a957251fce9295cf96e418acff2c289ace902bf79937acdd9005e2040ad60f68"} May 21 14:38:12.268121 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.268096 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" event={"ID":"65b15b1f-0915-43fc-8d45-b356ed26504d","Type":"ContainerStarted","Data":"cc3ccefad8fb583c40957cd18018a4cb2d2ecfbb656ec56cc54e02d8dd59a7de"} May 21 14:38:12.282336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.282309 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" event={"ID":"70363879c7e7a02228ec6966e9295d64","Type":"ContainerStarted","Data":"acf08d452edde046a23f08d44f9e4202272a0c5e98a45a5d30e4d49f1082130c"} May 21 14:38:12.289235 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.289202 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerStarted","Data":"a6384288e1a713983122bdef313f32115c203228d8391f12defb563ce7e2b1ff"} May 21 14:38:12.304560 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.304536 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xpc84" event={"ID":"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae","Type":"ContainerStarted","Data":"795a8ee8fa871ee7508e4e8376eb96bf8f59c1a7706441dfd68d9bc7374bed6b"} May 21 14:38:12.311360 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.311337 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-24mg7" event={"ID":"5899e613-8f04-48c7-82c6-aa5a3dd6318c","Type":"ContainerStarted","Data":"148183b8585f5078b9921e4f2f0643ea6f6126861b74881f09c7cec9aa07c6e9"} May 21 14:38:12.314343 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.314320 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vd7d6" event={"ID":"66211a43-a9aa-443c-9941-65435b44df5b","Type":"ContainerStarted","Data":"85aa89179f4355b5052765829626c28d1603b822d3b7aac8f9abdddf2108132f"} May 21 14:38:12.318073 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.318001 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xnpq" event={"ID":"36a8325d-5375-4c71-ae53-1d25d0a3c1d0","Type":"ContainerStarted","Data":"98ce72a82d20618aede230892b1e22f95147bdf02bb9f35f99301a5b6b704a3b"} May 21 14:38:12.328045 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.328007 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" event={"ID":"6d113bb90b30a0ad30c8cd3725255e56","Type":"ContainerStarted","Data":"6c82b825e9917b809ebd18e66f0871632f14e82d5899debdfce04fc8258280b7"} May 21 14:38:12.503690 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.503478 2554 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:12.720780 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.720742 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:12.720946 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:12.720815 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:12.721004 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.720974 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:12.721004 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.720993 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:12.721004 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.721006 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:12.721224 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.721080 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:14.721045168 +0000 UTC m=+5.034964650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:12.721483 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.721463 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:12.721542 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:12.721518 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:14.721504075 +0000 UTC m=+5.035423558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:13.138997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.138949 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:33:11 +0000 UTC" deadline="2027-10-20 19:39:37.168038507 +0000 UTC" May 21 14:38:13.138997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.138987 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12413h1m24.029055793s" May 21 14:38:13.177216 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.177181 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-xmn54"] May 21 14:38:13.183643 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.183619 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.187407 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.187384 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:38:13.187516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.187432 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:38:13.187680 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.187663 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-64jhk\"" May 21 14:38:13.226008 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.225975 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ca6ee39-bd50-4354-994b-698985ae3955-hosts-file\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.226157 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.226021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dfm\" (UniqueName: \"kubernetes.io/projected/6ca6ee39-bd50-4354-994b-698985ae3955-kube-api-access-g4dfm\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.226157 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.226083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ca6ee39-bd50-4354-994b-698985ae3955-tmp-dir\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.328359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.327385 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ca6ee39-bd50-4354-994b-698985ae3955-tmp-dir\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.328359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.327477 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ca6ee39-bd50-4354-994b-698985ae3955-hosts-file\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.328359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.327505 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dfm\" (UniqueName: \"kubernetes.io/projected/6ca6ee39-bd50-4354-994b-698985ae3955-kube-api-access-g4dfm\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.328359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.328147 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ca6ee39-bd50-4354-994b-698985ae3955-tmp-dir\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.328359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.328233 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ca6ee39-bd50-4354-994b-698985ae3955-hosts-file\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.350052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.349976 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dfm\" (UniqueName: \"kubernetes.io/projected/6ca6ee39-bd50-4354-994b-698985ae3955-kube-api-access-g4dfm\") pod \"node-resolver-xmn54\" (UID: \"6ca6ee39-bd50-4354-994b-698985ae3955\") " pod="openshift-dns/node-resolver-xmn54" May 21 14:38:13.497359 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:13.496900 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmn54" May 21 14:38:14.220256 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:14.220219 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:14.220650 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.220349 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:14.220650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:14.220508 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:14.220650 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.220634 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:14.737991 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:14.738098 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738223 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738289 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:18.738266509 +0000 UTC m=+9.052185991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738714 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738732 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738745 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:14.738828 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:14.738792 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:18.738776407 +0000 UTC m=+9.052695890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:16.220160 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:16.220110 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:16.220160 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:16.220146 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:16.220667 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:16.220260 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:16.220667 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:16.220356 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:18.219898 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.219716 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:18.219898 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.219859 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:18.220455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.219938 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:18.220455 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.220055 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:18.346332 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.346295 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6mrpb"] May 21 14:38:18.349716 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.349353 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.349716 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.349426 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:18.471889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.471650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-kubelet-config\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.471889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.471711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.471889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.471748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-dbus\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.572902 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.572865 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-kubelet-config\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.573109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.572921 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.573109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.572949 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-dbus\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.573109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.572991 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-kubelet-config\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.573294 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.573123 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07642766-f7ec-49b4-aba8-ce7026360160-dbus\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:18.573294 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.573129 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:18.573294 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.573212 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:19.073190734 +0000 UTC m=+9.387110227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:18.774758 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.774718 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:18.774956 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:18.774772 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:18.774956 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.774950 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:18.775089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.774972 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:18.775089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.774987 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:18.775089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.774953 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:18.775089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.775048 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:26.775030002 +0000 UTC m=+17.088949489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:18.775089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:18.775082 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:26.775070829 +0000 UTC m=+17.088990322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:19.078189 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:19.078092 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:19.078355 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:19.078229 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:19.078355 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:19.078293 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:20.078274287 +0000 UTC m=+10.392193777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:20.086072 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:20.085972 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:20.086507 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:20.086147 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:20.086507 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:20.086228 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:22.0862052 +0000 UTC m=+12.400124691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:20.220604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:20.220571 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:20.220783 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:20.220689 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:20.221091 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:20.221072 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:20.221208 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:20.221168 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:20.221283 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:20.221227 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:20.221331 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:20.221308 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:22.100146 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:22.099900 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:22.100587 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:22.100104 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:22.100587 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:22.100328 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:26.100286158 +0000 UTC m=+16.414205640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:22.219743 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:22.219711 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:22.219919 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:22.219720 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:22.219919 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:22.219854 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:22.219919 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:22.219846 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:22.220102 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:22.219929 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:22.220102 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:22.220031 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:24.219932 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:24.219899 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:24.220391 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:24.219900 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:24.220391 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:24.220037 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:24.220391 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:24.219913 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:24.220391 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:24.220157 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:24.220391 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:24.220268 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:26.132163 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.132120 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:26.132610 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.132286 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:26.132610 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.132352 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:34.132332295 +0000 UTC m=+24.446251773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:26.219681 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.219640 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:26.219850 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.219650 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:26.219850 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.219769 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:26.219965 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.219862 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:26.219965 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.219660 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:26.220089 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.219982 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:26.838412 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.838374 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:26.838424 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838554 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838555 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838573 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838586 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:26.838634 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838635 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.838614938 +0000 UTC m=+33.152534419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:26.838948 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:26.838655 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.838647212 +0000 UTC m=+33.152566689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:28.220180 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:28.220050 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:28.220180 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:28.220050 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:28.220641 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:28.220196 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:28.220641 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:28.220312 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:28.220641 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:28.220070 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:28.220641 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:28.220403 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:30.220120 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.220048 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:30.220529 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.220191 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:30.220529 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:30.220191 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:30.220529 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.220210 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:30.220529 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:30.220314 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:30.220529 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:30.220396 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:30.373766 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.373590 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xpc84" event={"ID":"e3ee5cd9-c0ba-4a22-85ff-1b24f5506dae","Type":"ContainerStarted","Data":"749af05e97caa525019da627535b950f45da89aa89ab8a323eaa098aa0b7273e"} May 21 14:38:30.379342 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.379291 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vd7d6" event={"ID":"66211a43-a9aa-443c-9941-65435b44df5b","Type":"ContainerStarted","Data":"4b75d91da909ee7612af1ced4c6432fd7826719cd9dfb70554018a071edd9665"} May 21 14:38:30.389128 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.389102 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" event={"ID":"6d113bb90b30a0ad30c8cd3725255e56","Type":"ContainerStarted","Data":"2434e09b1bf7b804bb54791ea292c5d28ed45287c45dbc27f13acde726ce7759"} May 21 14:38:30.391821 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.391034 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xpc84" podStartSLOduration=1.944059744 podStartE2EDuration="20.39101739s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.498743655 +0000 UTC m=+1.812663133" lastFinishedPulling="2026-05-21 14:38:29.945701293 +0000 UTC m=+20.259620779" observedRunningTime="2026-05-21 14:38:30.389589038 +0000 UTC m=+20.703508564" watchObservedRunningTime="2026-05-21 14:38:30.39101739 +0000 UTC m=+20.704936891" May 21 14:38:30.392034 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.391982 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"18e39bc47d38903a5f65ceafc8a4916c27a3b061e33cad1fa26c8c6bb4ee36b4"} May 21 14:38:30.392034 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.392019 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"49e9456aad3762e48c7adb8aa2298e350b6357c19ad96420b4e2da17463bf3ec"} May 21 14:38:30.394541 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.394501 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmn54" event={"ID":"6ca6ee39-bd50-4354-994b-698985ae3955","Type":"ContainerStarted","Data":"ba88efe46da5ade829ac3a0f8111a776503b9884e7cd2dda9939967d2cde9c21"} May 21 14:38:30.402752 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.402620 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-221.ec2.internal" podStartSLOduration=19.402605136 podStartE2EDuration="19.402605136s" podCreationTimestamp="2026-05-21 14:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:30.402047267 +0000 UTC m=+20.715966768" watchObservedRunningTime="2026-05-21 14:38:30.402605136 +0000 UTC m=+20.716524636" May 21 14:38:30.421081 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:30.421021 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vd7d6" podStartSLOduration=1.91503625 podStartE2EDuration="20.421011444s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.471996774 +0000 UTC m=+1.785916251" lastFinishedPulling="2026-05-21 14:38:29.977971969 +0000 UTC m=+20.291891445" observedRunningTime="2026-05-21 14:38:30.420912259 +0000 UTC m=+20.734831758" watchObservedRunningTime="2026-05-21 14:38:30.421011444 +0000 UTC m=+20.734930946" May 21 14:38:31.398222 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.397920 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xnpq" event={"ID":"36a8325d-5375-4c71-ae53-1d25d0a3c1d0","Type":"ContainerStarted","Data":"2637797372e57c5d256cdb920bc05e661705a017c1a6a930067fe6f172514706"} May 21 14:38:31.399550 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.399510 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sk9b" event={"ID":"2825c367-c25d-4c56-a945-542017b4d809","Type":"ContainerStarted","Data":"fec67dd65428a48233e052592de226fc0ed68a4e01ab214cc0ec026902983e40"} May 21 14:38:31.403779 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.403749 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"2121ea7beedb61f421c669fa14b6774cdeab75efb69915f47b3f1da127886d72"} May 21 14:38:31.403883 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.403788 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"7e080bd02fcf80fd725f63d2e3fe78b531ba2acff2d157a0a18f15cbf0d489fb"} May 21 14:38:31.403883 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.403802 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"6e62a5a88653287b579e314eef47b5f53a8b2e71f4edb07b5a156cd47ffa902c"} May 21 14:38:31.403883 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.403815 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"ae8e1c10414917d5c51657cff4a7e989df6d9ac560d5ddbcf7d8a90f7b45cf26"} May 21 14:38:31.405303 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.405279 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" event={"ID":"65b15b1f-0915-43fc-8d45-b356ed26504d","Type":"ContainerStarted","Data":"ec85fc8488bf7930b6627782b7a3424ad4da8ff35718c010dfce69f37aa64776"} May 21 14:38:31.406831 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.406808 2554 generic.go:358] "Generic (PLEG): container finished" podID="70363879c7e7a02228ec6966e9295d64" containerID="60cee0ffbbce3463aa0f72501c6119805524202f08b0cd6b4df70ee6a58d2b0f" exitCode=0 May 21 14:38:31.406936 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.406899 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" event={"ID":"70363879c7e7a02228ec6966e9295d64","Type":"ContainerDied","Data":"60cee0ffbbce3463aa0f72501c6119805524202f08b0cd6b4df70ee6a58d2b0f"} May 21 14:38:31.409450 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.409041 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmn54" event={"ID":"6ca6ee39-bd50-4354-994b-698985ae3955","Type":"ContainerStarted","Data":"7444e88ad304eeada76c07c0e114c0454652368d9bdaba700462e4e2432d3759"} May 21 14:38:31.411196 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.411172 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="b88511dced3bc21b861c90f2ad69d669b7b7b2a3d93dc522082d717c7d65e524" exitCode=0 May 21 14:38:31.411281 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.411260 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"b88511dced3bc21b861c90f2ad69d669b7b7b2a3d93dc522082d717c7d65e524"} May 21 14:38:31.414031 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.413996 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2xnpq" podStartSLOduration=2.904083554 podStartE2EDuration="21.413985405s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.434705786 +0000 UTC m=+1.748625266" lastFinishedPulling="2026-05-21 14:38:29.944607636 +0000 UTC m=+20.258527117" observedRunningTime="2026-05-21 14:38:31.412532789 +0000 UTC m=+21.726452287" watchObservedRunningTime="2026-05-21 14:38:31.413985405 +0000 UTC m=+21.727904923" May 21 14:38:31.426147 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.426108 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2sk9b" podStartSLOduration=11.183342842 podStartE2EDuration="21.426097748s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.514274754 +0000 UTC m=+1.828194232" lastFinishedPulling="2026-05-21 14:38:21.757029657 +0000 UTC m=+12.070949138" observedRunningTime="2026-05-21 14:38:31.425690025 +0000 UTC m=+21.739609524" watchObservedRunningTime="2026-05-21 14:38:31.426097748 +0000 UTC m=+21.740017246" May 21 14:38:31.458630 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.458578 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xmn54" podStartSLOduration=18.458559555 podStartE2EDuration="18.458559555s" podCreationTimestamp="2026-05-21 14:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:31.457851748 +0000 UTC m=+21.771771250" watchObservedRunningTime="2026-05-21 14:38:31.458559555 +0000 UTC m=+21.772479056" May 21 14:38:31.583165 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:31.583121 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:38:32.160455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.160349 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:38:31.583147629Z","UUID":"6ba69ebf-bfb6-4686-bbf2-d0eb7d6c21cb","Handler":null,"Name":"","Endpoint":""} May 21 14:38:32.162159 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.162133 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:38:32.162268 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.162173 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:38:32.177796 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.177767 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:32.178448 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.178414 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:32.219820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.219766 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:32.219820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.219808 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:32.220093 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.219766 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:32.220093 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:32.219904 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:32.220093 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:32.219985 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:32.220414 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:32.220113 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:32.416469 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.416406 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" event={"ID":"65b15b1f-0915-43fc-8d45-b356ed26504d","Type":"ContainerStarted","Data":"311ce447cd0d62cd4c0a114a8d47530720b2a8340f5da0de482be1fad11ee804"} May 21 14:38:32.416469 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.416448 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" event={"ID":"65b15b1f-0915-43fc-8d45-b356ed26504d","Type":"ContainerStarted","Data":"6f2d1e308131a73af05fc702fa3d6407e95893a088bc730f32c4e296a05830a4"} May 21 14:38:32.418611 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.418586 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" event={"ID":"70363879c7e7a02228ec6966e9295d64","Type":"ContainerStarted","Data":"528a203d5a36f28ae89ec7e56d28cd398898046951220054f19fc8c12e3095b6"} May 21 14:38:32.420463 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.420435 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-24mg7" event={"ID":"5899e613-8f04-48c7-82c6-aa5a3dd6318c","Type":"ContainerStarted","Data":"1c3f1443fad4ac0975953497b7cad7d22a4c0a92abb519ebffe9664d6e10a9c8"} May 21 14:38:32.420896 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.420857 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:32.421427 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.421408 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2xnpq" May 21 14:38:32.450838 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.450787 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhv56" podStartSLOduration=1.568882804 podStartE2EDuration="22.450770338s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.442948519 +0000 UTC m=+1.756867996" lastFinishedPulling="2026-05-21 14:38:32.324836042 +0000 UTC m=+22.638755530" observedRunningTime="2026-05-21 14:38:32.432933198 +0000 UTC m=+22.746852697" watchObservedRunningTime="2026-05-21 14:38:32.450770338 +0000 UTC m=+22.764689838" May 21 14:38:32.464685 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:32.464629 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-24mg7" podStartSLOduration=4.015012803 podStartE2EDuration="22.464614297s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.477226347 +0000 UTC m=+1.791145823" lastFinishedPulling="2026-05-21 14:38:29.926827825 +0000 UTC m=+20.240747317" observedRunningTime="2026-05-21 14:38:32.464241643 +0000 UTC m=+22.778161143" watchObservedRunningTime="2026-05-21 14:38:32.464614297 +0000 UTC m=+22.778533796" May 21 14:38:33.426614 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:33.426530 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"b4692abde14069abea520aa7201e659789d4ce6cd56546a877a4ad16dcca8cd5"} May 21 14:38:34.196428 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:34.196391 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:34.196759 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:34.196494 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:34.196759 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:34.196557 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret podName:07642766-f7ec-49b4-aba8-ce7026360160 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.196538399 +0000 UTC m=+40.510457885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret") pod "global-pull-secret-syncer-6mrpb" (UID: "07642766-f7ec-49b4-aba8-ce7026360160") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:34.219841 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:34.219804 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:34.219980 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:34.219804 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:34.219980 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:34.219934 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:34.220122 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:34.220025 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:34.220122 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:34.219804 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:34.220227 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:34.220177 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:36.220088 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.220042 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:36.220640 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.220042 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:36.220640 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:36.220173 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:36.220640 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:36.220216 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:36.220640 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.220247 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:36.220640 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:36.220303 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:36.437510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.437444 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" event={"ID":"fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf","Type":"ContainerStarted","Data":"7281a8d99f4a5531790ac2d1b018046952be64fb6ddfe9d7fde391569096d478"} May 21 14:38:36.437744 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.437715 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:36.439136 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.439109 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="2b381cd5f4c6b23706c05930618ab21e3acc5ab8db087280fb94afdb8a81eb1c" exitCode=0 May 21 14:38:36.439231 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.439150 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"2b381cd5f4c6b23706c05930618ab21e3acc5ab8db087280fb94afdb8a81eb1c"} May 21 14:38:36.452816 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.452799 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:36.466226 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.466188 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" podStartSLOduration=7.743536121 podStartE2EDuration="26.466175454s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.482333717 +0000 UTC m=+1.796253195" lastFinishedPulling="2026-05-21 14:38:30.204973046 +0000 UTC m=+20.518892528" observedRunningTime="2026-05-21 14:38:36.464764598 +0000 UTC m=+26.778684097" watchObservedRunningTime="2026-05-21 14:38:36.466175454 +0000 UTC m=+26.780094950" May 21 14:38:36.466649 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:36.466627 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-221.ec2.internal" podStartSLOduration=25.4666193 podStartE2EDuration="25.4666193s" podCreationTimestamp="2026-05-21 14:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:32.47940473 +0000 UTC m=+22.793324229" watchObservedRunningTime="2026-05-21 14:38:36.4666193 +0000 UTC m=+26.780538798" May 21 14:38:37.445571 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:37.445303 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="5b2e65a0a985b63c8e6a213778af9d2eefbeff2466c8f5aa26375565eaeaf834" exitCode=0 May 21 14:38:37.445946 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:37.445382 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"5b2e65a0a985b63c8e6a213778af9d2eefbeff2466c8f5aa26375565eaeaf834"} May 21 14:38:37.446207 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:37.446097 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:37.446207 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:37.446128 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:37.460507 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:37.460486 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:38:38.141100 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.141050 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzhlj"] May 21 14:38:38.141210 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.141196 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:38.141311 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:38.141287 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:38.143753 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.143722 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgg4p"] May 21 14:38:38.143862 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.143849 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:38.143969 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:38.143947 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:38.144603 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.144580 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mrpb"] May 21 14:38:38.144709 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.144694 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:38.144809 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:38.144790 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:38.449564 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.449535 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="7df51cb5e30da85d9b135cb628088c074764ba23249180402d60fd41bbe76fba" exitCode=0 May 21 14:38:38.449947 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:38.449638 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"7df51cb5e30da85d9b135cb628088c074764ba23249180402d60fd41bbe76fba"} May 21 14:38:39.219528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:39.219435 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:39.219673 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:39.219561 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:40.220633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:40.220552 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:40.221169 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:40.220670 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:40.221169 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:40.220759 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:40.221169 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:40.220861 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:41.219528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:41.219500 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:41.219691 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:41.219616 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrpb" podUID="07642766-f7ec-49b4-aba8-ce7026360160" May 21 14:38:42.219597 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:42.219566 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:42.219597 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:42.219603 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:42.220135 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.219698 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhlj" podUID="92b621ea-ae8d-4628-8041-b59606de1a67" May 21 14:38:42.220135 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.219829 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgg4p" podUID="ab699f52-13c4-4d60-a2f5-9792ff1af4b5" May 21 14:38:42.870910 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:42.870816 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:42.870910 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:42.870863 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.870994 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.871010 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.871025 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.871037 2554 projected.go:194] Error preparing data for projected volume kube-api-access-5bx78 for pod openshift-network-diagnostics/network-check-target-rzhlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.871076 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs podName:ab699f52-13c4-4d60-a2f5-9792ff1af4b5 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:14.87104358 +0000 UTC m=+65.184963061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs") pod "network-metrics-daemon-wgg4p" (UID: "ab699f52-13c4-4d60-a2f5-9792ff1af4b5") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:42.871101 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:42.871095 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78 podName:92b621ea-ae8d-4628-8041-b59606de1a67 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:14.871087217 +0000 UTC m=+65.185006694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bx78" (UniqueName: "kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78") pod "network-check-target-rzhlj" (UID: "92b621ea-ae8d-4628-8041-b59606de1a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:43.014859 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.014657 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-221.ec2.internal" event="NodeReady" May 21 14:38:43.015028 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.014993 2554 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:38:43.055754 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.055722 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svf7t"] May 21 14:38:43.082081 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.082039 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fnbpk"] May 21 14:38:43.082230 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.082211 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.084869 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.084849 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:38:43.085000 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.084850 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:38:43.085000 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.084961 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-86l7j\"" May 21 14:38:43.100210 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.100190 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svf7t"] May 21 14:38:43.100210 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.100213 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnbpk"] May 21 14:38:43.100353 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.100300 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.102996 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.102943 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:38:43.102996 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.102944 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsm8g\"" May 21 14:38:43.102996 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.102973 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:38:43.103201 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.102976 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:38:43.174134 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.174046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.174134 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.174123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-config-volume\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.174319 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.174156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfv8\" (UniqueName: \"kubernetes.io/projected/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-kube-api-access-4pfv8\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.174319 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.174213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-tmp-dir\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.220203 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.220170 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:43.222868 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.222849 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:38:43.275621 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275579 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.275800 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.275800 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmnfq\" (UniqueName: \"kubernetes.io/projected/9ab7dfb8-8948-4306-af9c-278f4a56a485-kube-api-access-zmnfq\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.275800 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275709 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-config-volume\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.275800 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.275755 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:43.275800 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275778 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfv8\" (UniqueName: \"kubernetes.io/projected/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-kube-api-access-4pfv8\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.276040 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.275824 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:43.775801856 +0000 UTC m=+34.089721333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:43.276040 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.275955 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-tmp-dir\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.276288 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.276256 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-tmp-dir\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.276398 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.276350 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-config-volume\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.288700 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.288678 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfv8\" (UniqueName: \"kubernetes.io/projected/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-kube-api-access-4pfv8\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.376730 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.376687 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.376921 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.376739 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmnfq\" (UniqueName: \"kubernetes.io/projected/9ab7dfb8-8948-4306-af9c-278f4a56a485-kube-api-access-zmnfq\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.376921 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.376851 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:43.377031 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.376926 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:43.876909721 +0000 UTC m=+34.190829201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:38:43.385985 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.385952 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmnfq\" (UniqueName: \"kubernetes.io/projected/9ab7dfb8-8948-4306-af9c-278f4a56a485-kube-api-access-zmnfq\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.780336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.780301 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:43.780602 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.780450 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:43.780602 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.780511 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:44.780495866 +0000 UTC m=+35.094415344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:43.881108 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:43.881054 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:43.881263 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.881190 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:43.881263 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:43.881253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:44.881237669 +0000 UTC m=+35.195157146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:38:44.220043 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.219964 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:38:44.220269 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.219964 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:38:44.222842 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.222816 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:38:44.222985 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.222868 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:38:44.224162 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.224128 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ns24t\"" May 21 14:38:44.224162 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.224128 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:38:44.224339 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.224131 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pnzxq\"" May 21 14:38:44.788492 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.788460 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:44.788644 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:44.788579 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:44.788644 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:44.788630 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:46.788616442 +0000 UTC m=+37.102535918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:44.889554 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:44.889520 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:44.889702 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:44.889624 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:44.889702 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:44.889674 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:46.889659371 +0000 UTC m=+37.203578848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:38:45.464941 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:45.464908 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerStarted","Data":"b967c803512be438881863fa07b3b8059b4f0f535a2c89bc2724a49d45ef5404"} May 21 14:38:46.469349 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:46.469312 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="b967c803512be438881863fa07b3b8059b4f0f535a2c89bc2724a49d45ef5404" exitCode=0 May 21 14:38:46.469767 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:46.469371 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"b967c803512be438881863fa07b3b8059b4f0f535a2c89bc2724a49d45ef5404"} May 21 14:38:46.801670 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:46.801580 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:46.801806 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:46.801709 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:46.801806 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:46.801766 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.801749783 +0000 UTC m=+41.115669263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:46.902428 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:46.902393 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:46.902608 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:46.902535 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:46.902674 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:46.902612 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.902593266 +0000 UTC m=+41.216512761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:38:47.473398 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:47.473364 2554 generic.go:358] "Generic (PLEG): container finished" podID="ad907261-5481-4aac-8771-b71e51180755" containerID="46d897e328aa13fb2b4b95f6a1069dcdb4ce666b59b45d190be1b3d528eb20cc" exitCode=0 May 21 14:38:47.473808 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:47.473409 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerDied","Data":"46d897e328aa13fb2b4b95f6a1069dcdb4ce666b59b45d190be1b3d528eb20cc"} May 21 14:38:48.478376 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.478341 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" event={"ID":"ad907261-5481-4aac-8771-b71e51180755","Type":"ContainerStarted","Data":"faaea4c5a47e214708d5ffab9b0e27461f2fdb1b30d344014ab472d5aa18617c"} May 21 14:38:48.508471 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.508425 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c4vtg" podStartSLOduration=4.811581095 podStartE2EDuration="38.50841135s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:11.524694883 +0000 UTC m=+1.838614361" lastFinishedPulling="2026-05-21 14:38:45.221525138 +0000 UTC m=+35.535444616" observedRunningTime="2026-05-21 14:38:48.507269328 +0000 UTC m=+38.821188827" watchObservedRunningTime="2026-05-21 14:38:48.50841135 +0000 UTC m=+38.822330848" May 21 14:38:48.535375 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.535335 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr"] May 21 14:38:48.568143 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.568109 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr"] May 21 14:38:48.568276 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.568178 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" May 21 14:38:48.570913 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.570885 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 14:38:48.571023 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.570954 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 14:38:48.571023 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.570966 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ms5lm\"" May 21 14:38:48.715650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.715613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbrg\" (UniqueName: \"kubernetes.io/projected/1e9a09ce-6ef7-47d5-98af-48e9392e0611-kube-api-access-gnbrg\") pod \"migrator-b985f5d89-4jbsr\" (UID: \"1e9a09ce-6ef7-47d5-98af-48e9392e0611\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" May 21 14:38:48.815923 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.815894 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbrg\" (UniqueName: \"kubernetes.io/projected/1e9a09ce-6ef7-47d5-98af-48e9392e0611-kube-api-access-gnbrg\") pod \"migrator-b985f5d89-4jbsr\" (UID: \"1e9a09ce-6ef7-47d5-98af-48e9392e0611\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" May 21 14:38:48.824054 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.824032 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbrg\" (UniqueName: \"kubernetes.io/projected/1e9a09ce-6ef7-47d5-98af-48e9392e0611-kube-api-access-gnbrg\") pod \"migrator-b985f5d89-4jbsr\" (UID: \"1e9a09ce-6ef7-47d5-98af-48e9392e0611\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" May 21 14:38:48.876974 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:48.876948 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" May 21 14:38:49.060291 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:49.060265 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr"] May 21 14:38:49.063899 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:49.063871 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9a09ce_6ef7_47d5_98af_48e9392e0611.slice/crio-8a9bbd01748b5e428b34c951cdc63547fdfe90d6b3951c44741327b9fa167f90 WatchSource:0}: Error finding container 8a9bbd01748b5e428b34c951cdc63547fdfe90d6b3951c44741327b9fa167f90: Status 404 returned error can't find the container with id 8a9bbd01748b5e428b34c951cdc63547fdfe90d6b3951c44741327b9fa167f90 May 21 14:38:49.480973 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:49.480883 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" event={"ID":"1e9a09ce-6ef7-47d5-98af-48e9392e0611","Type":"ContainerStarted","Data":"8a9bbd01748b5e428b34c951cdc63547fdfe90d6b3951c44741327b9fa167f90"} May 21 14:38:49.988429 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:49.988394 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4zdmm"] May 21 14:38:50.012082 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.012033 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4zdmm"] May 21 14:38:50.012229 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.012171 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.015166 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.015139 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 14:38:50.015166 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.015164 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 14:38:50.015356 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.015327 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vnhjf\"" May 21 14:38:50.016220 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.016197 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 14:38:50.022271 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.022253 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 14:38:50.126414 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.126372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-key\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.126584 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.126436 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-cabundle\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.126584 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.126523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssv2\" (UniqueName: \"kubernetes.io/projected/8211e59a-f529-4d02-9bda-ec82d1d31fbb-kube-api-access-pssv2\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.226969 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.226936 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:50.227145 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.227004 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-key\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.227145 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.227042 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-cabundle\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.227145 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.227120 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pssv2\" (UniqueName: \"kubernetes.io/projected/8211e59a-f529-4d02-9bda-ec82d1d31fbb-kube-api-access-pssv2\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.228083 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.228009 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-cabundle\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.229664 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.229639 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07642766-f7ec-49b4-aba8-ce7026360160-original-pull-secret\") pod \"global-pull-secret-syncer-6mrpb\" (UID: \"07642766-f7ec-49b4-aba8-ce7026360160\") " pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:50.229780 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.229695 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8211e59a-f529-4d02-9bda-ec82d1d31fbb-signing-key\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.234570 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.234548 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssv2\" (UniqueName: \"kubernetes.io/projected/8211e59a-f529-4d02-9bda-ec82d1d31fbb-kube-api-access-pssv2\") pod \"service-ca-67d667c7d-4zdmm\" (UID: \"8211e59a-f529-4d02-9bda-ec82d1d31fbb\") " pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.321266 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.321223 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" May 21 14:38:50.429597 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.429571 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrpb" May 21 14:38:50.442049 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.442019 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4zdmm"] May 21 14:38:50.605279 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:50.605203 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8211e59a_f529_4d02_9bda_ec82d1d31fbb.slice/crio-2a56fc85f81823068c3d7085fcbf9a280f066630415e5f9c1294ae5e3033da66 WatchSource:0}: Error finding container 2a56fc85f81823068c3d7085fcbf9a280f066630415e5f9c1294ae5e3033da66: Status 404 returned error can't find the container with id 2a56fc85f81823068c3d7085fcbf9a280f066630415e5f9c1294ae5e3033da66 May 21 14:38:50.765560 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.765531 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mrpb"] May 21 14:38:50.769899 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:38:50.769870 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07642766_f7ec_49b4_aba8_ce7026360160.slice/crio-37097b6e5e6109d157281ec7febc5cc3972d196e353eee38cc5bd4117b2a0a1e WatchSource:0}: Error finding container 37097b6e5e6109d157281ec7febc5cc3972d196e353eee38cc5bd4117b2a0a1e: Status 404 returned error can't find the container with id 37097b6e5e6109d157281ec7febc5cc3972d196e353eee38cc5bd4117b2a0a1e May 21 14:38:50.832692 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.832665 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:50.832787 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:50.832758 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:50.832830 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:50.832815 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:58.832786898 +0000 UTC m=+49.146706378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:50.933665 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:50.933643 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:50.933810 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:50.933792 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:50.933855 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:50.933845 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:58.933831126 +0000 UTC m=+49.247750603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:38:51.487008 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:51.486931 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" event={"ID":"1e9a09ce-6ef7-47d5-98af-48e9392e0611","Type":"ContainerStarted","Data":"4eb900acf929a15c9adcf56e0765e743fef11fb47d44522b0db15f414c9fa4f1"} May 21 14:38:51.487008 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:51.486977 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" event={"ID":"1e9a09ce-6ef7-47d5-98af-48e9392e0611","Type":"ContainerStarted","Data":"90fca84c95a8eb018de49764105b7ed0cd621e4022f4b1504401d4de9553391d"} May 21 14:38:51.488322 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:51.488292 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" event={"ID":"8211e59a-f529-4d02-9bda-ec82d1d31fbb","Type":"ContainerStarted","Data":"2a56fc85f81823068c3d7085fcbf9a280f066630415e5f9c1294ae5e3033da66"} May 21 14:38:51.489506 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:51.489478 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mrpb" event={"ID":"07642766-f7ec-49b4-aba8-ce7026360160","Type":"ContainerStarted","Data":"37097b6e5e6109d157281ec7febc5cc3972d196e353eee38cc5bd4117b2a0a1e"} May 21 14:38:51.504935 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:51.504892 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4jbsr" podStartSLOduration=1.9386931710000002 podStartE2EDuration="3.504877747s" podCreationTimestamp="2026-05-21 14:38:48 +0000 UTC" firstStartedPulling="2026-05-21 14:38:49.065735337 +0000 UTC m=+39.379654817" lastFinishedPulling="2026-05-21 14:38:50.63191991 +0000 UTC m=+40.945839393" observedRunningTime="2026-05-21 14:38:51.504565374 +0000 UTC m=+41.818484866" watchObservedRunningTime="2026-05-21 14:38:51.504877747 +0000 UTC m=+41.818797246" May 21 14:38:55.499680 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:55.499593 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" event={"ID":"8211e59a-f529-4d02-9bda-ec82d1d31fbb","Type":"ContainerStarted","Data":"5d20f5ceb490be73f21c0da4bd202b3c0696a80d61180dd8c66acd57b60eacb9"} May 21 14:38:55.500900 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:55.500874 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mrpb" event={"ID":"07642766-f7ec-49b4-aba8-ce7026360160","Type":"ContainerStarted","Data":"2e6b175aef2995a656c52463e5247de763a6d8d3500890445fd757354a18d45b"} May 21 14:38:55.514880 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:55.514840 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-4zdmm" podStartSLOduration=3.890105924 podStartE2EDuration="6.514827554s" podCreationTimestamp="2026-05-21 14:38:49 +0000 UTC" firstStartedPulling="2026-05-21 14:38:50.627201412 +0000 UTC m=+40.941120895" lastFinishedPulling="2026-05-21 14:38:53.251923048 +0000 UTC m=+43.565842525" observedRunningTime="2026-05-21 14:38:55.51447528 +0000 UTC m=+45.828394781" watchObservedRunningTime="2026-05-21 14:38:55.514827554 +0000 UTC m=+45.828747052" May 21 14:38:55.529151 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:55.529112 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6mrpb" podStartSLOduration=33.279432484 podStartE2EDuration="37.529099896s" podCreationTimestamp="2026-05-21 14:38:18 +0000 UTC" firstStartedPulling="2026-05-21 14:38:50.771742388 +0000 UTC m=+41.085661868" lastFinishedPulling="2026-05-21 14:38:55.0214098 +0000 UTC m=+45.335329280" observedRunningTime="2026-05-21 14:38:55.528838334 +0000 UTC m=+45.842757834" watchObservedRunningTime="2026-05-21 14:38:55.529099896 +0000 UTC m=+45.843019395" May 21 14:38:58.889525 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:58.889478 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:38:58.889918 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:58.889621 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:58.889918 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:58.889686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls podName:ee4a3837-4571-49cb-b76f-e5e36cb7a9fd nodeName:}" failed. No retries permitted until 2026-05-21 14:39:14.889671086 +0000 UTC m=+65.203590564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls") pod "dns-default-svf7t" (UID: "ee4a3837-4571-49cb-b76f-e5e36cb7a9fd") : secret "dns-default-metrics-tls" not found May 21 14:38:58.990357 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:38:58.990315 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:38:58.990531 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:58.990448 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:58.990531 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:38:58.990505 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert podName:9ab7dfb8-8948-4306-af9c-278f4a56a485 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:14.990488215 +0000 UTC m=+65.304407699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert") pod "ingress-canary-fnbpk" (UID: "9ab7dfb8-8948-4306-af9c-278f4a56a485") : secret "canary-serving-cert" not found May 21 14:39:09.461801 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:09.461768 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phmc2" May 21 14:39:13.126238 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.126203 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2kbbg"] May 21 14:39:13.128905 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.128878 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58cf44b975-6kd2g"] May 21 14:39:13.129022 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.128954 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.131012 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.130993 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.131985 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.131966 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p46jx\"" May 21 14:39:13.133273 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.133258 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:39:13.134477 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.134456 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:39:13.134820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.134802 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 14:39:13.136157 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.136135 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6kdzp\"" May 21 14:39:13.136263 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.136169 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:39:13.136394 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.136373 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:39:13.136454 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.136440 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:39:13.141151 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.141131 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 14:39:13.142776 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.142755 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 14:39:13.145121 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.145104 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:39:13.149488 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.149463 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58cf44b975-6kd2g"] May 21 14:39:13.150445 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.150425 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2kbbg"] May 21 14:39:13.175670 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.175639 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58cf44b975-6kd2g"] May 21 14:39:13.175819 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:13.175799 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-6wj69 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" podUID="2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" May 21 14:39:13.192661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-snapshots\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.192803 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.192803 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.192803 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192772 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.192908 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192808 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.192908 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192833 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-tmp\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.192978 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj69\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.193012 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.192999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.193044 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.193093 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.193127 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2c756-3554-4f0a-b520-71499dbf92bb-serving-cert\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.193159 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.193191 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bzc\" (UniqueName: \"kubernetes.io/projected/92a2c756-3554-4f0a-b520-71499dbf92bb-kube-api-access-j4bzc\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.193225 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.193205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293581 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293545 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-snapshots\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.293581 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293586 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293610 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293648 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293666 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293680 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-tmp\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293706 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj69\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.293827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.293730 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.294315 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294187 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.294315 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294235 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.294315 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294260 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2c756-3554-4f0a-b520-71499dbf92bb-serving-cert\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.294315 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294306 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.294580 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294332 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bzc\" (UniqueName: \"kubernetes.io/projected/92a2c756-3554-4f0a-b520-71499dbf92bb-kube-api-access-j4bzc\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.294580 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294377 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.294580 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294504 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-snapshots\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.294847 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294822 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.294937 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a2c756-3554-4f0a-b520-71499dbf92bb-tmp\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.295001 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.294966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.295078 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.295027 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.295205 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.295178 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.295697 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.295669 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2c756-3554-4f0a-b520-71499dbf92bb-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.296439 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.296411 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.296535 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.296488 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.296663 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.296640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.297172 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.297153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2c756-3554-4f0a-b520-71499dbf92bb-serving-cert\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.303444 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.303411 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj69\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.304708 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.304686 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token\") pod \"image-registry-58cf44b975-6kd2g\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.304863 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.304846 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bzc\" (UniqueName: \"kubernetes.io/projected/92a2c756-3554-4f0a-b520-71499dbf92bb-kube-api-access-j4bzc\") pod \"insights-operator-78bdfb888c-2kbbg\" (UID: \"92a2c756-3554-4f0a-b520-71499dbf92bb\") " pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.439365 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.439282 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" May 21 14:39:13.534983 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.534957 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.539475 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.539452 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:13.555767 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.555745 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2kbbg"] May 21 14:39:13.558183 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:13.558158 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a2c756_3554_4f0a_b520_71499dbf92bb.slice/crio-59a5473f9f7c22fb1d05c190276bcb785c6af84cc05c35a446e4f1f22f482924 WatchSource:0}: Error finding container 59a5473f9f7c22fb1d05c190276bcb785c6af84cc05c35a446e4f1f22f482924: Status 404 returned error can't find the container with id 59a5473f9f7c22fb1d05c190276bcb785c6af84cc05c35a446e4f1f22f482924 May 21 14:39:13.597322 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597299 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597432 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597337 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597432 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597369 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597557 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597536 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597612 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597578 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597612 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597602 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597709 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597628 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597709 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597678 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wj69\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69\") pod \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\" (UID: \"2df2c2d3-94e7-4ec2-8b0d-cd61b250149a\") " May 21 14:39:13.597813 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597699 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:39:13.597878 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597853 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:39:13.597951 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.597929 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-ca-trust-extracted\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.598046 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.598022 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:39:13.599650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.599622 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:39:13.599726 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.599663 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:39:13.599726 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.599681 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:39:13.599917 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.599899 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:39:13.600012 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.599996 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69" (OuterVolumeSpecName: "kube-api-access-6wj69") pod "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" (UID: "2df2c2d3-94e7-4ec2-8b0d-cd61b250149a"). InnerVolumeSpecName "kube-api-access-6wj69". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:39:13.699115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699041 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-bound-sa-token\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699082 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-certificates\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699098 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-installation-pull-secrets\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699113 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-registry-tls\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699327 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699122 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-trusted-ca\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699327 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699131 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-image-registry-private-configuration\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:13.699327 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:13.699142 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wj69\" (UniqueName: \"kubernetes.io/projected/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a-kube-api-access-6wj69\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:39:14.141714 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.141677 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:39:14.146136 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.146116 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.149963 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.149941 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rfg6c\"" May 21 14:39:14.149963 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.149958 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 14:39:14.150152 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.149941 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 14:39:14.150218 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.150201 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 14:39:14.151309 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.151252 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 14:39:14.151441 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.151426 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 14:39:14.151506 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.151475 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 14:39:14.151593 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.151557 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 14:39:14.154814 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.154796 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:39:14.203451 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.203589 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.203589 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.203589 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.203741 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv9fq\" (UniqueName: \"kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.203741 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.203688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.304733 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304698 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv9fq\" (UniqueName: \"kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.304872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304770 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.304872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304815 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.304872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304847 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.305018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304877 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.305018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.304921 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.305574 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.305524 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.305867 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.305838 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.305980 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.305842 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.307618 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.307596 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.307802 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.307783 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.316508 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.316486 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv9fq\" (UniqueName: \"kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq\") pod \"console-78bbb7c465-k86w8\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.455598 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.455509 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:14.538285 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.538237 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" event={"ID":"92a2c756-3554-4f0a-b520-71499dbf92bb","Type":"ContainerStarted","Data":"59a5473f9f7c22fb1d05c190276bcb785c6af84cc05c35a446e4f1f22f482924"} May 21 14:39:14.538285 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.538282 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58cf44b975-6kd2g" May 21 14:39:14.589514 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.589481 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58cf44b975-6kd2g"] May 21 14:39:14.592579 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.592550 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58cf44b975-6kd2g"] May 21 14:39:14.595012 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.594989 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:39:14.598636 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:14.598595 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02431969_0875_451a_b30f_5f2bf493fb1e.slice/crio-6429aa76600bb854b11c61781b0517a598c470d88f10ecc282fb4f1618334403 WatchSource:0}: Error finding container 6429aa76600bb854b11c61781b0517a598c470d88f10ecc282fb4f1618334403: Status 404 returned error can't find the container with id 6429aa76600bb854b11c61781b0517a598c470d88f10ecc282fb4f1618334403 May 21 14:39:14.911350 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.911309 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:39:14.911536 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.911356 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:39:14.911536 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.911495 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:39:14.913630 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.913610 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4a3837-4571-49cb-b76f-e5e36cb7a9fd-metrics-tls\") pod \"dns-default-svf7t\" (UID: \"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd\") " pod="openshift-dns/dns-default-svf7t" May 21 14:39:14.915361 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.915338 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:39:14.915501 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.915485 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:39:14.923717 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.923700 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab699f52-13c4-4d60-a2f5-9792ff1af4b5-metrics-certs\") pod \"network-metrics-daemon-wgg4p\" (UID: \"ab699f52-13c4-4d60-a2f5-9792ff1af4b5\") " pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:39:14.925336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.925318 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:39:14.935350 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:14.935330 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bx78\" (UniqueName: \"kubernetes.io/projected/92b621ea-ae8d-4628-8041-b59606de1a67-kube-api-access-5bx78\") pod \"network-check-target-rzhlj\" (UID: \"92b621ea-ae8d-4628-8041-b59606de1a67\") " pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:39:15.012011 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.011978 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:39:15.014128 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.014112 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab7dfb8-8948-4306-af9c-278f4a56a485-cert\") pod \"ingress-canary-fnbpk\" (UID: \"9ab7dfb8-8948-4306-af9c-278f4a56a485\") " pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:39:15.134956 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.134931 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pnzxq\"" May 21 14:39:15.141930 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.141909 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ns24t\"" May 21 14:39:15.142953 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.142934 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:39:15.150336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.150303 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgg4p" May 21 14:39:15.196189 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.195943 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-86l7j\"" May 21 14:39:15.204596 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.204222 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svf7t" May 21 14:39:15.212761 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.212708 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsm8g\"" May 21 14:39:15.221078 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.221037 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnbpk" May 21 14:39:15.274546 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.274487 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzhlj"] May 21 14:39:15.281425 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:15.280591 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b621ea_ae8d_4628_8041_b59606de1a67.slice/crio-26c51b375ed7f279b54c7f08f807c6ab3ed1b29805234fb1dc6c961313baf726 WatchSource:0}: Error finding container 26c51b375ed7f279b54c7f08f807c6ab3ed1b29805234fb1dc6c961313baf726: Status 404 returned error can't find the container with id 26c51b375ed7f279b54c7f08f807c6ab3ed1b29805234fb1dc6c961313baf726 May 21 14:39:15.301044 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.301014 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgg4p"] May 21 14:39:15.356035 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.356002 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svf7t"] May 21 14:39:15.358947 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:15.358917 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4a3837_4571_49cb_b76f_e5e36cb7a9fd.slice/crio-98e217f799f67f1832cc78a9bbf158922fbc4d7c542da3fc1f0511ff3753a9c1 WatchSource:0}: Error finding container 98e217f799f67f1832cc78a9bbf158922fbc4d7c542da3fc1f0511ff3753a9c1: Status 404 returned error can't find the container with id 98e217f799f67f1832cc78a9bbf158922fbc4d7c542da3fc1f0511ff3753a9c1 May 21 14:39:15.370881 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.370838 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnbpk"] May 21 14:39:15.374907 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:15.374867 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab7dfb8_8948_4306_af9c_278f4a56a485.slice/crio-96acfd93a66d5a000d36edd24981e2789ea620c7ea642f91f9493e6887fc1f0a WatchSource:0}: Error finding container 96acfd93a66d5a000d36edd24981e2789ea620c7ea642f91f9493e6887fc1f0a: Status 404 returned error can't find the container with id 96acfd93a66d5a000d36edd24981e2789ea620c7ea642f91f9493e6887fc1f0a May 21 14:39:15.541502 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.541457 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgg4p" event={"ID":"ab699f52-13c4-4d60-a2f5-9792ff1af4b5","Type":"ContainerStarted","Data":"095415d3b338218a122145ca1f3c55fe107ab39a50957bfa76e3b5ae59720b5c"} May 21 14:39:15.542666 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.542494 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnbpk" event={"ID":"9ab7dfb8-8948-4306-af9c-278f4a56a485","Type":"ContainerStarted","Data":"96acfd93a66d5a000d36edd24981e2789ea620c7ea642f91f9493e6887fc1f0a"} May 21 14:39:15.543576 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.543545 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svf7t" event={"ID":"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd","Type":"ContainerStarted","Data":"98e217f799f67f1832cc78a9bbf158922fbc4d7c542da3fc1f0511ff3753a9c1"} May 21 14:39:15.544782 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.544757 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzhlj" event={"ID":"92b621ea-ae8d-4628-8041-b59606de1a67","Type":"ContainerStarted","Data":"26c51b375ed7f279b54c7f08f807c6ab3ed1b29805234fb1dc6c961313baf726"} May 21 14:39:15.545842 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:15.545821 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78bbb7c465-k86w8" event={"ID":"02431969-0875-451a-b30f-5f2bf493fb1e","Type":"ContainerStarted","Data":"6429aa76600bb854b11c61781b0517a598c470d88f10ecc282fb4f1618334403"} May 21 14:39:16.224802 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:16.224666 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df2c2d3-94e7-4ec2-8b0d-cd61b250149a" path="/var/lib/kubelet/pods/2df2c2d3-94e7-4ec2-8b0d-cd61b250149a/volumes" May 21 14:39:17.156676 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.156640 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t"] May 21 14:39:17.167504 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.167477 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t"] May 21 14:39:17.167653 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.167593 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:17.170184 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.170123 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 14:39:17.170184 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.170143 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xpmqs\"" May 21 14:39:17.230140 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.230098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t\" (UID: \"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:17.330927 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.330888 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t\" (UID: \"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:17.331095 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:17.331029 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 14:39:17.331137 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:17.331113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates podName:a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd nodeName:}" failed. No retries permitted until 2026-05-21 14:39:17.831095899 +0000 UTC m=+68.145015377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" (UID: "a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd") : secret "prometheus-operator-admission-webhook-tls" not found May 21 14:39:17.834883 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.834825 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t\" (UID: \"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:17.837803 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:17.837774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t\" (UID: \"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:18.079604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:18.079568 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:20.474771 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.474727 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t"] May 21 14:39:20.565085 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.564968 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgg4p" event={"ID":"ab699f52-13c4-4d60-a2f5-9792ff1af4b5","Type":"ContainerStarted","Data":"e0d69c6e1a12e198050bf1de9d8a43bde6a45d2ac5ec1d2cda63912128bc1114"} May 21 14:39:20.566177 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.566148 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" event={"ID":"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd","Type":"ContainerStarted","Data":"f2468242dd357234af6192c8f6bf4d60dd8ecd72e59fb4ed39d91411f04db234"} May 21 14:39:20.567649 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.567624 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnbpk" event={"ID":"9ab7dfb8-8948-4306-af9c-278f4a56a485","Type":"ContainerStarted","Data":"ccfabafa8d2b131930073b806ab229cdfeb4084ba6c77b63c27b8f2c83dc8ded"} May 21 14:39:20.575295 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.575239 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svf7t" event={"ID":"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd","Type":"ContainerStarted","Data":"9e1bb1121e217a5ec33945e6f0ad79079db7037d7eee61734ecd3579eebaf3c5"} May 21 14:39:20.581116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.580674 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzhlj" event={"ID":"92b621ea-ae8d-4628-8041-b59606de1a67","Type":"ContainerStarted","Data":"4acbc81d787ad515425304c468ef7fc24b57bf6c5fc64a7029cd76e39e77ec13"} May 21 14:39:20.581116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.580800 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:39:20.585722 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.582842 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78bbb7c465-k86w8" event={"ID":"02431969-0875-451a-b30f-5f2bf493fb1e","Type":"ContainerStarted","Data":"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202"} May 21 14:39:20.585722 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.584787 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fnbpk" podStartSLOduration=32.621781601 podStartE2EDuration="37.58477443s" podCreationTimestamp="2026-05-21 14:38:43 +0000 UTC" firstStartedPulling="2026-05-21 14:39:15.377238438 +0000 UTC m=+65.691157915" lastFinishedPulling="2026-05-21 14:39:20.340231254 +0000 UTC m=+70.654150744" observedRunningTime="2026-05-21 14:39:20.583668445 +0000 UTC m=+70.897587943" watchObservedRunningTime="2026-05-21 14:39:20.58477443 +0000 UTC m=+70.898693930" May 21 14:39:20.590180 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.589628 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" event={"ID":"92a2c756-3554-4f0a-b520-71499dbf92bb","Type":"ContainerStarted","Data":"3b5d691e4d8d367dc84586a3d58b89a7b64ae480bb4d02cb30bf2c21a68e4286"} May 21 14:39:20.623200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.623141 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-78bbb7c465-k86w8" podStartSLOduration=0.904402604 podStartE2EDuration="6.623121425s" podCreationTimestamp="2026-05-21 14:39:14 +0000 UTC" firstStartedPulling="2026-05-21 14:39:14.60069976 +0000 UTC m=+64.914619236" lastFinishedPulling="2026-05-21 14:39:20.319418568 +0000 UTC m=+70.633338057" observedRunningTime="2026-05-21 14:39:20.605414349 +0000 UTC m=+70.919333862" watchObservedRunningTime="2026-05-21 14:39:20.623121425 +0000 UTC m=+70.937040927" May 21 14:39:20.641672 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.640564 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rzhlj" podStartSLOduration=65.590191159 podStartE2EDuration="1m10.640544728s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:39:15.283222923 +0000 UTC m=+65.597142419" lastFinishedPulling="2026-05-21 14:39:20.333576509 +0000 UTC m=+70.647495988" observedRunningTime="2026-05-21 14:39:20.622078753 +0000 UTC m=+70.935998245" watchObservedRunningTime="2026-05-21 14:39:20.640544728 +0000 UTC m=+70.954464225" May 21 14:39:20.641672 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:20.641315 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-2kbbg" podStartSLOduration=1.382254303 podStartE2EDuration="7.641303309s" podCreationTimestamp="2026-05-21 14:39:13 +0000 UTC" firstStartedPulling="2026-05-21 14:39:13.559832556 +0000 UTC m=+63.873752033" lastFinishedPulling="2026-05-21 14:39:19.818881559 +0000 UTC m=+70.132801039" observedRunningTime="2026-05-21 14:39:20.639692842 +0000 UTC m=+70.953612342" watchObservedRunningTime="2026-05-21 14:39:20.641303309 +0000 UTC m=+70.955222809" May 21 14:39:21.593745 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:21.593711 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgg4p" event={"ID":"ab699f52-13c4-4d60-a2f5-9792ff1af4b5","Type":"ContainerStarted","Data":"efaf2958b5e48fb00d9a50275ce145830160177c24a3d8a4fb2a0f9c5eb5a0af"} May 21 14:39:21.595317 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:21.595271 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svf7t" event={"ID":"ee4a3837-4571-49cb-b76f-e5e36cb7a9fd","Type":"ContainerStarted","Data":"cc612254d70d0ed2f89bacda95c607d1e5c17da9e21b0350ea01ae8b1df77987"} May 21 14:39:21.609565 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:21.609519 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wgg4p" podStartSLOduration=66.592899812 podStartE2EDuration="1m11.609501324s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:39:15.312148297 +0000 UTC m=+65.626067776" lastFinishedPulling="2026-05-21 14:39:20.328749796 +0000 UTC m=+70.642669288" observedRunningTime="2026-05-21 14:39:21.608195265 +0000 UTC m=+71.922114764" watchObservedRunningTime="2026-05-21 14:39:21.609501324 +0000 UTC m=+71.923420822" May 21 14:39:21.624584 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:21.624534 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-svf7t" podStartSLOduration=33.649737393 podStartE2EDuration="38.62451732s" podCreationTimestamp="2026-05-21 14:38:43 +0000 UTC" firstStartedPulling="2026-05-21 14:39:15.363798825 +0000 UTC m=+65.677718303" lastFinishedPulling="2026-05-21 14:39:20.338578753 +0000 UTC m=+70.652498230" observedRunningTime="2026-05-21 14:39:21.623791046 +0000 UTC m=+71.937710544" watchObservedRunningTime="2026-05-21 14:39:21.62451732 +0000 UTC m=+71.938436819" May 21 14:39:22.599569 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.599525 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" event={"ID":"a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd","Type":"ContainerStarted","Data":"a151b99f9f77172eb622c6d96f785c600b41c8c06191d83ab47b4ffbb7c22575"} May 21 14:39:22.600027 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.600007 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svf7t" May 21 14:39:22.600147 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.600039 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:22.604107 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.604086 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" May 21 14:39:22.616303 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.616259 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t" podStartSLOduration=4.560984401 podStartE2EDuration="5.616244166s" podCreationTimestamp="2026-05-21 14:39:17 +0000 UTC" firstStartedPulling="2026-05-21 14:39:20.498741305 +0000 UTC m=+70.812660787" lastFinishedPulling="2026-05-21 14:39:21.554001072 +0000 UTC m=+71.867920552" observedRunningTime="2026-05-21 14:39:22.614386975 +0000 UTC m=+72.928306473" watchObservedRunningTime="2026-05-21 14:39:22.616244166 +0000 UTC m=+72.930163664" May 21 14:39:22.862639 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:22.862559 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svf7t_ee4a3837-4571-49cb-b76f-e5e36cb7a9fd/dns/0.log" May 21 14:39:23.045625 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.045599 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svf7t_ee4a3837-4571-49cb-b76f-e5e36cb7a9fd/kube-rbac-proxy/0.log" May 21 14:39:23.225124 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.225028 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vlgds"] May 21 14:39:23.227528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.227511 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.230186 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.230165 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:39:23.231411 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.231382 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f94x5\"" May 21 14:39:23.231541 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.231453 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 14:39:23.231541 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.231481 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:39:23.231541 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.231504 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 14:39:23.231541 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.231524 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:39:23.236171 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.236142 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vlgds"] May 21 14:39:23.280204 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.280165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.280204 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.280210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.280465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.280240 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q22t\" (UniqueName: \"kubernetes.io/projected/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-kube-api-access-4q22t\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.280465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.280365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.381452 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.381418 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.381452 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.381455 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.381694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.381475 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4q22t\" (UniqueName: \"kubernetes.io/projected/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-kube-api-access-4q22t\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.381694 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.381609 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.381798 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:23.381752 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 14:39:23.381898 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:23.381881 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls podName:57cb9cb6-f827-4434-be2d-8b1e0d8afc84 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:23.881859162 +0000 UTC m=+74.195778651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-vlgds" (UID: "57cb9cb6-f827-4434-be2d-8b1e0d8afc84") : secret "prometheus-operator-tls" not found May 21 14:39:23.386840 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.386713 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.387617 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.387597 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.391661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.391637 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q22t\" (UniqueName: \"kubernetes.io/projected/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-kube-api-access-4q22t\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.445121 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.445096 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmn54_6ca6ee39-bd50-4354-994b-698985ae3955/dns-node-resolver/0.log" May 21 14:39:23.885492 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.885451 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:23.887824 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:23.887789 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57cb9cb6-f827-4434-be2d-8b1e0d8afc84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vlgds\" (UID: \"57cb9cb6-f827-4434-be2d-8b1e0d8afc84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:24.137629 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.137543 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" May 21 14:39:24.247861 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.247828 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sk9b_2825c367-c25d-4c56-a945-542017b4d809/node-ca/0.log" May 21 14:39:24.281867 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.281838 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vlgds"] May 21 14:39:24.284602 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:24.284576 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cb9cb6_f827_4434_be2d_8b1e0d8afc84.slice/crio-e680ded4ceba527ceef89af24d14a9d2c2a9d2f48594def4181c367152d10a5c WatchSource:0}: Error finding container e680ded4ceba527ceef89af24d14a9d2c2a9d2f48594def4181c367152d10a5c: Status 404 returned error can't find the container with id e680ded4ceba527ceef89af24d14a9d2c2a9d2f48594def4181c367152d10a5c May 21 14:39:24.456555 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.456481 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:24.456555 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.456520 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:24.457647 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.457609 2554 patch_prober.go:28] interesting pod/console-78bbb7c465-k86w8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body= May 21 14:39:24.457695 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.457670 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78bbb7c465-k86w8" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" May 21 14:39:24.605864 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:24.605837 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" event={"ID":"57cb9cb6-f827-4434-be2d-8b1e0d8afc84","Type":"ContainerStarted","Data":"e680ded4ceba527ceef89af24d14a9d2c2a9d2f48594def4181c367152d10a5c"} May 21 14:39:25.245292 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:25.245256 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fnbpk_9ab7dfb8-8948-4306-af9c-278f4a56a485/serve-healthcheck-canary/0.log" May 21 14:39:26.613242 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:26.613208 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" event={"ID":"57cb9cb6-f827-4434-be2d-8b1e0d8afc84","Type":"ContainerStarted","Data":"614a0b7940c4fe9078e28fc0b3832f4fc385bf56b3357cf28fcaa196d951c3ab"} May 21 14:39:26.613242 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:26.613243 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" event={"ID":"57cb9cb6-f827-4434-be2d-8b1e0d8afc84","Type":"ContainerStarted","Data":"0fad20ba67c2b200773089ff4025ebeecc0b68c67fca9e36fee9b3932d52186f"} May 21 14:39:26.629215 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:26.629172 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vlgds" podStartSLOduration=2.253039287 podStartE2EDuration="3.629158851s" podCreationTimestamp="2026-05-21 14:39:23 +0000 UTC" firstStartedPulling="2026-05-21 14:39:24.286432971 +0000 UTC m=+74.600352448" lastFinishedPulling="2026-05-21 14:39:25.662552535 +0000 UTC m=+75.976472012" observedRunningTime="2026-05-21 14:39:26.628135963 +0000 UTC m=+76.942055462" watchObservedRunningTime="2026-05-21 14:39:26.629158851 +0000 UTC m=+76.943078350" May 21 14:39:28.612029 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.611988 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r2wh6"] May 21 14:39:28.615700 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.615676 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.618237 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.618212 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:39:28.618539 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.618524 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:39:28.618625 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.618547 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-88tch\"" May 21 14:39:28.618793 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.618781 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:39:28.718506 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-root\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718506 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-tls\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718543 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-textfile\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718569 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-wtmp\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-sys\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718633 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q6jd\" (UniqueName: \"kubernetes.io/projected/5355e5c7-7ca6-476f-8978-12545dd69753-kube-api-access-7q6jd\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.718762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.718705 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-metrics-client-ca\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819169 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819128 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-root\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819338 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819195 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-tls\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819338 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819225 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-textfile\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819338 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819255 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-wtmp\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819338 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819253 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-root\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819338 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819284 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-sys\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819341 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-sys\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819378 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819408 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-wtmp\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819416 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q6jd\" (UniqueName: \"kubernetes.io/projected/5355e5c7-7ca6-476f-8978-12545dd69753-kube-api-access-7q6jd\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819491 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819578 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819566 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-metrics-client-ca\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.819915 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.819673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-textfile\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.820109 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.820081 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-metrics-client-ca\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.820195 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.820167 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.822073 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.822038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-tls\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.822214 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.822192 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5355e5c7-7ca6-476f-8978-12545dd69753-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.827507 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.827486 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q6jd\" (UniqueName: \"kubernetes.io/projected/5355e5c7-7ca6-476f-8978-12545dd69753-kube-api-access-7q6jd\") pod \"node-exporter-r2wh6\" (UID: \"5355e5c7-7ca6-476f-8978-12545dd69753\") " pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.927956 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:28.927876 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2wh6" May 21 14:39:28.936120 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:28.936083 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355e5c7_7ca6_476f_8978_12545dd69753.slice/crio-ad6cc76a9922362d36417655f05377fd513d66dda8a58ad6f94a8ca5b09ce49b WatchSource:0}: Error finding container ad6cc76a9922362d36417655f05377fd513d66dda8a58ad6f94a8ca5b09ce49b: Status 404 returned error can't find the container with id ad6cc76a9922362d36417655f05377fd513d66dda8a58ad6f94a8ca5b09ce49b May 21 14:39:29.621698 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.621659 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2wh6" event={"ID":"5355e5c7-7ca6-476f-8978-12545dd69753","Type":"ContainerStarted","Data":"ad6cc76a9922362d36417655f05377fd513d66dda8a58ad6f94a8ca5b09ce49b"} May 21 14:39:29.655347 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.655315 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:39:29.668682 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.668651 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.671883 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.671851 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 14:39:29.672181 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672136 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 14:39:29.672495 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672434 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 14:39:29.672683 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672660 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 14:39:29.672799 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672773 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:39:29.672914 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672887 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 14:39:29.672914 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.672898 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 14:39:29.673244 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.673024 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cntth\"" May 21 14:39:29.673244 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.673026 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 14:39:29.673244 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.673139 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 14:39:29.673244 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.673186 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-out\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729275 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4szv\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-kube-api-access-p4szv\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729435 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-web-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729459 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729499 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.729775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.729615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830337 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830308 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-out\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830344 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830382 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830398 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4szv\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-kube-api-access-p4szv\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830421 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830450 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830510 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830504 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-web-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830540 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830590 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830615 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830639 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830664 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.830756 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.830685 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.832050 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.832019 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.833792 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.833663 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.833792 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.833663 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.833792 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:29.833774 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle podName:7bd74e9c-2f15-4543-ab12-d206ab2133cf nodeName:}" failed. No retries permitted until 2026-05-21 14:39:30.333755008 +0000 UTC m=+80.647674488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7bd74e9c-2f15-4543-ab12-d206ab2133cf") : configmap references non-existent config key: ca-bundle.crt May 21 14:39:29.834026 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.833865 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.834026 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.834021 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.834406 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.834357 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.834647 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.834624 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7bd74e9c-2f15-4543-ab12-d206ab2133cf-config-out\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.835209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.835188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-web-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.835371 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.835351 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.835670 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.835652 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.836604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.836581 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7bd74e9c-2f15-4543-ab12-d206ab2133cf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:29.838257 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:29.838237 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4szv\" (UniqueName: \"kubernetes.io/projected/7bd74e9c-2f15-4543-ab12-d206ab2133cf-kube-api-access-p4szv\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:30.334661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.334622 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:30.335487 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.335459 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd74e9c-2f15-4543-ab12-d206ab2133cf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7bd74e9c-2f15-4543-ab12-d206ab2133cf\") " pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:30.583888 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.583849 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 14:39:30.626481 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.626441 2554 generic.go:358] "Generic (PLEG): container finished" podID="5355e5c7-7ca6-476f-8978-12545dd69753" containerID="e6df5f888d8765508d8a7111d7c111919c51291b1a45c9f2d49d9985ca1fa67b" exitCode=0 May 21 14:39:30.626917 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.626524 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2wh6" event={"ID":"5355e5c7-7ca6-476f-8978-12545dd69753","Type":"ContainerDied","Data":"e6df5f888d8765508d8a7111d7c111919c51291b1a45c9f2d49d9985ca1fa67b"} May 21 14:39:30.717489 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:30.717465 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 14:39:30.722048 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:30.722025 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd74e9c_2f15_4543_ab12_d206ab2133cf.slice/crio-254965ba6bdaf25d5658e7bd27b5f31b565a78a87bbf1600b1c9222855b6f7ac WatchSource:0}: Error finding container 254965ba6bdaf25d5658e7bd27b5f31b565a78a87bbf1600b1c9222855b6f7ac: Status 404 returned error can't find the container with id 254965ba6bdaf25d5658e7bd27b5f31b565a78a87bbf1600b1c9222855b6f7ac May 21 14:39:31.547604 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.547567 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-566689c768-94fbp"] May 21 14:39:31.551889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.551858 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.554847 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.554663 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 14:39:31.554971 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.554910 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 14:39:31.555052 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.554979 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6c9p2\"" May 21 14:39:31.555140 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.555122 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 14:39:31.555239 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.555222 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 14:39:31.555323 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.555306 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 14:39:31.555442 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.555426 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fl6aharit7mb8\"" May 21 14:39:31.564665 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.564134 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566689c768-94fbp"] May 21 14:39:31.633245 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.633196 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2wh6" event={"ID":"5355e5c7-7ca6-476f-8978-12545dd69753","Type":"ContainerStarted","Data":"20d23a1e7ba0ddebe4e4f8182e90bb1aa8f8f0a5c145ac315b5102bfbdadec8d"} May 21 14:39:31.633672 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.633248 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2wh6" event={"ID":"5355e5c7-7ca6-476f-8978-12545dd69753","Type":"ContainerStarted","Data":"b0e7208b63da712fb527943451e14b55cfdb86d2b44b1a654977c80989bcc1a5"} May 21 14:39:31.634342 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.634319 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"254965ba6bdaf25d5658e7bd27b5f31b565a78a87bbf1600b1c9222855b6f7ac"} May 21 14:39:31.646687 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-grpc-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.646852 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.646852 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646719 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.646852 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.646852 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.647056 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.647056 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837cc958-1791-4dd0-a061-85fd8491d415-metrics-client-ca\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.647056 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.646971 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/837cc958-1791-4dd0-a061-85fd8491d415-kube-api-access-lc4fb\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.652493 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.652425 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r2wh6" podStartSLOduration=2.3823831970000002 podStartE2EDuration="3.652409624s" podCreationTimestamp="2026-05-21 14:39:28 +0000 UTC" firstStartedPulling="2026-05-21 14:39:28.937893304 +0000 UTC m=+79.251812780" lastFinishedPulling="2026-05-21 14:39:30.207919727 +0000 UTC m=+80.521839207" observedRunningTime="2026-05-21 14:39:31.651730122 +0000 UTC m=+81.965649622" watchObservedRunningTime="2026-05-21 14:39:31.652409624 +0000 UTC m=+81.966329129" May 21 14:39:31.747934 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.747884 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.747965 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837cc958-1791-4dd0-a061-85fd8491d415-metrics-client-ca\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748016 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/837cc958-1791-4dd0-a061-85fd8491d415-kube-api-access-lc4fb\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748046 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-grpc-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748091 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748129 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748420 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748210 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.748420 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.748255 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.750150 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.750122 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837cc958-1791-4dd0-a061-85fd8491d415-metrics-client-ca\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.752334 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.752302 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.753042 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.753000 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.753177 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.753055 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.753422 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.753383 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-grpc-tls\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.753987 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.753956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.755214 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.755170 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/837cc958-1791-4dd0-a061-85fd8491d415-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.756692 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.756653 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/837cc958-1791-4dd0-a061-85fd8491d415-kube-api-access-lc4fb\") pod \"thanos-querier-566689c768-94fbp\" (UID: \"837cc958-1791-4dd0-a061-85fd8491d415\") " pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:31.865726 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:31.865639 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:32.031365 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.031172 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566689c768-94fbp"] May 21 14:39:32.034278 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:32.034250 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837cc958_1791_4dd0_a061_85fd8491d415.slice/crio-dc423414e2e4e5684ad69f68a9d475547aa57411badcd648243a5240e737c34d WatchSource:0}: Error finding container dc423414e2e4e5684ad69f68a9d475547aa57411badcd648243a5240e737c34d: Status 404 returned error can't find the container with id dc423414e2e4e5684ad69f68a9d475547aa57411badcd648243a5240e737c34d May 21 14:39:32.466341 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.466306 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-frdm7"] May 21 14:39:32.469515 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.469499 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.471972 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.471948 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:39:32.472116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.471999 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-klsxf\"" May 21 14:39:32.473225 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.473204 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:39:32.480943 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.480920 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frdm7"] May 21 14:39:32.554950 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.554918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcbm\" (UniqueName: \"kubernetes.io/projected/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-api-access-nzcbm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.555124 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.554958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-crio-socket\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.555124 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.555043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.555270 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.555142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.555270 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.555185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-data-volume\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.605465 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.605433 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svf7t" May 21 14:39:32.639203 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.639164 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"dc423414e2e4e5684ad69f68a9d475547aa57411badcd648243a5240e737c34d"} May 21 14:39:32.640853 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.640820 2554 generic.go:358] "Generic (PLEG): container finished" podID="7bd74e9c-2f15-4543-ab12-d206ab2133cf" containerID="7d0d5aad4688066127b4dd0a8a6c6b49df2536d9673ae94d97b2affb5f5c1677" exitCode=0 May 21 14:39:32.640992 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.640891 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerDied","Data":"7d0d5aad4688066127b4dd0a8a6c6b49df2536d9673ae94d97b2affb5f5c1677"} May 21 14:39:32.655588 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655565 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.655704 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655635 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.655704 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655680 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-data-volume\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.655808 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655714 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcbm\" (UniqueName: \"kubernetes.io/projected/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-api-access-nzcbm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.655808 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655748 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-crio-socket\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.655906 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.655871 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-crio-socket\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.656313 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.656286 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-data-volume\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.656585 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.656563 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.658815 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.658793 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.664125 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.664093 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcbm\" (UniqueName: \"kubernetes.io/projected/2c07f6bc-8fea-43e7-9b34-e2dd65037ce3-kube-api-access-nzcbm\") pod \"insights-runtime-extractor-frdm7\" (UID: \"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3\") " pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.778249 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.778221 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frdm7" May 21 14:39:32.919638 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:32.919608 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frdm7"] May 21 14:39:32.921997 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:32.921968 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c07f6bc_8fea_43e7_9b34_e2dd65037ce3.slice/crio-0f318960fe9041753fdb28150ddbd3457420f3e0dbcbdecdea07a56aef0cbbb4 WatchSource:0}: Error finding container 0f318960fe9041753fdb28150ddbd3457420f3e0dbcbdecdea07a56aef0cbbb4: Status 404 returned error can't find the container with id 0f318960fe9041753fdb28150ddbd3457420f3e0dbcbdecdea07a56aef0cbbb4 May 21 14:39:33.369472 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.369436 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tt29s"] May 21 14:39:33.372820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.372797 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:33.375629 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.375285 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-jggtz\"" May 21 14:39:33.375629 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.375496 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 14:39:33.380308 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.380283 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tt29s"] May 21 14:39:33.463309 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.463269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tt29s\" (UID: \"40e95172-083f-47b1-b2a1-888176feb32e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:33.564602 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.564562 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tt29s\" (UID: \"40e95172-083f-47b1-b2a1-888176feb32e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:33.564804 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:33.564707 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 14:39:33.564884 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:33.564804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert podName:40e95172-083f-47b1-b2a1-888176feb32e nodeName:}" failed. No retries permitted until 2026-05-21 14:39:34.064778423 +0000 UTC m=+84.378697923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-tt29s" (UID: "40e95172-083f-47b1-b2a1-888176feb32e") : secret "monitoring-plugin-cert" not found May 21 14:39:33.647764 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.647637 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frdm7" event={"ID":"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3","Type":"ContainerStarted","Data":"a0163c093a95f7eaa0fb1241135342a85dd6e030d89a155443625ab5bb57e6b4"} May 21 14:39:33.647764 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:33.647685 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frdm7" event={"ID":"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3","Type":"ContainerStarted","Data":"0f318960fe9041753fdb28150ddbd3457420f3e0dbcbdecdea07a56aef0cbbb4"} May 21 14:39:34.069628 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.069596 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tt29s\" (UID: \"40e95172-083f-47b1-b2a1-888176feb32e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:34.069773 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:34.069740 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 14:39:34.069823 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:34.069804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert podName:40e95172-083f-47b1-b2a1-888176feb32e nodeName:}" failed. No retries permitted until 2026-05-21 14:39:35.069788323 +0000 UTC m=+85.383707814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-tt29s" (UID: "40e95172-083f-47b1-b2a1-888176feb32e") : secret "monitoring-plugin-cert" not found May 21 14:39:34.460376 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.460302 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:34.464267 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.464246 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:39:34.653413 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.653384 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"3e426779deadde2d78c04408c8b382448047c11aa9357e956ae39373cf02d03f"} May 21 14:39:34.656782 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.656755 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frdm7" event={"ID":"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3","Type":"ContainerStarted","Data":"5a26e1107104aacfd1291e60fc1d6630b9dbbae397448d2607066d0f6555464e"} May 21 14:39:34.659683 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.659629 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"ec35dd6b294097e3eb57e55384f188623b00e9d29f18ee3e36328988c90a6d60"} May 21 14:39:34.832488 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.832455 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:39:34.836768 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.836562 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.839334 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.839316 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:39:34.839435 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.839336 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:39:34.839913 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.839895 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:39:34.840383 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840369 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:39:34.840383 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840377 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:39:34.840531 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840440 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:39:34.840719 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840673 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:39:34.840719 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840704 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:39:34.840872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.840795 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:39:34.841189 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.841167 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:39:34.841289 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.841190 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:39:34.841289 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.841240 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nbbn4\"" May 21 14:39:34.841407 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.841169 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e7i4b0c8kul1r\"" May 21 14:39:34.841455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.841431 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:39:34.843743 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.843316 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:39:34.853516 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.853491 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:39:34.976682 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.976682 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.976880 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.976880 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.976880 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977033 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977033 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977033 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.976993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977115 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqzdz\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-kube-api-access-fqzdz\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977286 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:34.977397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:34.977348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.077827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077784 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.077827 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077834 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077863 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqzdz\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-kube-api-access-fqzdz\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077889 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077911 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077954 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tt29s\" (UID: \"40e95172-083f-47b1-b2a1-888176feb32e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.077987 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078018 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078104 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078081 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078109 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078164 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078221 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078270 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078326 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078369 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078406 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078438 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078483 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.078595 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078514 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.079054 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.079054 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.078690 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.081771 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.081593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.081771 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.081765 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.081797 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.081872 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.082417 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.082546 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.082984 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.083589 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.084513 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.084333 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-config\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.085531 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.085505 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.086192 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.085695 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7589038-dca3-47cc-9656-7c859b87eea2-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.086192 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.086133 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.086555 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.086531 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.087116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.087046 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.087834 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.087811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/40e95172-083f-47b1-b2a1-888176feb32e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-tt29s\" (UID: \"40e95172-083f-47b1-b2a1-888176feb32e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:35.087919 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.087814 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7589038-dca3-47cc-9656-7c859b87eea2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.089021 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.089000 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqzdz\" (UniqueName: \"kubernetes.io/projected/d7589038-dca3-47cc-9656-7c859b87eea2-kube-api-access-fqzdz\") pod \"prometheus-k8s-0\" (UID: \"d7589038-dca3-47cc-9656-7c859b87eea2\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.149906 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.149864 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:35.190566 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.190424 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:35.342806 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.342772 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:39:35.353915 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.353242 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-tt29s"] May 21 14:39:35.665402 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.665315 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"e0e4b29fa8072c4dd2968da2853badce694a9811ae77fb9a1edc0d84ece79e72"} May 21 14:39:35.665402 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.665364 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"35c128436371b0873c13a19c74e08dffe83f612237406a7d7969bdf481b7e925"} May 21 14:39:35.666715 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.666688 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" event={"ID":"40e95172-083f-47b1-b2a1-888176feb32e","Type":"ContainerStarted","Data":"111fcba95121b9167cf17e73dc8e20917e389c2df48cd11e7abece6d989ff023"} May 21 14:39:35.668222 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.668196 2554 generic.go:358] "Generic (PLEG): container finished" podID="d7589038-dca3-47cc-9656-7c859b87eea2" containerID="464961e378c9d25c8a36aabe245b06a8be24008260e500bf084825320385642e" exitCode=0 May 21 14:39:35.668317 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.668287 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerDied","Data":"464961e378c9d25c8a36aabe245b06a8be24008260e500bf084825320385642e"} May 21 14:39:35.668385 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.668322 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"eb6f429a83b88dd2ac0c2013b98a024f1791d498aa302abcf8733e1393ce66fa"} May 21 14:39:35.671618 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.671585 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"065f85fd0d04348b91167cb2869143ebc714cbec74fae855b0b0ed3eaf5f2562"} May 21 14:39:35.671693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.671618 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"772d74b45b2d689df093ab0479b88a59947e6a8f7b481dc594313061b9780161"} May 21 14:39:35.671693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.671632 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"28d6e33c9f0ab594500adc4bc8fa879cade9ba7ef3cf1883159155877bf3798c"} May 21 14:39:35.671693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:35.671646 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"9dcd9d4d1135be9a459bbad7dd45600944195275e2afae0881908432999de1e2"} May 21 14:39:36.678870 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.678819 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"b9ea4b5aeca017365998fdf11d74d4912485312257b0feb0bf918804780370df"} May 21 14:39:36.678870 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.678868 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"0446b2404b18f121bc60c19fa68662cae28b57630c79a8397697b8c4e32e6f4a"} May 21 14:39:36.679406 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.678889 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" event={"ID":"837cc958-1791-4dd0-a061-85fd8491d415","Type":"ContainerStarted","Data":"4d69af97e7ae539e39d68f82cc771eb00a9831f5a21f3c6e7a4b0552c889f65c"} May 21 14:39:36.679406 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.679009 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:36.680791 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.680754 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frdm7" event={"ID":"2c07f6bc-8fea-43e7-9b34-e2dd65037ce3","Type":"ContainerStarted","Data":"fe8f1d15a052cd0f0776dc565e169ecfdf8765f1eaa1ba23482899a92c33ddad"} May 21 14:39:36.684229 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.684196 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7bd74e9c-2f15-4543-ab12-d206ab2133cf","Type":"ContainerStarted","Data":"eb40de62c734adb36bc739fd5bf09395e5babd16d2aebccd5a1cb701d3d08f37"} May 21 14:39:36.704801 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.704754 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" podStartSLOduration=1.639160626 podStartE2EDuration="5.704740474s" podCreationTimestamp="2026-05-21 14:39:31 +0000 UTC" firstStartedPulling="2026-05-21 14:39:32.036700521 +0000 UTC m=+82.350619998" lastFinishedPulling="2026-05-21 14:39:36.102280365 +0000 UTC m=+86.416199846" observedRunningTime="2026-05-21 14:39:36.701759218 +0000 UTC m=+87.015678718" watchObservedRunningTime="2026-05-21 14:39:36.704740474 +0000 UTC m=+87.018659972" May 21 14:39:36.724370 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.724326 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-frdm7" podStartSLOduration=1.611765246 podStartE2EDuration="4.724310331s" podCreationTimestamp="2026-05-21 14:39:32 +0000 UTC" firstStartedPulling="2026-05-21 14:39:32.989149249 +0000 UTC m=+83.303068734" lastFinishedPulling="2026-05-21 14:39:36.101694334 +0000 UTC m=+86.415613819" observedRunningTime="2026-05-21 14:39:36.722456778 +0000 UTC m=+87.036376288" watchObservedRunningTime="2026-05-21 14:39:36.724310331 +0000 UTC m=+87.038229830" May 21 14:39:36.748425 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:36.748367 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.367588457 podStartE2EDuration="7.748347856s" podCreationTimestamp="2026-05-21 14:39:29 +0000 UTC" firstStartedPulling="2026-05-21 14:39:30.723942074 +0000 UTC m=+81.037861550" lastFinishedPulling="2026-05-21 14:39:36.104701473 +0000 UTC m=+86.418620949" observedRunningTime="2026-05-21 14:39:36.745636134 +0000 UTC m=+87.059555638" watchObservedRunningTime="2026-05-21 14:39:36.748347856 +0000 UTC m=+87.062267356" May 21 14:39:37.688977 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:37.688830 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" event={"ID":"40e95172-083f-47b1-b2a1-888176feb32e","Type":"ContainerStarted","Data":"9a1272d51245b42802d8bb5c9061279c73e18ddbc570cce439a85365937cdb2f"} May 21 14:39:37.690045 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:37.690000 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:37.694491 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:37.694467 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" May 21 14:39:37.705116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:37.705051 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-tt29s" podStartSLOduration=2.666229704 podStartE2EDuration="4.705038371s" podCreationTimestamp="2026-05-21 14:39:33 +0000 UTC" firstStartedPulling="2026-05-21 14:39:35.363158209 +0000 UTC m=+85.677077698" lastFinishedPulling="2026-05-21 14:39:37.401966887 +0000 UTC m=+87.715886365" observedRunningTime="2026-05-21 14:39:37.703518827 +0000 UTC m=+88.017438325" watchObservedRunningTime="2026-05-21 14:39:37.705038371 +0000 UTC m=+88.018957907" May 21 14:39:38.695451 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:38.695375 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"62166edaa88e249206b5ecfa7451d6e5f5bbc3a458fecf5e9891a8ad1d6f8eaa"} May 21 14:39:38.695451 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:38.695419 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"85c72fb727f418c5a311f7d6efb1b84e58f61871a00cdbe973ef04a05778f490"} May 21 14:39:38.695451 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:38.695432 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"7b18fb9f88270ca8b38423bfbebf1110667751dbb229b9d237de0837a0ef9b1b"} May 21 14:39:39.704415 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:39.704375 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"6bc20014b1a51044b6e4be58090458d9d129d56d729a52d548e1ae4a288266fc"} May 21 14:39:39.704889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:39.704423 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"0444a0d748f7a209625f5f6de2dd3e890345797ce1c70dbbdbfe868da9a3ec4f"} May 21 14:39:39.704889 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:39.704437 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7589038-dca3-47cc-9656-7c859b87eea2","Type":"ContainerStarted","Data":"ef7bf82df98b476eac5c718dfb357f6f323562613e9ad51c8a14b16dc602e449"} May 21 14:39:39.739744 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:39.739650 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.971647347 podStartE2EDuration="5.739629764s" podCreationTimestamp="2026-05-21 14:39:34 +0000 UTC" firstStartedPulling="2026-05-21 14:39:35.669652149 +0000 UTC m=+85.983571627" lastFinishedPulling="2026-05-21 14:39:38.437634568 +0000 UTC m=+88.751554044" observedRunningTime="2026-05-21 14:39:39.737230887 +0000 UTC m=+90.051150388" watchObservedRunningTime="2026-05-21 14:39:39.739629764 +0000 UTC m=+90.053549264" May 21 14:39:39.823174 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:39.823126 2554 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: configmap "prometheus-k8s-rulefiles-0" not found May 21 14:39:39.823364 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:39:39.823212 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-rulefiles-0 podName:d7589038-dca3-47cc-9656-7c859b87eea2 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:40.32318889 +0000 UTC m=+90.637108378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/d7589038-dca3-47cc-9656-7c859b87eea2-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "d7589038-dca3-47cc-9656-7c859b87eea2") : configmap "prometheus-k8s-rulefiles-0" not found May 21 14:39:40.150001 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:40.149966 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:39:42.695692 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:42.695665 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-566689c768-94fbp" May 21 14:39:45.307299 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.307266 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:39:45.311730 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.311713 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.319355 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.319324 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 14:39:45.321799 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.321774 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:39:45.477250 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477218 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477389 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477389 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477389 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477368 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477524 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477524 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.477524 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.477518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zq6\" (UniqueName: \"kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578795 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578702 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578795 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578770 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578804 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578844 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578883 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.578997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.578934 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.579221 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.579009 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zq6\" (UniqueName: \"kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.579630 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.579605 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.579725 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.579710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.579850 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.579799 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.580437 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.580407 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.581791 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.581745 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.581791 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.581774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.587037 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.587009 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zq6\" (UniqueName: \"kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6\") pod \"console-55948dc8f5-ch6hh\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.622575 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.622498 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:45.790685 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:45.790657 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:39:45.796652 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:39:45.796609 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e7aa74_8756_4c4c_aa45_7ac1d16bd591.slice/crio-224a0f82f4d257b13997e9d87eb7e8095ce0781117fa33009c4a795a84d09a04 WatchSource:0}: Error finding container 224a0f82f4d257b13997e9d87eb7e8095ce0781117fa33009c4a795a84d09a04: Status 404 returned error can't find the container with id 224a0f82f4d257b13997e9d87eb7e8095ce0781117fa33009c4a795a84d09a04 May 21 14:39:46.729900 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:46.729863 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55948dc8f5-ch6hh" event={"ID":"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591","Type":"ContainerStarted","Data":"84ba9545f8c5549a2e0aa6d514903e2c4451949396896610b3be0dab2305bee6"} May 21 14:39:46.729900 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:46.729902 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55948dc8f5-ch6hh" event={"ID":"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591","Type":"ContainerStarted","Data":"224a0f82f4d257b13997e9d87eb7e8095ce0781117fa33009c4a795a84d09a04"} May 21 14:39:46.750023 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:46.749978 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55948dc8f5-ch6hh" podStartSLOduration=1.7499651269999998 podStartE2EDuration="1.749965127s" podCreationTimestamp="2026-05-21 14:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:39:46.748715133 +0000 UTC m=+97.062634635" watchObservedRunningTime="2026-05-21 14:39:46.749965127 +0000 UTC m=+97.063884626" May 21 14:39:51.598422 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:51.598386 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rzhlj" May 21 14:39:55.622986 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:55.622944 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:55.623392 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:55.623022 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:55.627779 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:55.627758 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:55.759832 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:55.759801 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:39:55.810311 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:39:55.810274 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:40:20.829882 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:20.829816 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-78bbb7c465-k86w8" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" containerName="console" containerID="cri-o://95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202" gracePeriod=15 May 21 14:40:21.068642 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.068619 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78bbb7c465-k86w8_02431969-0875-451a-b30f-5f2bf493fb1e/console/0.log" May 21 14:40:21.068775 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.068688 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:40:21.179029 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.178959 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179037 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179075 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179095 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179126 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv9fq\" (UniqueName: \"kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179200 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179184 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert\") pod \"02431969-0875-451a-b30f-5f2bf493fb1e\" (UID: \"02431969-0875-451a-b30f-5f2bf493fb1e\") " May 21 14:40:21.179468 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179438 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:40:21.179518 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179448 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config" (OuterVolumeSpecName: "console-config") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:40:21.179518 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.179502 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:40:21.181431 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.181396 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:40:21.181532 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.181485 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:40:21.181532 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.181498 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq" (OuterVolumeSpecName: "kube-api-access-qv9fq") pod "02431969-0875-451a-b30f-5f2bf493fb1e" (UID: "02431969-0875-451a-b30f-5f2bf493fb1e"). InnerVolumeSpecName "kube-api-access-qv9fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:40:21.280454 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280412 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-console-config\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.280454 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280453 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-oauth-serving-cert\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.280454 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280463 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-oauth-config\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.280646 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280472 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02431969-0875-451a-b30f-5f2bf493fb1e-service-ca\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.280646 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280482 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv9fq\" (UniqueName: \"kubernetes.io/projected/02431969-0875-451a-b30f-5f2bf493fb1e-kube-api-access-qv9fq\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.280646 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.280490 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02431969-0875-451a-b30f-5f2bf493fb1e-console-serving-cert\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:40:21.831223 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831196 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78bbb7c465-k86w8_02431969-0875-451a-b30f-5f2bf493fb1e/console/0.log" May 21 14:40:21.831594 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831234 2554 generic.go:358] "Generic (PLEG): container finished" podID="02431969-0875-451a-b30f-5f2bf493fb1e" containerID="95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202" exitCode=2 May 21 14:40:21.831594 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831307 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78bbb7c465-k86w8" event={"ID":"02431969-0875-451a-b30f-5f2bf493fb1e","Type":"ContainerDied","Data":"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202"} May 21 14:40:21.831594 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831332 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78bbb7c465-k86w8" event={"ID":"02431969-0875-451a-b30f-5f2bf493fb1e","Type":"ContainerDied","Data":"6429aa76600bb854b11c61781b0517a598c470d88f10ecc282fb4f1618334403"} May 21 14:40:21.831594 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831346 2554 scope.go:117] "RemoveContainer" containerID="95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202" May 21 14:40:21.831594 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.831308 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78bbb7c465-k86w8" May 21 14:40:21.840282 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.840265 2554 scope.go:117] "RemoveContainer" containerID="95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202" May 21 14:40:21.840566 ip-10-0-140-221 kubenswrapper[2554]: E0521 14:40:21.840543 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202\": container with ID starting with 95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202 not found: ID does not exist" containerID="95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202" May 21 14:40:21.840639 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.840575 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202"} err="failed to get container status \"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202\": rpc error: code = NotFound desc = could not find container \"95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202\": container with ID starting with 95fcf04fea0b698903744fb88bea9363a5e245126b9ab720850f4d59930f1202 not found: ID does not exist" May 21 14:40:21.852702 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.852667 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:40:21.858081 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:21.858031 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78bbb7c465-k86w8"] May 21 14:40:22.224177 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:22.224099 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" path="/var/lib/kubelet/pods/02431969-0875-451a-b30f-5f2bf493fb1e/volumes" May 21 14:40:35.150788 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:35.150754 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:40:35.169698 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:35.169669 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:40:35.887963 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:40:35.887934 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:41:03.789170 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:03.789086 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:41:28.808176 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:28.808103 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-55948dc8f5-ch6hh" podUID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" containerName="console" containerID="cri-o://84ba9545f8c5549a2e0aa6d514903e2c4451949396896610b3be0dab2305bee6" gracePeriod=15 May 21 14:41:29.026244 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.026218 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55948dc8f5-ch6hh_b6e7aa74-8756-4c4c-aa45-7ac1d16bd591/console/0.log" May 21 14:41:29.026396 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.026262 2554 generic.go:358] "Generic (PLEG): container finished" podID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" containerID="84ba9545f8c5549a2e0aa6d514903e2c4451949396896610b3be0dab2305bee6" exitCode=2 May 21 14:41:29.026396 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.026306 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55948dc8f5-ch6hh" event={"ID":"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591","Type":"ContainerDied","Data":"84ba9545f8c5549a2e0aa6d514903e2c4451949396896610b3be0dab2305bee6"} May 21 14:41:29.045441 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.045419 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55948dc8f5-ch6hh_b6e7aa74-8756-4c4c-aa45-7ac1d16bd591/console/0.log" May 21 14:41:29.045549 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.045483 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:41:29.146788 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146693 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.146788 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146734 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147025 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146846 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147025 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146878 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147025 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146914 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5zq6\" (UniqueName: \"kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147025 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146952 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147025 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.146975 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle\") pod \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\" (UID: \"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591\") " May 21 14:41:29.147314 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147210 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:41:29.147376 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147311 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config" (OuterVolumeSpecName: "console-config") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:41:29.147376 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147358 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:41:29.147550 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147482 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:41:29.147693 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147677 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-config\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.147762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147696 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-service-ca\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.147762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147705 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-trusted-ca-bundle\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.147762 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.147713 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-oauth-serving-cert\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.148962 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.148938 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:41:29.149115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.148957 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:41:29.149115 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.149027 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6" (OuterVolumeSpecName: "kube-api-access-m5zq6") pod "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" (UID: "b6e7aa74-8756-4c4c-aa45-7ac1d16bd591"). InnerVolumeSpecName "kube-api-access-m5zq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:41:29.249018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.248985 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-oauth-config\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.249018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.249011 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5zq6\" (UniqueName: \"kubernetes.io/projected/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-kube-api-access-m5zq6\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:29.249018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:29.249021 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591-console-serving-cert\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 14:41:30.030804 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.030776 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55948dc8f5-ch6hh_b6e7aa74-8756-4c4c-aa45-7ac1d16bd591/console/0.log" May 21 14:41:30.031326 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.030894 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55948dc8f5-ch6hh" event={"ID":"b6e7aa74-8756-4c4c-aa45-7ac1d16bd591","Type":"ContainerDied","Data":"224a0f82f4d257b13997e9d87eb7e8095ce0781117fa33009c4a795a84d09a04"} May 21 14:41:30.031326 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.030900 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55948dc8f5-ch6hh" May 21 14:41:30.031326 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.030927 2554 scope.go:117] "RemoveContainer" containerID="84ba9545f8c5549a2e0aa6d514903e2c4451949396896610b3be0dab2305bee6" May 21 14:41:30.053452 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.053397 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:41:30.057744 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.057720 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55948dc8f5-ch6hh"] May 21 14:41:30.227809 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:41:30.227768 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" path="/var/lib/kubelet/pods/b6e7aa74-8756-4c4c-aa45-7ac1d16bd591/volumes" May 21 14:42:41.029141 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029044 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v"] May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029392 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" containerName="console" May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029404 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" containerName="console" May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029420 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" containerName="console" May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029425 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" containerName="console" May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029467 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="02431969-0875-451a-b30f-5f2bf493fb1e" containerName="console" May 21 14:42:41.029633 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.029479 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6e7aa74-8756-4c4c-aa45-7ac1d16bd591" containerName="console" May 21 14:42:41.031259 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.031242 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.033725 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.033704 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:42:41.034997 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.034975 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rnz47\"" May 21 14:42:41.035125 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.035002 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:42:41.039158 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.039139 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v"] May 21 14:42:41.146735 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.146704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7cp\" (UniqueName: \"kubernetes.io/projected/d6b54db6-16b0-443e-bb33-d858571c0a10-kube-api-access-br7cp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.146894 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.146768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6b54db6-16b0-443e-bb33-d858571c0a10-tmp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.247333 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.247294 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br7cp\" (UniqueName: \"kubernetes.io/projected/d6b54db6-16b0-443e-bb33-d858571c0a10-kube-api-access-br7cp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.247492 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.247381 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6b54db6-16b0-443e-bb33-d858571c0a10-tmp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.247681 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.247665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6b54db6-16b0-443e-bb33-d858571c0a10-tmp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.255325 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.255305 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7cp\" (UniqueName: \"kubernetes.io/projected/d6b54db6-16b0-443e-bb33-d858571c0a10-kube-api-access-br7cp\") pod \"openshift-lws-operator-bfc7f696d-qg74v\" (UID: \"d6b54db6-16b0-443e-bb33-d858571c0a10\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.352191 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.352108 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" May 21 14:42:41.473094 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:41.473047 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v"] May 21 14:42:41.475754 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:42:41.475723 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6b54db6_16b0_443e_bb33_d858571c0a10.slice/crio-281c2464c3d2cb84cf120d5024707936ce3184494f73ebd5a092cd15a5d2ecaa WatchSource:0}: Error finding container 281c2464c3d2cb84cf120d5024707936ce3184494f73ebd5a092cd15a5d2ecaa: Status 404 returned error can't find the container with id 281c2464c3d2cb84cf120d5024707936ce3184494f73ebd5a092cd15a5d2ecaa May 21 14:42:42.238664 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:42.238620 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" event={"ID":"d6b54db6-16b0-443e-bb33-d858571c0a10","Type":"ContainerStarted","Data":"281c2464c3d2cb84cf120d5024707936ce3184494f73ebd5a092cd15a5d2ecaa"} May 21 14:42:43.446751 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.446716 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-p9fkk"] May 21 14:42:43.449216 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.449194 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.451919 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.451883 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 14:42:43.452289 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.452267 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 14:42:43.453125 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.453108 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xwfbs\"" May 21 14:42:43.457707 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.457528 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-p9fkk"] May 21 14:42:43.564207 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.564161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zdhd\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-kube-api-access-5zdhd\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.564381 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.564295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-bound-sa-token\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.665663 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.665628 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-bound-sa-token\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.665820 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.665692 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zdhd\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-kube-api-access-5zdhd\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.673979 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.673945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-bound-sa-token\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.674236 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.674215 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zdhd\" (UniqueName: \"kubernetes.io/projected/d574d0ef-8fbe-4800-9720-96686260adf4-kube-api-access-5zdhd\") pod \"cert-manager-79c8d999ff-p9fkk\" (UID: \"d574d0ef-8fbe-4800-9720-96686260adf4\") " pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:43.761730 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:43.761701 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-p9fkk" May 21 14:42:44.944384 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:44.944357 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-p9fkk"] May 21 14:42:44.947355 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:42:44.947331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd574d0ef_8fbe_4800_9720_96686260adf4.slice/crio-1421dec06b1328db171b1c5b1674138bc7239696105488c88b240b745e113344 WatchSource:0}: Error finding container 1421dec06b1328db171b1c5b1674138bc7239696105488c88b240b745e113344: Status 404 returned error can't find the container with id 1421dec06b1328db171b1c5b1674138bc7239696105488c88b240b745e113344 May 21 14:42:45.257608 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:45.257576 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" event={"ID":"d6b54db6-16b0-443e-bb33-d858571c0a10","Type":"ContainerStarted","Data":"ab03036278ad59b571cd2e3609918b16cb12fb1db80fe11025150fdbd2645aa9"} May 21 14:42:45.258865 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:45.258837 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-p9fkk" event={"ID":"d574d0ef-8fbe-4800-9720-96686260adf4","Type":"ContainerStarted","Data":"1421dec06b1328db171b1c5b1674138bc7239696105488c88b240b745e113344"} May 21 14:42:45.281015 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:45.280957 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-qg74v" podStartSLOduration=0.899460482 podStartE2EDuration="4.280941364s" podCreationTimestamp="2026-05-21 14:42:41 +0000 UTC" firstStartedPulling="2026-05-21 14:42:41.477264305 +0000 UTC m=+271.791183782" lastFinishedPulling="2026-05-21 14:42:44.858745171 +0000 UTC m=+275.172664664" observedRunningTime="2026-05-21 14:42:45.280833225 +0000 UTC m=+275.594752724" watchObservedRunningTime="2026-05-21 14:42:45.280941364 +0000 UTC m=+275.594860865" May 21 14:42:51.279582 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:51.279494 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-p9fkk" event={"ID":"d574d0ef-8fbe-4800-9720-96686260adf4","Type":"ContainerStarted","Data":"8b28e3dd5fd945f84c0babc7ab9a6f8b1c5d057b2e5208f4e2c06fe87bc6d36d"} May 21 14:42:51.294850 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:51.294799 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-p9fkk" podStartSLOduration=2.232430246 podStartE2EDuration="8.294783463s" podCreationTimestamp="2026-05-21 14:42:43 +0000 UTC" firstStartedPulling="2026-05-21 14:42:44.949974283 +0000 UTC m=+275.263893760" lastFinishedPulling="2026-05-21 14:42:51.012327496 +0000 UTC m=+281.326246977" observedRunningTime="2026-05-21 14:42:51.293777544 +0000 UTC m=+281.607697043" watchObservedRunningTime="2026-05-21 14:42:51.294783463 +0000 UTC m=+281.608702967" May 21 14:42:54.975155 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.975118 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7"] May 21 14:42:54.977312 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.977296 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:54.981231 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.981205 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 14:42:54.981333 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.981228 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xmssw\"" May 21 14:42:54.981333 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.981227 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 14:42:54.981333 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.981209 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 14:42:54.987483 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:54.987462 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7"] May 21 14:42:55.072348 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.072282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmm24\" (UniqueName: \"kubernetes.io/projected/3436f59c-a973-4c5e-b1af-2904a7541bb2-kube-api-access-zmm24\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.072528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.072361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3436f59c-a973-4c5e-b1af-2904a7541bb2-manager-config\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.072528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.072385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.072528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.072410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-metrics-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.173154 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.173122 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmm24\" (UniqueName: \"kubernetes.io/projected/3436f59c-a973-4c5e-b1af-2904a7541bb2-kube-api-access-zmm24\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.173303 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.173159 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3436f59c-a973-4c5e-b1af-2904a7541bb2-manager-config\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.173303 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.173194 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.173303 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.173229 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-metrics-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.173946 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.173920 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3436f59c-a973-4c5e-b1af-2904a7541bb2-manager-config\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.175442 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.175416 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.175555 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.175473 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3436f59c-a973-4c5e-b1af-2904a7541bb2-metrics-cert\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.181153 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.181128 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmm24\" (UniqueName: \"kubernetes.io/projected/3436f59c-a973-4c5e-b1af-2904a7541bb2-kube-api-access-zmm24\") pod \"lws-controller-manager-cd96457dd-jcvl7\" (UID: \"3436f59c-a973-4c5e-b1af-2904a7541bb2\") " pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.287318 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.287268 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:42:55.413164 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:55.413135 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7"] May 21 14:42:55.415595 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:42:55.415564 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3436f59c_a973_4c5e_b1af_2904a7541bb2.slice/crio-35a25e81e87c45bb71eea2ce76d518fd2e4aae2e8d24ce09535dd2a231521b7e WatchSource:0}: Error finding container 35a25e81e87c45bb71eea2ce76d518fd2e4aae2e8d24ce09535dd2a231521b7e: Status 404 returned error can't find the container with id 35a25e81e87c45bb71eea2ce76d518fd2e4aae2e8d24ce09535dd2a231521b7e May 21 14:42:56.295320 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:42:56.295279 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" event={"ID":"3436f59c-a973-4c5e-b1af-2904a7541bb2","Type":"ContainerStarted","Data":"35a25e81e87c45bb71eea2ce76d518fd2e4aae2e8d24ce09535dd2a231521b7e"} May 21 14:43:00.544839 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.544795 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df"] May 21 14:43:00.546941 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.546922 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.550003 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.549980 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:43:00.550233 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.550216 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:43:00.550380 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.550360 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:43:00.550597 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.550584 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7l8mj\"" May 21 14:43:00.550931 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.550917 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:43:00.562267 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.562244 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df"] May 21 14:43:00.622174 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.622137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.622325 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.622188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.622325 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.622305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9hf\" (UniqueName: \"kubernetes.io/projected/20348b0a-ff43-4914-b7fd-44cef8cc1c52-kube-api-access-5w9hf\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.722914 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.722878 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9hf\" (UniqueName: \"kubernetes.io/projected/20348b0a-ff43-4914-b7fd-44cef8cc1c52-kube-api-access-5w9hf\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.723125 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.722956 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.723125 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.722986 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.725476 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.725447 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.725576 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.725477 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20348b0a-ff43-4914-b7fd-44cef8cc1c52-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.730240 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.730210 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9hf\" (UniqueName: \"kubernetes.io/projected/20348b0a-ff43-4914-b7fd-44cef8cc1c52-kube-api-access-5w9hf\") pod \"opendatahub-operator-controller-manager-64d8b6f58-zk2df\" (UID: \"20348b0a-ff43-4914-b7fd-44cef8cc1c52\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.858741 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.858657 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:00.993012 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:00.992987 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df"] May 21 14:43:00.995451 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:43:00.995421 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20348b0a_ff43_4914_b7fd_44cef8cc1c52.slice/crio-65d48816aaea9bb34631e6ed38db38a3a68ae2aae49ee37b9949e190c9a77e24 WatchSource:0}: Error finding container 65d48816aaea9bb34631e6ed38db38a3a68ae2aae49ee37b9949e190c9a77e24: Status 404 returned error can't find the container with id 65d48816aaea9bb34631e6ed38db38a3a68ae2aae49ee37b9949e190c9a77e24 May 21 14:43:01.309590 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:01.309554 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" event={"ID":"20348b0a-ff43-4914-b7fd-44cef8cc1c52","Type":"ContainerStarted","Data":"65d48816aaea9bb34631e6ed38db38a3a68ae2aae49ee37b9949e190c9a77e24"} May 21 14:43:04.322235 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:04.322201 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" event={"ID":"20348b0a-ff43-4914-b7fd-44cef8cc1c52","Type":"ContainerStarted","Data":"f259c13f08b5cf81c335ef4856b1aff62290f4889c1ef73990f69483df67ac66"} May 21 14:43:04.322628 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:04.322319 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:04.344650 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:04.344597 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" podStartSLOduration=1.8477179179999998 podStartE2EDuration="4.344578454s" podCreationTimestamp="2026-05-21 14:43:00 +0000 UTC" firstStartedPulling="2026-05-21 14:43:00.997786254 +0000 UTC m=+291.311705730" lastFinishedPulling="2026-05-21 14:43:03.494646781 +0000 UTC m=+293.808566266" observedRunningTime="2026-05-21 14:43:04.342740079 +0000 UTC m=+294.656659578" watchObservedRunningTime="2026-05-21 14:43:04.344578454 +0000 UTC m=+294.658497955" May 21 14:43:05.326943 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:05.326906 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" event={"ID":"3436f59c-a973-4c5e-b1af-2904a7541bb2","Type":"ContainerStarted","Data":"d690bcd8b2c69ba52b45aaf35e3e13c197d4ea608d7e0974405bbcca3b824cb6"} May 21 14:43:05.344036 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:05.343989 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" podStartSLOduration=2.442703372 podStartE2EDuration="11.343976245s" podCreationTimestamp="2026-05-21 14:42:54 +0000 UTC" firstStartedPulling="2026-05-21 14:42:55.417403306 +0000 UTC m=+285.731322783" lastFinishedPulling="2026-05-21 14:43:04.318676178 +0000 UTC m=+294.632595656" observedRunningTime="2026-05-21 14:43:05.343640946 +0000 UTC m=+295.657560448" watchObservedRunningTime="2026-05-21 14:43:05.343976245 +0000 UTC m=+295.657895744" May 21 14:43:06.329487 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:06.329459 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:43:10.121728 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:10.121701 2554 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:43:15.329528 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:15.329502 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-zk2df" May 21 14:43:17.334794 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:17.334762 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cd96457dd-jcvl7" May 21 14:43:20.830014 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.829977 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-m6rlh"] May 21 14:43:20.926323 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.926297 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-m6rlh"] May 21 14:43:20.926474 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.926415 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:20.930641 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.930606 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:43:20.930784 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.930653 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:43:20.930784 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.930682 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:43:20.930784 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.930720 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x4l7j\"" May 21 14:43:20.930784 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.930608 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:43:20.991872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.991837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tls-certs\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:20.992031 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.991880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tmp\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:20.992116 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:20.992086 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7nzb\" (UniqueName: \"kubernetes.io/projected/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-kube-api-access-s7nzb\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.093455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.093370 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tls-certs\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.093455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.093413 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tmp\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.093630 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.093502 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7nzb\" (UniqueName: \"kubernetes.io/projected/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-kube-api-access-s7nzb\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.095671 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.095638 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tmp\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.095980 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.095956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-tls-certs\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.101520 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.101500 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7nzb\" (UniqueName: \"kubernetes.io/projected/8fa4ddf1-eb45-499e-afa6-82e99c2fb331-kube-api-access-s7nzb\") pod \"kube-auth-proxy-f8585948-m6rlh\" (UID: \"8fa4ddf1-eb45-499e-afa6-82e99c2fb331\") " pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.236360 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.236330 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" May 21 14:43:21.361078 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.361033 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-m6rlh"] May 21 14:43:21.363376 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:43:21.363345 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa4ddf1_eb45_499e_afa6_82e99c2fb331.slice/crio-2fcebfed508ea1d0a0054a13a63b3d372878530ba009d7e7d33e4a298eb6710b WatchSource:0}: Error finding container 2fcebfed508ea1d0a0054a13a63b3d372878530ba009d7e7d33e4a298eb6710b: Status 404 returned error can't find the container with id 2fcebfed508ea1d0a0054a13a63b3d372878530ba009d7e7d33e4a298eb6710b May 21 14:43:21.365106 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.365088 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:43:21.376665 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:21.376631 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" event={"ID":"8fa4ddf1-eb45-499e-afa6-82e99c2fb331","Type":"ContainerStarted","Data":"2fcebfed508ea1d0a0054a13a63b3d372878530ba009d7e7d33e4a298eb6710b"} May 21 14:43:25.403274 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:25.403233 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" event={"ID":"8fa4ddf1-eb45-499e-afa6-82e99c2fb331","Type":"ContainerStarted","Data":"e89500360200c9ffc2442bf138b4e053e8a044f071f180167115f4b2d8a9e576"} May 21 14:43:25.418954 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:43:25.418906 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f8585948-m6rlh" podStartSLOduration=2.09188623 podStartE2EDuration="5.418893745s" podCreationTimestamp="2026-05-21 14:43:20 +0000 UTC" firstStartedPulling="2026-05-21 14:43:21.365215079 +0000 UTC m=+311.679134556" lastFinishedPulling="2026-05-21 14:43:24.69222259 +0000 UTC m=+315.006142071" observedRunningTime="2026-05-21 14:43:25.418699491 +0000 UTC m=+315.732618991" watchObservedRunningTime="2026-05-21 14:43:25.418893745 +0000 UTC m=+315.732813243" May 21 14:45:02.146579 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.146542 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b"] May 21 14:45:02.149861 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.149844 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.152515 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.152491 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:45:02.152627 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.152539 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 14:45:02.152627 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.152550 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 14:45:02.153810 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.153792 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:45:02.153874 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.153850 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8vzmb\"" May 21 14:45:02.161398 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.161377 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b"] May 21 14:45:02.200593 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.200559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jhl\" (UniqueName: \"kubernetes.io/projected/e9976771-3204-4471-8114-2f0262e8d9d2-kube-api-access-98jhl\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.200804 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.200603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9976771-3204-4471-8114-2f0262e8d9d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.200804 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.200714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9976771-3204-4471-8114-2f0262e8d9d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.301430 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.301394 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9976771-3204-4471-8114-2f0262e8d9d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.301616 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.301484 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9976771-3204-4471-8114-2f0262e8d9d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.301616 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.301561 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98jhl\" (UniqueName: \"kubernetes.io/projected/e9976771-3204-4471-8114-2f0262e8d9d2-kube-api-access-98jhl\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.302221 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.302193 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9976771-3204-4471-8114-2f0262e8d9d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.303872 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.303851 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9976771-3204-4471-8114-2f0262e8d9d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.310182 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.310161 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jhl\" (UniqueName: \"kubernetes.io/projected/e9976771-3204-4471-8114-2f0262e8d9d2-kube-api-access-98jhl\") pod \"kuadrant-console-plugin-6cb54b5c86-2nb8b\" (UID: \"e9976771-3204-4471-8114-2f0262e8d9d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.459209 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.459119 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" May 21 14:45:02.589667 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.589641 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b"] May 21 14:45:02.592549 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:45:02.592508 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9976771_3204_4471_8114_2f0262e8d9d2.slice/crio-d37d5ced8fd683c3c24610a251b1e89d19bde9ff6d4fbbd5963882fe29e8afe9 WatchSource:0}: Error finding container d37d5ced8fd683c3c24610a251b1e89d19bde9ff6d4fbbd5963882fe29e8afe9: Status 404 returned error can't find the container with id d37d5ced8fd683c3c24610a251b1e89d19bde9ff6d4fbbd5963882fe29e8afe9 May 21 14:45:02.718882 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:02.718790 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" event={"ID":"e9976771-3204-4471-8114-2f0262e8d9d2","Type":"ContainerStarted","Data":"d37d5ced8fd683c3c24610a251b1e89d19bde9ff6d4fbbd5963882fe29e8afe9"} May 21 14:45:27.824462 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:27.824427 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" event={"ID":"e9976771-3204-4471-8114-2f0262e8d9d2","Type":"ContainerStarted","Data":"b225a5cc2f2f7ceb1f8ee7de2c162a3ba8329cbb56cd81bdd447fbc0eca4a809"} May 21 14:45:27.840855 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:45:27.840810 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2nb8b" podStartSLOduration=1.614675004 podStartE2EDuration="25.840798718s" podCreationTimestamp="2026-05-21 14:45:02 +0000 UTC" firstStartedPulling="2026-05-21 14:45:02.594138414 +0000 UTC m=+412.908057892" lastFinishedPulling="2026-05-21 14:45:26.820262128 +0000 UTC m=+437.134181606" observedRunningTime="2026-05-21 14:45:27.838870506 +0000 UTC m=+438.152790004" watchObservedRunningTime="2026-05-21 14:45:27.840798718 +0000 UTC m=+438.154718216" May 21 14:46:01.084819 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.084784 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:46:01.087355 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.087338 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.089855 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.089823 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 14:46:01.095622 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.095597 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:46:01.118476 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.118437 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:46:01.230439 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.230404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb9701a5-314f-45ed-a982-4ad88347d22b-config-file\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.230641 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.230501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8dgk\" (UniqueName: \"kubernetes.io/projected/bb9701a5-314f-45ed-a982-4ad88347d22b-kube-api-access-w8dgk\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.331743 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.331688 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8dgk\" (UniqueName: \"kubernetes.io/projected/bb9701a5-314f-45ed-a982-4ad88347d22b-kube-api-access-w8dgk\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.331942 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.331797 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb9701a5-314f-45ed-a982-4ad88347d22b-config-file\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.332449 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.332431 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb9701a5-314f-45ed-a982-4ad88347d22b-config-file\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.339723 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.339656 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8dgk\" (UniqueName: \"kubernetes.io/projected/bb9701a5-314f-45ed-a982-4ad88347d22b-kube-api-access-w8dgk\") pod \"limitador-limitador-78c99df468-bwdt9\" (UID: \"bb9701a5-314f-45ed-a982-4ad88347d22b\") " pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.398397 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.398360 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:01.525844 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.525735 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:46:01.528249 ip-10-0-140-221 kubenswrapper[2554]: W0521 14:46:01.528177 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9701a5_314f_45ed_a982_4ad88347d22b.slice/crio-3b667d43910738d5cc267a7377f0023482ce01e3c02a37adeca8beae9dac6644 WatchSource:0}: Error finding container 3b667d43910738d5cc267a7377f0023482ce01e3c02a37adeca8beae9dac6644: Status 404 returned error can't find the container with id 3b667d43910738d5cc267a7377f0023482ce01e3c02a37adeca8beae9dac6644 May 21 14:46:01.940526 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:01.940488 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" event={"ID":"bb9701a5-314f-45ed-a982-4ad88347d22b","Type":"ContainerStarted","Data":"3b667d43910738d5cc267a7377f0023482ce01e3c02a37adeca8beae9dac6644"} May 21 14:46:04.951715 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:04.951679 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" event={"ID":"bb9701a5-314f-45ed-a982-4ad88347d22b","Type":"ContainerStarted","Data":"8ba9b80e026ae846863184237ce049ea0700c8499f913c3d9e502b4818389692"} May 21 14:46:04.952154 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:04.951765 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:46:04.967771 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:04.967729 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" podStartSLOduration=1.5925529859999998 podStartE2EDuration="3.967717172s" podCreationTimestamp="2026-05-21 14:46:01 +0000 UTC" firstStartedPulling="2026-05-21 14:46:01.530048042 +0000 UTC m=+471.843967519" lastFinishedPulling="2026-05-21 14:46:03.905212228 +0000 UTC m=+474.219131705" observedRunningTime="2026-05-21 14:46:04.966323874 +0000 UTC m=+475.280243372" watchObservedRunningTime="2026-05-21 14:46:04.967717172 +0000 UTC m=+475.281636670" May 21 14:46:15.956678 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:46:15.956650 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-bwdt9" May 21 14:47:26.941131 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:47:26.941098 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:47:43.694666 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:47:43.694629 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:48:00.891466 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:48:00.891434 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:48:21.288168 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:48:21.288129 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:48:32.394748 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:48:32.394670 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:48:36.007242 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:48:36.007203 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:48:42.091591 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:48:42.091559 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:49:37.092405 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:49:37.092364 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:49:47.587018 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:49:47.586983 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:49:56.694623 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:49:56.694586 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:50:07.694613 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:50:07.694572 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:50:15.397661 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:50:15.397627 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:50:26.788108 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:50:26.788053 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:51:38.389649 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:51:38.389569 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:51:53.886193 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:51:53.886154 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:52:32.788567 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:52:32.788534 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:52:49.191268 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:52:49.191227 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:53:03.798873 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:53:03.798787 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:53:20.284709 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:53:20.284670 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:54:13.391511 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:54:13.391477 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:54:23.290926 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:54:23.290889 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:54:39.284204 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:54:39.284116 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:54:47.586826 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:54:47.586791 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:55:05.483072 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:55:05.483021 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:55:13.286043 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:55:13.286005 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:55:45.894455 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:55:45.894423 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:55:54.882210 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:55:54.882172 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:03.684638 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:03.684551 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:11.796390 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:11.796352 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:20.287724 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:20.287690 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:28.082574 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:28.082535 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:32.592336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:32.592299 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:36.486993 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:36.486954 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:56:47.987274 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:56:47.987233 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:57:34.888393 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:57:34.888311 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:57:40.493786 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:57:40.493748 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:57:46.791003 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:57:46.790962 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:57:54.389114 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:57:54.389073 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:04.494715 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:04.494670 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:12.489741 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:12.489702 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:21.085246 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:21.085209 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:26.390345 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:26.390308 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:30.599336 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:30.599301 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:38.591111 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:38.591055 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:47.283912 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:47.283877 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:58:55.884486 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:58:55.884452 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:05.194675 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:05.194599 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:14.507391 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:14.507350 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:22.187702 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:22.187667 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:31.889039 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:31.888999 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:39.391797 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:39.391762 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:49.288960 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:49.288925 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 14:59:56.990172 ip-10-0-140-221 kubenswrapper[2554]: I0521 14:59:56.990137 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:00:00.145730 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.145692 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-tqtcf"] May 21 15:00:00.149123 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.149106 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:00.151778 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.151758 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qckk7\"" May 21 15:00:00.161841 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.161817 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-tqtcf"] May 21 15:00:00.259007 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.258970 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rppq5\" (UniqueName: \"kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5\") pod \"maas-api-key-cleanup-29656260-tqtcf\" (UID: \"8c42829c-3bce-4495-b511-071d60c09b6a\") " pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:00.359983 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.359941 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rppq5\" (UniqueName: \"kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5\") pod \"maas-api-key-cleanup-29656260-tqtcf\" (UID: \"8c42829c-3bce-4495-b511-071d60c09b6a\") " pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:00.369635 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.369606 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rppq5\" (UniqueName: \"kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5\") pod \"maas-api-key-cleanup-29656260-tqtcf\" (UID: \"8c42829c-3bce-4495-b511-071d60c09b6a\") " pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:00.459743 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.459656 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:00.587644 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.587489 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656260-tqtcf"] May 21 15:00:00.590519 ip-10-0-140-221 kubenswrapper[2554]: W0521 15:00:00.590479 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c42829c_3bce_4495_b511_071d60c09b6a.slice/crio-2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07 WatchSource:0}: Error finding container 2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07: Status 404 returned error can't find the container with id 2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07 May 21 15:00:00.592226 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.592207 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:00:00.683911 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:00.683874 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" event={"ID":"8c42829c-3bce-4495-b511-071d60c09b6a","Type":"ContainerStarted","Data":"2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07"} May 21 15:00:08.711237 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:08.711200 2554 generic.go:358] "Generic (PLEG): container finished" podID="8c42829c-3bce-4495-b511-071d60c09b6a" containerID="bfc5560ed17c9401ede2f2e673f29e6889a605dff8a888d2d1119eddd84e8b01" exitCode=0 May 21 15:00:08.711674 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:08.711241 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" event={"ID":"8c42829c-3bce-4495-b511-071d60c09b6a","Type":"ContainerDied","Data":"bfc5560ed17c9401ede2f2e673f29e6889a605dff8a888d2d1119eddd84e8b01"} May 21 15:00:09.842592 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:09.842567 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:09.941091 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:09.941035 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rppq5\" (UniqueName: \"kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5\") pod \"8c42829c-3bce-4495-b511-071d60c09b6a\" (UID: \"8c42829c-3bce-4495-b511-071d60c09b6a\") " May 21 15:00:09.943330 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:09.943302 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5" (OuterVolumeSpecName: "kube-api-access-rppq5") pod "8c42829c-3bce-4495-b511-071d60c09b6a" (UID: "8c42829c-3bce-4495-b511-071d60c09b6a"). InnerVolumeSpecName "kube-api-access-rppq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:00:10.041853 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:10.041824 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rppq5\" (UniqueName: \"kubernetes.io/projected/8c42829c-3bce-4495-b511-071d60c09b6a-kube-api-access-rppq5\") on node \"ip-10-0-140-221.ec2.internal\" DevicePath \"\"" May 21 15:00:10.719163 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:10.719130 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" May 21 15:00:10.719325 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:10.719131 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656260-tqtcf" event={"ID":"8c42829c-3bce-4495-b511-071d60c09b6a","Type":"ContainerDied","Data":"2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07"} May 21 15:00:10.719325 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:00:10.719244 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2580cffbbb1048a1613a6902b7d4d79f65b621ec836cdfa5448b4cf597100f07" May 21 15:02:13.091862 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:02:13.091819 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:02:20.986753 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:02:20.986715 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:02:44.988217 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:02:44.988175 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:02:49.994142 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:02:49.994101 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:00.094687 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:00.094652 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:09.986632 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:09.986597 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:19.187259 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:19.187224 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:29.994527 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:29.994439 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:38.150732 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:38.150696 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:48.692806 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:48.692771 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:03:58.494464 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:03:58.494427 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:04:07.982031 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:04:07.981989 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:04:17.891837 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:04:17.891801 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:04:52.180911 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:04:52.180877 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:05:35.293731 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:05:35.293692 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:05:43.285589 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:05:43.285550 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:05:53.095815 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:05:53.095779 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:01.884072 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:01.884027 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:09.788369 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:09.788328 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:23.486019 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:23.485981 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:32.484677 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:32.484593 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:38.492732 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:38.492692 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:47.796853 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:47.796816 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:06:55.985008 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:06:55.984973 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:04.784606 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:04.784566 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:15.385985 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:15.385950 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:33.395926 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:33.395890 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:41.490676 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:41.490633 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:50.795320 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:50.795281 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:07:58.785047 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:07:58.785010 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:16.191040 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:16.191004 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:24.391955 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:24.391918 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:33.202513 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:33.202477 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:41.201500 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:41.201468 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:50.891279 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:50.891248 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:08:59.584861 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:08:59.584826 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:07.888720 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:07.888685 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:21.097550 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:21.097512 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:30.287291 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:30.287214 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:43.688312 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:43.688276 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:53.690896 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:53.690861 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:09:59.784432 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:09:59.784395 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:10:09.495883 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:10:09.495844 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:10:16.898008 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:10:16.897974 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:10:34.590071 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:10:34.590019 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:10:42.286138 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:10:42.286103 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:10:52.303328 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:10:52.303287 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:11:00.293261 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:00.293185 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:11:23.595561 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:23.595522 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:11:36.388456 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:36.388419 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-bwdt9"] May 21 15:11:45.333686 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:45.333650 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656260-tqtcf_8c42829c-3bce-4495-b511-071d60c09b6a/cleanup/0.log" May 21 15:11:45.966874 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:45.966838 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d8b6f58-zk2df_20348b0a-ff43-4914-b7fd-44cef8cc1c52/manager/0.log" May 21 15:11:47.737450 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:47.737418 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-2nb8b_e9976771-3204-4471-8114-2f0262e8d9d2/kuadrant-console-plugin/0.log" May 21 15:11:48.070901 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:48.070871 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-bwdt9_bb9701a5-314f-45ed-a982-4ad88347d22b/limitador/0.log" May 21 15:11:48.781105 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:48.781051 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f8585948-m6rlh_8fa4ddf1-eb45-499e-afa6-82e99c2fb331/kube-auth-proxy/0.log" May 21 15:11:54.515446 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.515410 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6k557/must-gather-kpsl9"] May 21 15:11:54.515839 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.515816 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c42829c-3bce-4495-b511-071d60c09b6a" containerName="cleanup" May 21 15:11:54.515839 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.515828 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c42829c-3bce-4495-b511-071d60c09b6a" containerName="cleanup" May 21 15:11:54.515908 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.515884 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c42829c-3bce-4495-b511-071d60c09b6a" containerName="cleanup" May 21 15:11:54.519167 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.519151 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.521849 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.521827 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k557\"/\"kube-root-ca.crt\"" May 21 15:11:54.521984 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.521929 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k557\"/\"openshift-service-ca.crt\"" May 21 15:11:54.521984 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.521969 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6k557\"/\"default-dockercfg-mwmkf\"" May 21 15:11:54.532373 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.532350 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/must-gather-kpsl9"] May 21 15:11:54.604651 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.604608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d23041be-9a27-4563-8bc9-5996da083f4b-must-gather-output\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.604897 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.604683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fzg5\" (UniqueName: \"kubernetes.io/projected/d23041be-9a27-4563-8bc9-5996da083f4b-kube-api-access-2fzg5\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.705909 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.705854 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d23041be-9a27-4563-8bc9-5996da083f4b-must-gather-output\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.706124 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.705935 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fzg5\" (UniqueName: \"kubernetes.io/projected/d23041be-9a27-4563-8bc9-5996da083f4b-kube-api-access-2fzg5\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.706247 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.706226 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d23041be-9a27-4563-8bc9-5996da083f4b-must-gather-output\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.715943 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.715918 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fzg5\" (UniqueName: \"kubernetes.io/projected/d23041be-9a27-4563-8bc9-5996da083f4b-kube-api-access-2fzg5\") pod \"must-gather-kpsl9\" (UID: \"d23041be-9a27-4563-8bc9-5996da083f4b\") " pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.828717 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.828627 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/must-gather-kpsl9" May 21 15:11:54.957388 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.957359 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/must-gather-kpsl9"] May 21 15:11:54.958674 ip-10-0-140-221 kubenswrapper[2554]: W0521 15:11:54.958646 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd23041be_9a27_4563_8bc9_5996da083f4b.slice/crio-d60fae0cb95fd18b11bd58136857b27f1d61718e1bb381df17ef9cd1c9520ef8 WatchSource:0}: Error finding container d60fae0cb95fd18b11bd58136857b27f1d61718e1bb381df17ef9cd1c9520ef8: Status 404 returned error can't find the container with id d60fae0cb95fd18b11bd58136857b27f1d61718e1bb381df17ef9cd1c9520ef8 May 21 15:11:54.960416 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:54.960401 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:11:55.079849 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:55.079757 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/must-gather-kpsl9" event={"ID":"d23041be-9a27-4563-8bc9-5996da083f4b","Type":"ContainerStarted","Data":"d60fae0cb95fd18b11bd58136857b27f1d61718e1bb381df17ef9cd1c9520ef8"} May 21 15:11:56.084615 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:56.084564 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/must-gather-kpsl9" event={"ID":"d23041be-9a27-4563-8bc9-5996da083f4b","Type":"ContainerStarted","Data":"f9b420eb48140ba18ba9faa23cd941104efade0086b9e46d13ba7b2787c22f5c"} May 21 15:11:57.090726 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:57.090681 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/must-gather-kpsl9" event={"ID":"d23041be-9a27-4563-8bc9-5996da083f4b","Type":"ContainerStarted","Data":"17881afcbc87aaf8a58bfd8769f1fd641efcf26e42bc043b4087277c67969de3"} May 21 15:11:57.111712 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:57.111665 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6k557/must-gather-kpsl9" podStartSLOduration=2.15564575 podStartE2EDuration="3.111649888s" podCreationTimestamp="2026-05-21 15:11:54 +0000 UTC" firstStartedPulling="2026-05-21 15:11:54.960528308 +0000 UTC m=+2025.274447786" lastFinishedPulling="2026-05-21 15:11:55.916532439 +0000 UTC m=+2026.230451924" observedRunningTime="2026-05-21 15:11:57.10825486 +0000 UTC m=+2027.422174371" watchObservedRunningTime="2026-05-21 15:11:57.111649888 +0000 UTC m=+2027.425569386" May 21 15:11:57.626392 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:57.626361 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6mrpb_07642766-f7ec-49b4-aba8-ce7026360160/global-pull-secret-syncer/0.log" May 21 15:11:57.779267 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:57.779237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2xnpq_36a8325d-5375-4c71-ae53-1d25d0a3c1d0/konnectivity-agent/0.log" May 21 15:11:57.929528 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:11:57.929448 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-221.ec2.internal_6d113bb90b30a0ad30c8cd3725255e56/haproxy/0.log" May 21 15:12:01.692787 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:01.692684 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-2nb8b_e9976771-3204-4471-8114-2f0262e8d9d2/kuadrant-console-plugin/0.log" May 21 15:12:01.833092 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:01.833046 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-bwdt9_bb9701a5-314f-45ed-a982-4ad88347d22b/limitador/0.log" May 21 15:12:03.102390 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.102352 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/alertmanager/0.log" May 21 15:12:03.127967 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.127923 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/config-reloader/0.log" May 21 15:12:03.152602 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.152548 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/kube-rbac-proxy-web/0.log" May 21 15:12:03.176179 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.176141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/kube-rbac-proxy/0.log" May 21 15:12:03.198912 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.198820 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/kube-rbac-proxy-metric/0.log" May 21 15:12:03.220857 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.220833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/prom-label-proxy/0.log" May 21 15:12:03.242660 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.242592 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7bd74e9c-2f15-4543-ab12-d206ab2133cf/init-config-reloader/0.log" May 21 15:12:03.437698 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.437663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-tt29s_40e95172-083f-47b1-b2a1-888176feb32e/monitoring-plugin/0.log" May 21 15:12:03.655181 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.655106 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2wh6_5355e5c7-7ca6-476f-8978-12545dd69753/node-exporter/0.log" May 21 15:12:03.680737 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.680702 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2wh6_5355e5c7-7ca6-476f-8978-12545dd69753/kube-rbac-proxy/0.log" May 21 15:12:03.703000 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.702967 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2wh6_5355e5c7-7ca6-476f-8978-12545dd69753/init-textfile/0.log" May 21 15:12:03.826034 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.826000 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/prometheus/0.log" May 21 15:12:03.852685 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.852655 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/config-reloader/0.log" May 21 15:12:03.875855 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.875824 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/thanos-sidecar/0.log" May 21 15:12:03.903579 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.903515 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/kube-rbac-proxy-web/0.log" May 21 15:12:03.927037 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.926963 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/kube-rbac-proxy/0.log" May 21 15:12:03.960240 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.960208 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/kube-rbac-proxy-thanos/0.log" May 21 15:12:03.984586 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:03.984553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7589038-dca3-47cc-9656-7c859b87eea2/init-config-reloader/0.log" May 21 15:12:04.023933 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.023900 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vlgds_57cb9cb6-f827-4434-be2d-8b1e0d8afc84/prometheus-operator/0.log" May 21 15:12:04.043678 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.043646 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vlgds_57cb9cb6-f827-4434-be2d-8b1e0d8afc84/kube-rbac-proxy/0.log" May 21 15:12:04.069391 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.069358 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-t7l5t_a73090cb-bf0d-4c04-82a9-3bd98b9cf8fd/prometheus-operator-admission-webhook/0.log" May 21 15:12:04.187329 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.187247 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/thanos-query/0.log" May 21 15:12:04.209699 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.209670 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/kube-rbac-proxy-web/0.log" May 21 15:12:04.232303 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.232275 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/kube-rbac-proxy/0.log" May 21 15:12:04.254846 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.254819 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/prom-label-proxy/0.log" May 21 15:12:04.278144 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.278110 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/kube-rbac-proxy-rules/0.log" May 21 15:12:04.300154 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:04.300100 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566689c768-94fbp_837cc958-1791-4dd0-a061-85fd8491d415/kube-rbac-proxy-metrics/0.log" May 21 15:12:06.403643 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.403609 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j"] May 21 15:12:06.409648 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.409620 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.417439 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.417410 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j"] May 21 15:12:06.528255 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.528043 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-sys\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.528255 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.528111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-proc\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.528255 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.528149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpbqh\" (UniqueName: \"kubernetes.io/projected/e7c2ad03-c691-41f7-9c34-59b0da65698e-kube-api-access-hpbqh\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.528255 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.528204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-podres\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.528611 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.528370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-lib-modules\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629295 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629257 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-podres\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629478 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629328 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-lib-modules\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629478 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629373 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-sys\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629478 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629389 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-proc\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629478 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629405 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpbqh\" (UniqueName: \"kubernetes.io/projected/e7c2ad03-c691-41f7-9c34-59b0da65698e-kube-api-access-hpbqh\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629685 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-podres\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629685 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629477 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-sys\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629685 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629484 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-proc\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.629685 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.629508 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2ad03-c691-41f7-9c34-59b0da65698e-lib-modules\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.637585 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.637553 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpbqh\" (UniqueName: \"kubernetes.io/projected/e7c2ad03-c691-41f7-9c34-59b0da65698e-kube-api-access-hpbqh\") pod \"perf-node-gather-daemonset-vnh4j\" (UID: \"e7c2ad03-c691-41f7-9c34-59b0da65698e\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.728396 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.728303 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:06.904381 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:06.904340 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j"] May 21 15:12:06.910497 ip-10-0-140-221 kubenswrapper[2554]: W0521 15:12:06.910460 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7c2ad03_c691_41f7_9c34_59b0da65698e.slice/crio-5d5cf55f3401279b1c02b7661adf780c546557f275bd4cdc8eaca454e402830f WatchSource:0}: Error finding container 5d5cf55f3401279b1c02b7661adf780c546557f275bd4cdc8eaca454e402830f: Status 404 returned error can't find the container with id 5d5cf55f3401279b1c02b7661adf780c546557f275bd4cdc8eaca454e402830f May 21 15:12:07.140746 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.140709 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" event={"ID":"e7c2ad03-c691-41f7-9c34-59b0da65698e","Type":"ContainerStarted","Data":"17995da345ef11344098e88a3def91088562e22cd4631a246783b8f2f0d80225"} May 21 15:12:07.140746 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.140749 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" event={"ID":"e7c2ad03-c691-41f7-9c34-59b0da65698e","Type":"ContainerStarted","Data":"5d5cf55f3401279b1c02b7661adf780c546557f275bd4cdc8eaca454e402830f"} May 21 15:12:07.141002 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.140832 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:07.156094 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.156027 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" podStartSLOduration=1.156009037 podStartE2EDuration="1.156009037s" podCreationTimestamp="2026-05-21 15:12:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:12:07.1552908 +0000 UTC m=+2037.469210301" watchObservedRunningTime="2026-05-21 15:12:07.156009037 +0000 UTC m=+2037.469928538" May 21 15:12:07.962786 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.962753 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svf7t_ee4a3837-4571-49cb-b76f-e5e36cb7a9fd/dns/0.log" May 21 15:12:07.984273 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:07.984241 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svf7t_ee4a3837-4571-49cb-b76f-e5e36cb7a9fd/kube-rbac-proxy/0.log" May 21 15:12:08.030520 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:08.030495 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmn54_6ca6ee39-bd50-4354-994b-698985ae3955/dns-node-resolver/0.log" May 21 15:12:08.532531 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:08.532501 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sk9b_2825c367-c25d-4c56-a945-542017b4d809/node-ca/0.log" May 21 15:12:09.522866 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:09.522828 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f8585948-m6rlh_8fa4ddf1-eb45-499e-afa6-82e99c2fb331/kube-auth-proxy/0.log" May 21 15:12:10.246636 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:10.246600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fnbpk_9ab7dfb8-8948-4306-af9c-278f4a56a485/serve-healthcheck-canary/0.log" May 21 15:12:10.690342 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:10.690299 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-2kbbg_92a2c756-3554-4f0a-b520-71499dbf92bb/insights-operator/0.log" May 21 15:12:10.710574 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:10.710551 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frdm7_2c07f6bc-8fea-43e7-9b34-e2dd65037ce3/kube-rbac-proxy/0.log" May 21 15:12:10.731351 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:10.731329 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frdm7_2c07f6bc-8fea-43e7-9b34-e2dd65037ce3/exporter/0.log" May 21 15:12:10.752988 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:10.752966 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frdm7_2c07f6bc-8fea-43e7-9b34-e2dd65037ce3/extractor/0.log" May 21 15:12:12.821390 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:12.821356 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656260-tqtcf_8c42829c-3bce-4495-b511-071d60c09b6a/cleanup/0.log" May 21 15:12:13.084906 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:13.084835 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d8b6f58-zk2df_20348b0a-ff43-4914-b7fd-44cef8cc1c52/manager/0.log" May 21 15:12:13.158889 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:13.158850 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-vnh4j" May 21 15:12:14.166121 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:14.166088 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cd96457dd-jcvl7_3436f59c-a973-4c5e-b1af-2904a7541bb2/manager/0.log" May 21 15:12:14.217311 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:14.217282 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-qg74v_d6b54db6-16b0-443e-bb33-d858571c0a10/openshift-lws-operator/0.log" May 21 15:12:18.599594 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:18.599564 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-4jbsr_1e9a09ce-6ef7-47d5-98af-48e9392e0611/migrator/0.log" May 21 15:12:18.619723 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:18.619686 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-4jbsr_1e9a09ce-6ef7-47d5-98af-48e9392e0611/graceful-termination/0.log" May 21 15:12:20.211755 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.211729 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/kube-multus-additional-cni-plugins/0.log" May 21 15:12:20.232802 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.232769 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/egress-router-binary-copy/0.log" May 21 15:12:20.254587 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.254555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/cni-plugins/0.log" May 21 15:12:20.276601 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.276579 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/bond-cni-plugin/0.log" May 21 15:12:20.296225 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.296201 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/routeoverride-cni/0.log" May 21 15:12:20.317800 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.317776 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/whereabouts-cni-bincopy/0.log" May 21 15:12:20.337901 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.337879 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4vtg_ad907261-5481-4aac-8771-b71e51180755/whereabouts-cni/0.log" May 21 15:12:20.561097 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.561036 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vd7d6_66211a43-a9aa-443c-9941-65435b44df5b/kube-multus/0.log" May 21 15:12:20.672049 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.672018 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wgg4p_ab699f52-13c4-4d60-a2f5-9792ff1af4b5/network-metrics-daemon/0.log" May 21 15:12:20.691588 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:20.691560 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wgg4p_ab699f52-13c4-4d60-a2f5-9792ff1af4b5/kube-rbac-proxy/0.log" May 21 15:12:22.132702 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.132664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/ovn-controller/0.log" May 21 15:12:22.165021 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.164973 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/ovn-acl-logging/0.log" May 21 15:12:22.183333 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.183305 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/kube-rbac-proxy-node/0.log" May 21 15:12:22.206703 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.206669 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:12:22.227486 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.227457 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/northd/0.log" May 21 15:12:22.250076 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.250040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/nbdb/0.log" May 21 15:12:22.274223 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.274202 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/sbdb/0.log" May 21 15:12:22.400309 ip-10-0-140-221 kubenswrapper[2554]: I0521 15:12:22.400237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phmc2_fec2ff92-8eae-4bb2-a76d-2e31dbde0ccf/ovnkube-controller/0.log"