May 21 17:40:28.539578 ip-10-0-141-214 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 17:40:28.539599 ip-10-0-141-214 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 17:40:28.539608 ip-10-0-141-214 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 17:40:28.539910 ip-10-0-141-214 systemd[1]: Failed to start Kubernetes Kubelet. May 21 17:40:38.722243 ip-10-0-141-214 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 17:40:38.722258 ip-10-0-141-214 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5535b9b002c24c5b88ea4add318d4dfd -- May 21 17:43:05.117876 ip-10-0-141-214 systemd[1]: Starting Kubernetes Kubelet... May 21 17:43:05.548563 ip-10-0-141-214 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:43:05.548563 ip-10-0-141-214 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 17:43:05.548563 ip-10-0-141-214 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:43:05.548563 ip-10-0-141-214 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 17:43:05.548563 ip-10-0-141-214 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:43:05.549365 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.549279 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 17:43:05.553086 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553072 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:43:05.553086 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553086 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553090 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553094 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553097 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553100 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553102 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553105 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553108 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553111 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553113 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553116 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553119 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553121 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553124 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553128 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553130 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553133 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553136 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553138 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553141 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:43:05.553150 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553143 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553146 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553148 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553151 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553155 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553157 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553160 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553163 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553166 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553169 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553171 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553174 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553176 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553179 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553182 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553186 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553196 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553199 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553202 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553204 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 17:43:05.553655 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553207 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553209 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553212 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553214 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553217 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553219 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553222 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553224 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553227 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553229 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553231 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553234 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553236 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553239 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553242 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553250 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553253 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553256 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553258 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553261 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:43:05.554140 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553264 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553267 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553271 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553275 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553278 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553281 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553284 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553287 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553289 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553298 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553300 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553303 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553306 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553309 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553311 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553314 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553317 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553319 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553322 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:43:05.554660 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553324 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553327 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553329 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553332 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553334 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553336 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553788 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553795 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553798 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553801 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553804 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553807 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553810 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553813 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553815 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553818 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553821 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553823 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553826 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553828 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:43:05.555115 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553831 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553833 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553842 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553844 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553847 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553849 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553852 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553854 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553857 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553860 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553862 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553865 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553867 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553870 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553872 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553875 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553877 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553881 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553885 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:43:05.555602 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553889 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553893 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553897 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553900 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553902 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553905 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553908 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553911 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553914 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553917 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553919 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553922 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553924 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553927 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553929 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553932 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553935 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553938 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553940 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553942 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:43:05.556075 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553945 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553947 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553950 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553952 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553955 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553957 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553960 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553962 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553964 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553967 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553969 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553972 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553975 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553978 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553980 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553983 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553986 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553988 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553991 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553993 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:43:05.556583 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553996 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.553999 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554001 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554004 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554006 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554009 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554012 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554014 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554017 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554020 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554022 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554026 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.554029 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555525 2565 flags.go:64] FLAG: --address="0.0.0.0" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555535 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555545 2565 flags.go:64] FLAG: --anonymous-auth="true" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555550 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555555 2565 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555559 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555563 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555568 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 17:43:05.557161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555571 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555574 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555578 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555582 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555585 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555588 2565 flags.go:64] FLAG: --cgroup-root="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555591 2565 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555594 2565 flags.go:64] FLAG: --client-ca-file="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555597 2565 flags.go:64] FLAG: --cloud-config="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555600 2565 flags.go:64] FLAG: --cloud-provider="external" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555603 2565 flags.go:64] FLAG: --cluster-dns="[]" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555608 2565 flags.go:64] FLAG: --cluster-domain="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555612 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555615 2565 flags.go:64] FLAG: --config-dir="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555617 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555621 2565 flags.go:64] FLAG: --container-log-max-files="5" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555625 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555628 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555631 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555634 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555637 2565 flags.go:64] FLAG: --contention-profiling="false" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555641 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555644 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555647 2565 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555650 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 17:43:05.557701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555657 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555660 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555663 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555666 2565 flags.go:64] FLAG: --enable-load-reader="false" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555669 2565 flags.go:64] FLAG: --enable-server="true" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555672 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555676 2565 flags.go:64] FLAG: --event-burst="100" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555679 2565 flags.go:64] FLAG: --event-qps="50" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555682 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555685 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555688 2565 flags.go:64] FLAG: --eviction-hard="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555692 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555695 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555698 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555701 2565 flags.go:64] FLAG: --eviction-soft="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555704 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555707 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555710 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555713 2565 flags.go:64] FLAG: --experimental-mounter-path="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555716 2565 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555719 2565 flags.go:64] FLAG: --fail-swap-on="true" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555722 2565 flags.go:64] FLAG: --feature-gates="" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555726 2565 flags.go:64] FLAG: --file-check-frequency="20s" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555729 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555732 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 17:43:05.558303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555735 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555738 2565 flags.go:64] FLAG: --healthz-port="10248" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555741 2565 flags.go:64] FLAG: --help="false" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555744 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-141-214.ec2.internal" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555748 2565 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555751 2565 flags.go:64] FLAG: --http-check-frequency="20s" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555754 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555757 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555761 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555763 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555766 2565 flags.go:64] FLAG: --image-service-endpoint="" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555769 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555772 2565 flags.go:64] FLAG: --kube-api-burst="100" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555775 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555778 2565 flags.go:64] FLAG: --kube-api-qps="50" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555781 2565 flags.go:64] FLAG: --kube-reserved="" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555784 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555791 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555794 2565 flags.go:64] FLAG: --kubelet-cgroups="" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555797 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555800 2565 flags.go:64] FLAG: --lock-file="" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555802 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555805 2565 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555809 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 17:43:05.558915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555814 2565 flags.go:64] FLAG: --log-json-split-stream="false" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555817 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555819 2565 flags.go:64] FLAG: --log-text-split-stream="false" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555822 2565 flags.go:64] FLAG: --logging-format="text" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555825 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555829 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555832 2565 flags.go:64] FLAG: --manifest-url="" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555835 2565 flags.go:64] FLAG: --manifest-url-header="" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555839 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555842 2565 flags.go:64] FLAG: --max-open-files="1000000" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555847 2565 flags.go:64] FLAG: --max-pods="110" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555850 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555853 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555856 2565 flags.go:64] FLAG: --memory-manager-policy="None" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555859 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555863 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555865 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555868 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555876 2565 flags.go:64] FLAG: --node-status-max-images="50" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555879 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555882 2565 flags.go:64] FLAG: --oom-score-adj="-999" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555885 2565 flags.go:64] FLAG: --pod-cidr="" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555888 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 17:43:05.559535 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555894 2565 flags.go:64] FLAG: --pod-manifest-path="" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555897 2565 flags.go:64] FLAG: --pod-max-pids="-1" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555900 2565 flags.go:64] FLAG: --pods-per-core="0" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555905 2565 flags.go:64] FLAG: --port="10250" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555908 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555911 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c7b9b03c1164679" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555914 2565 flags.go:64] FLAG: --qos-reserved="" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555917 2565 flags.go:64] FLAG: --read-only-port="10255" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555920 2565 flags.go:64] FLAG: --register-node="true" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555923 2565 flags.go:64] FLAG: --register-schedulable="true" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555926 2565 flags.go:64] FLAG: --register-with-taints="" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555930 2565 flags.go:64] FLAG: --registry-burst="10" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555932 2565 flags.go:64] FLAG: --registry-qps="5" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555935 2565 flags.go:64] FLAG: --reserved-cpus="" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555938 2565 flags.go:64] FLAG: --reserved-memory="" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555942 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555945 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555948 2565 flags.go:64] FLAG: --rotate-certificates="false" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555951 2565 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555953 2565 flags.go:64] FLAG: --runonce="false" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555956 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555959 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555962 2565 flags.go:64] FLAG: --seccomp-default="false" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555966 2565 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555969 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555972 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 17:43:05.560096 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555975 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555978 2565 flags.go:64] FLAG: --storage-driver-password="root" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555981 2565 flags.go:64] FLAG: --storage-driver-secure="false" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555984 2565 flags.go:64] FLAG: --storage-driver-table="stats" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555987 2565 flags.go:64] FLAG: --storage-driver-user="root" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555990 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555993 2565 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555996 2565 flags.go:64] FLAG: --system-cgroups="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.555999 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556005 2565 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556008 2565 flags.go:64] FLAG: --tls-cert-file="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556012 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556016 2565 flags.go:64] FLAG: --tls-min-version="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556019 2565 flags.go:64] FLAG: --tls-private-key-file="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556022 2565 flags.go:64] FLAG: --topology-manager-policy="none" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556025 2565 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556028 2565 flags.go:64] FLAG: --topology-manager-scope="container" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556031 2565 flags.go:64] FLAG: --v="2" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556035 2565 flags.go:64] FLAG: --version="false" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556039 2565 flags.go:64] FLAG: --vmodule="" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556043 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.556047 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556141 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556145 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556148 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:43:05.560733 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556151 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556153 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556156 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556158 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556161 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556169 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556172 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556174 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556177 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556180 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556182 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556185 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556187 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556190 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556193 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556195 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556199 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556202 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556205 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556207 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:43:05.561335 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556210 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556213 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556215 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556218 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556221 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556224 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556226 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556229 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556231 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556234 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556237 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556239 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556241 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556244 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556246 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556249 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556252 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556254 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556261 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556264 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:43:05.561875 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556267 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556269 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556272 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556275 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556277 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556279 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556282 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556284 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556289 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556292 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556294 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556297 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556300 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556303 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556305 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556308 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556310 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556313 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556315 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556318 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:43:05.562373 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556320 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556325 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556328 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556330 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556333 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556338 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556341 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556344 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556347 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556350 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556354 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556356 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556359 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556361 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556364 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556366 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556370 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556373 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:43:05.563244 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556376 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:43:05.564084 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556380 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:43:05.564084 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556382 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:43:05.564084 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.556385 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:43:05.564084 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.557092 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:43:05.565369 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.565350 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 17:43:05.565369 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.565369 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565437 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565445 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565450 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565455 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565461 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565465 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565469 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565474 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565478 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565482 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565509 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565514 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565519 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565523 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565527 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565531 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:43:05.565527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565536 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565540 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565544 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565548 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565552 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565556 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565561 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565565 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565569 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565573 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565578 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565582 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565586 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565590 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565595 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565601 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565605 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565609 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565613 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565617 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565621 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:43:05.566258 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565625 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565629 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565633 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565637 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565641 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565645 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565649 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565654 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565658 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565665 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565671 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565676 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565682 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565686 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565691 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565698 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565705 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565710 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565714 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:43:05.566960 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565718 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565723 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565727 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565732 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565736 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565740 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565744 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565749 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565754 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565759 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565763 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565767 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565771 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565775 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565780 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565784 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565788 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565792 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565796 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565801 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:43:05.567517 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565805 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565809 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565813 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565818 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565822 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565827 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565832 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565836 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565840 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.565844 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.565874 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566050 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566059 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566064 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566069 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566073 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:43:05.568033 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566078 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566082 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566086 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566090 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566094 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566099 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566104 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566108 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566112 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566116 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566121 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566125 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566129 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566134 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566139 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566143 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566148 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566152 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566156 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566161 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:43:05.568619 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566165 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566169 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566174 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566178 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566182 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566187 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566191 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566196 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566200 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566204 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566209 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566213 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566217 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566222 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566226 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566231 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566235 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566241 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566247 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566252 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:43:05.569522 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566256 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566260 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566264 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566268 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566272 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566277 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566282 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566288 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566295 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566300 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566304 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566309 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566314 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566318 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566323 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566328 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566333 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566337 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566342 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:43:05.570106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566346 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566350 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566354 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566358 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566362 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566366 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566370 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566375 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566380 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566384 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566388 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566392 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566398 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566402 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566406 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566410 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566413 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566418 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566423 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:43:05.570716 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566427 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:43:05.571175 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566431 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:43:05.571175 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:05.566435 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:43:05.571175 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.566443 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:43:05.571175 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.567334 2565 server.go:962] "Client rotation is on, will bootstrap in background" May 21 17:43:05.571175 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.570458 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 17:43:05.571482 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.571469 2565 server.go:1019] "Starting client certificate rotation" May 21 17:43:05.571619 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.571585 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:43:05.571619 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.571617 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:43:05.595367 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.595347 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:43:05.599467 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.599443 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:43:05.613640 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.613626 2565 log.go:25] "Validated CRI v1 runtime API" May 21 17:43:05.619667 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.619652 2565 log.go:25] "Validated CRI v1 image API" May 21 17:43:05.621616 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.621593 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 17:43:05.626551 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.626532 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:43:05.626881 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.626857 2565 fs.go:135] Filesystem UUIDs: map[1c7bbd6e-b70d-4e81-a83d-97b36c2aa110:/dev/nvme0n1p4 30dfeb34-d118-4d5d-b4f2-fbe9d74225fd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 21 17:43:05.626934 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.626882 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 17:43:05.631331 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.631225 2565 manager.go:217] Machine: {Timestamp:2026-05-21 17:43:05.630755855 +0000 UTC m=+0.394051434 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100393 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23f3a35ff49a87d41adc19fdba16d1 SystemUUID:ec23f3a3-5ff4-9a87-d41a-dc19fdba16d1 BootID:5535b9b0-02c2-4c5b-88ea-4add318d4dfd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:eb:17:16:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:eb:17:16:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:7c:8e:44:95:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 17:43:05.632075 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.632065 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 17:43:05.632155 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.632143 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 17:43:05.633945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.633919 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 17:43:05.634104 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.633946 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 17:43:05.634151 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.634114 2565 topology_manager.go:138] "Creating topology manager with none policy" May 21 17:43:05.634151 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.634123 2565 container_manager_linux.go:306] "Creating device plugin manager" May 21 17:43:05.634151 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.634130 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:43:05.634830 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.634820 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:43:05.636961 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.636952 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 17:43:05.637070 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.637061 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 17:43:05.639937 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.639927 2565 kubelet.go:491] "Attempting to sync node with API server" May 21 17:43:05.639975 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.639941 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 17:43:05.639975 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.639956 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 17:43:05.639975 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.639965 2565 kubelet.go:397] "Adding apiserver pod source" May 21 17:43:05.639975 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.639974 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 17:43:05.641131 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.641117 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:43:05.641176 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.641144 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:43:05.643849 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.643827 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 17:43:05.645907 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.645894 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 17:43:05.646811 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646799 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646816 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646822 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646827 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646826 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsw4p" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646836 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646842 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646848 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646854 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 17:43:05.646861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646861 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 17:43:05.647093 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646867 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 17:43:05.647093 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.646876 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 17:43:05.647250 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.647241 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 17:43:05.648878 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.648870 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 17:43:05.648915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.648879 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 17:43:05.651795 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.651773 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 17:43:05.651795 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.651782 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 17:43:05.652135 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.652105 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 17:43:05.652789 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.652767 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 17:43:05.652927 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.652828 2565 server.go:1295] "Started kubelet" May 21 17:43:05.653172 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.653128 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 17:43:05.653246 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.653161 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 17:43:05.653246 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.653232 2565 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 17:43:05.653740 ip-10-0-141-214 systemd[1]: Started Kubernetes Kubelet. May 21 17:43:05.654675 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.654589 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 17:43:05.655060 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.655040 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsw4p" May 21 17:43:05.655514 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.655484 2565 server.go:317] "Adding debug handlers to kubelet server" May 21 17:43:05.663970 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.663955 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 17:43:05.664049 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.663974 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 17:43:05.664049 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664020 2565 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 17:43:05.664049 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664032 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 17:43:05.664202 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664125 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 17:43:05.664202 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664172 2565 reconstruct.go:97] "Volume reconstruction finished" May 21 17:43:05.664202 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664179 2565 reconciler.go:26] "Reconciler: start to sync state" May 21 17:43:05.664585 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.664564 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 17:43:05.664671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664657 2565 factory.go:55] Registering systemd factory May 21 17:43:05.664671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664671 2565 factory.go:223] Registration of the systemd container factory successfully May 21 17:43:05.664879 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664862 2565 factory.go:153] Registering CRI-O factory May 21 17:43:05.664879 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664880 2565 factory.go:223] Registration of the crio container factory successfully May 21 17:43:05.665005 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664931 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 17:43:05.665005 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.664932 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:05.665005 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664953 2565 factory.go:103] Registering Raw factory May 21 17:43:05.665151 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.664990 2565 manager.go:1196] Started watching for new ooms in manager May 21 17:43:05.665466 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.665455 2565 manager.go:319] Starting recovery of all containers May 21 17:43:05.667313 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.667291 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:05.669161 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.669141 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-214.ec2.internal\" not found" node="ip-10-0-141-214.ec2.internal" May 21 17:43:05.675590 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.675575 2565 manager.go:324] Recovery completed May 21 17:43:05.679633 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.679620 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.682097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682081 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.682160 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682112 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.682160 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682126 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.682591 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682568 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 17:43:05.682591 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682584 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 17:43:05.682668 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.682599 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 17:43:05.686767 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.686751 2565 policy_none.go:49] "None policy: Start" May 21 17:43:05.686836 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.686776 2565 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 17:43:05.686836 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.686788 2565 state_mem.go:35] "Initializing new in-memory state store" May 21 17:43:05.726034 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726018 2565 manager.go:341] "Starting Device Plugin manager" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.726046 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726055 2565 server.go:85] "Starting device plugin registration server" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726268 2565 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726281 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726373 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726460 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.726471 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.726931 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 17:43:05.742073 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.726968 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:05.752708 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.752680 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 17:43:05.753899 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.753880 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 17:43:05.753980 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.753909 2565 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 17:43:05.753980 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.753928 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 17:43:05.753980 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.753938 2565 kubelet.go:2451] "Starting kubelet main sync loop" May 21 17:43:05.754128 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.753984 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 17:43:05.757056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.757042 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:05.827047 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.827031 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.831880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.831866 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.831950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.831892 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.831950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.831902 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.831950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.831925 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-214.ec2.internal" May 21 17:43:05.840226 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.840211 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-214.ec2.internal" May 21 17:43:05.840320 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.840231 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-214.ec2.internal\": node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:05.854729 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.854710 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal"] May 21 17:43:05.854795 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.854766 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.855584 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.855570 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.855660 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.855594 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.855660 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.855606 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.856324 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.856308 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:05.857856 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.857843 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.858005 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.857990 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.858059 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858024 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.858555 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858542 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.858638 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858546 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.858638 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858570 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.858638 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858584 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.858638 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858586 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.858638 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.858597 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.860881 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.860866 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:05.860959 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.860894 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:43:05.861624 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.861610 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientMemory" May 21 17:43:05.861715 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.861646 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:43:05.861715 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.861661 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeHasSufficientPID" May 21 17:43:05.865534 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.865517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.865593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.865542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.865593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.865559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/611eecdfcb1ec0a5b7063b2d0d811571-config\") pod \"kube-apiserver-proxy-ip-10-0-141-214.ec2.internal\" (UID: \"611eecdfcb1ec0a5b7063b2d0d811571\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:05.892021 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.892003 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-214.ec2.internal\" not found" node="ip-10-0-141-214.ec2.internal" May 21 17:43:05.896259 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.896245 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-214.ec2.internal\" not found" node="ip-10-0-141-214.ec2.internal" May 21 17:43:05.957180 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:05.957162 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:05.966550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.966609 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.966609 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.966681 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966614 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe40143f031aeba447bcd02faec5391-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal\" (UID: \"2fe40143f031aeba447bcd02faec5391\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:05.966681 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966650 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/611eecdfcb1ec0a5b7063b2d0d811571-config\") pod \"kube-apiserver-proxy-ip-10-0-141-214.ec2.internal\" (UID: \"611eecdfcb1ec0a5b7063b2d0d811571\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:05.966747 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:05.966683 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/611eecdfcb1ec0a5b7063b2d0d811571-config\") pod \"kube-apiserver-proxy-ip-10-0-141-214.ec2.internal\" (UID: \"611eecdfcb1ec0a5b7063b2d0d811571\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:06.058077 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.058058 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.158805 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.158731 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.195152 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.195121 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:06.198823 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.198807 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:06.259762 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.259737 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.360205 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.360182 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.460639 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.460583 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.519590 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.519570 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:06.561434 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.561416 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.571755 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.571732 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 17:43:06.571869 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.571851 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:43:06.571911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.571872 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:43:06.571911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.571892 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:43:06.658476 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.658441 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 17:38:05 +0000 UTC" deadline="2028-02-05 22:01:53.414920208 +0000 UTC" May 21 17:43:06.658476 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.658473 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15004h18m46.756449715s" May 21 17:43:06.662431 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.662415 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.664810 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.664786 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 17:43:06.676433 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.676414 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:43:06.699645 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.699622 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdv46" May 21 17:43:06.705298 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.705283 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdv46" May 21 17:43:06.733169 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:06.733147 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611eecdfcb1ec0a5b7063b2d0d811571.slice/crio-ee4c618c1aaaf6442d330527e7608046d463200a707434cec2a6b978aaaae4f7 WatchSource:0}: Error finding container ee4c618c1aaaf6442d330527e7608046d463200a707434cec2a6b978aaaae4f7: Status 404 returned error can't find the container with id ee4c618c1aaaf6442d330527e7608046d463200a707434cec2a6b978aaaae4f7 May 21 17:43:06.733408 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:06.733394 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe40143f031aeba447bcd02faec5391.slice/crio-a22af466ef2440c54ebfd613c7da506afc101c877ce7a58c1c42b653a56f9c39 WatchSource:0}: Error finding container a22af466ef2440c54ebfd613c7da506afc101c877ce7a58c1c42b653a56f9c39: Status 404 returned error can't find the container with id a22af466ef2440c54ebfd613c7da506afc101c877ce7a58c1c42b653a56f9c39 May 21 17:43:06.736444 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.736429 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:43:06.757180 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.757141 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" event={"ID":"611eecdfcb1ec0a5b7063b2d0d811571","Type":"ContainerStarted","Data":"ee4c618c1aaaf6442d330527e7608046d463200a707434cec2a6b978aaaae4f7"} May 21 17:43:06.757948 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:06.757923 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" event={"ID":"2fe40143f031aeba447bcd02faec5391","Type":"ContainerStarted","Data":"a22af466ef2440c54ebfd613c7da506afc101c877ce7a58c1c42b653a56f9c39"} May 21 17:43:06.763071 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.763056 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.863540 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.863514 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:06.963923 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:06.963904 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:07.064331 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.064306 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:07.164942 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.164912 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-214.ec2.internal\" not found" May 21 17:43:07.250383 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.250356 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:07.265019 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.264992 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" May 21 17:43:07.275653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.275629 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:43:07.276597 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.276578 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" May 21 17:43:07.285799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.285767 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:43:07.513226 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.512997 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:07.516193 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.516168 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:07.641607 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.641566 2565 apiserver.go:52] "Watching apiserver" May 21 17:43:07.648219 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.648193 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 17:43:07.648609 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.648580 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-48wgk","openshift-multus/multus-additional-cni-plugins-cl52h","openshift-network-operator/iptables-alerter-7dwqn","openshift-ovn-kubernetes/ovnkube-node-92r2p","kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal","openshift-multus/multus-plxxb","openshift-multus/network-metrics-daemon-nf2kh","openshift-network-diagnostics/network-check-target-rvbql","kube-system/konnectivity-agent-f7m5r","openshift-cluster-node-tuning-operator/tuned-6m96c","openshift-dns/node-resolver-ftfbj"] May 21 17:43:07.651240 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.651208 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:07.651328 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.651296 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:07.653389 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.653361 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.655550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655429 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6js2m\"" May 21 17:43:07.655550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655542 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 17:43:07.655702 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655432 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 17:43:07.655943 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655890 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 17:43:07.655943 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655921 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 17:43:07.656077 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.655918 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 17:43:07.657955 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.657907 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.659749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.659727 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wrblw\"" May 21 17:43:07.659830 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.659786 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 17:43:07.659894 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.659843 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 17:43:07.659894 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.659740 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 17:43:07.660511 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.660457 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.662728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.662708 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.662857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.662839 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 17:43:07.664765 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.664600 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 17:43:07.664765 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.664674 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 17:43:07.664765 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.664696 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 17:43:07.664961 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.664851 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 17:43:07.666341 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.665059 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 17:43:07.666341 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.665384 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 17:43:07.666341 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.665723 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-plxxb" May 21 17:43:07.666341 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.666318 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bcp45\"" May 21 17:43:07.666754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.666656 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 17:43:07.666754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.666712 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 17:43:07.667981 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.667231 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bw7sf\"" May 21 17:43:07.667981 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.667902 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c7lz2\"" May 21 17:43:07.668134 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.668021 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 17:43:07.668459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.668440 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.668576 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.668559 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.668634 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.668560 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:07.670565 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.670418 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 17:43:07.670887 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.670711 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 17:43:07.670887 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.670714 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pw75r\"" May 21 17:43:07.670887 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.670790 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 17:43:07.671344 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.671328 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.673230 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.673214 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 17:43:07.673443 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.673429 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 17:43:07.674084 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.673775 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.674084 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.673820 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nbnp9\"" May 21 17:43:07.675705 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.675687 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 17:43:07.675858 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.675840 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nn4g4\"" May 21 17:43:07.675932 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.675902 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 17:43:07.676186 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676115 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.676505 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-kubelet\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.676591 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-registration-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.676591 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-sys-fs\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.676695 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-conf-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.676695 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.676799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-host-slash\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.676799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-node-log\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.676799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.676945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-config\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.676945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:07.676945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-device-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.676945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-os-release\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.676945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-k8s-cni-cncf-io\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-kubelet\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.676988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-log-socket\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-env-overrides\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-cni-binary-copy\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7wl\" (UniqueName: \"kubernetes.io/projected/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kube-api-access-ml7wl\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.677191 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-system-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-cnibin\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-os-release\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-netns\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-script-lib\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-bin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-multus\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-systemd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-multus-certs\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgz6\" (UniqueName: \"kubernetes.io/projected/0ec5cd19-8573-49bd-85c0-69504d92dc74-kube-api-access-nwgz6\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-systemd-units\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-etc-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a34b9a-570b-46cd-94da-2d423ac89e74-ovn-node-metrics-cert\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.677581 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhkc\" (UniqueName: \"kubernetes.io/projected/71a34b9a-570b-46cd-94da-2d423ac89e74-kube-api-access-9vhkc\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-bin\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-iptables-alerter-script\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-socket-dir-parent\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677839 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677868 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jhvpx\"" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.677838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678012 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-daemon-config\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-etc-kubernetes\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlkg\" (UniqueName: \"kubernetes.io/projected/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-kube-api-access-jrlkg\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9s4q\" (UniqueName: \"kubernetes.io/projected/9940eb66-5590-4034-81f8-bf733769bb41-kube-api-access-b9s4q\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-slash\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-var-lib-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.678349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-netd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9xw\" (UniqueName: \"kubernetes.io/projected/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-kube-api-access-7w9xw\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-socket-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-cnibin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-netns\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-system-cni-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-ovn\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-hostroot\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.679103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.678468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.706282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.706255 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:38:06 +0000 UTC" deadline="2027-12-12 12:26:43.881475513 +0000 UTC" May 21 17:43:07.706377 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.706283 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13674h43m36.175195984s" May 21 17:43:07.765098 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.765045 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 17:43:07.778699 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.778816 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778705 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-config\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.778816 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778725 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:07.778939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.778939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778856 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-device-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.778939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778886 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-os-release\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.778939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778913 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-k8s-cni-cncf-io\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-k8s-cni-cncf-io\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778964 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-kubelet\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778956 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-device-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779001 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-log-socket\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779028 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-env-overrides\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-log-socket\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-kubelet\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.778982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-os-release\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysconfig\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.779126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779098 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-cni-binary-copy\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779140 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-sys\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-host\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779233 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7wl\" (UniqueName: \"kubernetes.io/projected/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kube-api-access-ml7wl\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779261 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-tuned\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46zm\" (UniqueName: \"kubernetes.io/projected/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-kube-api-access-c46zm\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-config\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/553c3828-58db-4a38-947d-ef38652969fe-hosts-file\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779360 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-system-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.779434 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-env-overrides\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.779528 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:08.27947819 +0000 UTC m=+3.042773770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779560 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-cnibin\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779588 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-os-release\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.779605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-system-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779613 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-netns\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779640 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-script-lib\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-cni-binary-copy\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-serviceca\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-cnibin\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-netns\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779706 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-bin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-os-release\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779786 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-multus\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-bin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779862 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-systemd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-var-lib-cni-multus\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-lib-modules\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-systemd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.779997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-var-lib-kubelet\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780018 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-multus-certs\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780057 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgz6\" (UniqueName: \"kubernetes.io/projected/0ec5cd19-8573-49bd-85c0-69504d92dc74-kube-api-access-nwgz6\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780242 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-multus-certs\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780090 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-systemd-units\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a34b9a-570b-46cd-94da-2d423ac89e74-ovnkube-script-lib\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780196 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-etc-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-systemd-units\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780277 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a34b9a-570b-46cd-94da-2d423ac89e74-ovn-node-metrics-cert\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-etc-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780411 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhkc\" (UniqueName: \"kubernetes.io/projected/71a34b9a-570b-46cd-94da-2d423ac89e74-kube-api-access-9vhkc\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780469 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-conf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780621 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-bin\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780613 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-tmp\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.780939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-bin\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckcf\" (UniqueName: \"kubernetes.io/projected/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-kube-api-access-hckcf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780711 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-iptables-alerter-script\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780745 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780770 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-socket-dir-parent\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780795 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780821 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-cni-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2s4\" (UniqueName: \"kubernetes.io/projected/553c3828-58db-4a38-947d-ef38652969fe-kube-api-access-gl2s4\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-run-ovn-kubernetes\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-socket-dir-parent\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780927 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-daemon-config\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780968 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-etc-kubernetes\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.780995 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlkg\" (UniqueName: \"kubernetes.io/projected/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-kube-api-access-jrlkg\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781020 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9s4q\" (UniqueName: \"kubernetes.io/projected/9940eb66-5590-4034-81f8-bf733769bb41-kube-api-access-b9s4q\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781071 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-slash\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.781738 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781095 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-var-lib-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781118 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-netd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781151 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9xw\" (UniqueName: \"kubernetes.io/projected/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-kube-api-access-7w9xw\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781179 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-socket-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781202 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-cnibin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781225 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-netns\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781252 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-system-cni-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781276 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-ovn\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e101cb6-425f-4c3c-87fb-eadc117d93bc-agent-certs\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-iptables-alerter-script\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-run\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781366 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-hostroot\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-etc-kubernetes\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-hostroot\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-system-cni-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-daemon-config\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.782456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9940eb66-5590-4034-81f8-bf733769bb41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-cnibin\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-socket-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-host-run-netns\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781555 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-slash\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-cni-netd\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781587 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-kubelet\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-kubernetes\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-var-lib-openvswitch\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-run-ovn\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/553c3828-58db-4a38-947d-ef38652969fe-tmp-dir\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-host-kubelet\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781687 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-registration-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781720 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-sys-fs\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-registration-dir\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781776 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-conf-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.783015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781813 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-sys-fs\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781839 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec5cd19-8573-49bd-85c0-69504d92dc74-multus-conf-dir\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e101cb6-425f-4c3c-87fb-eadc117d93bc-konnectivity-ca\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-systemd\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-host\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781915 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-host-slash\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-host-slash\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.781980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-node-log\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.782028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-modprobe-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.782030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.782033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a34b9a-570b-46cd-94da-2d423ac89e74-node-log\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.783552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.782239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9940eb66-5590-4034-81f8-bf733769bb41-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.783906 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.783889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a34b9a-570b-46cd-94da-2d423ac89e74-ovn-node-metrics-cert\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.789230 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.789209 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:07.789340 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.789233 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:07.789340 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.789248 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:07.789340 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:07.789307 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:08.289289467 +0000 UTC m=+3.052585036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:07.792461 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.792437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlkg\" (UniqueName: \"kubernetes.io/projected/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-kube-api-access-jrlkg\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:07.792912 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.792883 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7wl\" (UniqueName: \"kubernetes.io/projected/7bdc2ab9-658b-4aeb-a097-6336d87cc9df-kube-api-access-ml7wl\") pod \"aws-ebs-csi-driver-node-bzpks\" (UID: \"7bdc2ab9-658b-4aeb-a097-6336d87cc9df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.793010 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.792915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9xw\" (UniqueName: \"kubernetes.io/projected/8f9a25f2-fb5a-4082-b0dc-e58001bd8269-kube-api-access-7w9xw\") pod \"iptables-alerter-7dwqn\" (UID: \"8f9a25f2-fb5a-4082-b0dc-e58001bd8269\") " pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.793010 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.792917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9s4q\" (UniqueName: \"kubernetes.io/projected/9940eb66-5590-4034-81f8-bf733769bb41-kube-api-access-b9s4q\") pod \"multus-additional-cni-plugins-cl52h\" (UID: \"9940eb66-5590-4034-81f8-bf733769bb41\") " pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.793010 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.792909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgz6\" (UniqueName: \"kubernetes.io/projected/0ec5cd19-8573-49bd-85c0-69504d92dc74-kube-api-access-nwgz6\") pod \"multus-plxxb\" (UID: \"0ec5cd19-8573-49bd-85c0-69504d92dc74\") " pod="openshift-multus/multus-plxxb" May 21 17:43:07.793453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.793431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhkc\" (UniqueName: \"kubernetes.io/projected/71a34b9a-570b-46cd-94da-2d423ac89e74-kube-api-access-9vhkc\") pod \"ovnkube-node-92r2p\" (UID: \"71a34b9a-570b-46cd-94da-2d423ac89e74\") " pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.882484 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysconfig\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882506 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-sys\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882530 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-host\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882564 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-tuned\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882588 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c46zm\" (UniqueName: \"kubernetes.io/projected/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-kube-api-access-c46zm\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882612 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/553c3828-58db-4a38-947d-ef38652969fe-hosts-file\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysconfig\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-host\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.882671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/553c3828-58db-4a38-947d-ef38652969fe-hosts-file\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882663 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-serviceca\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-sys\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-lib-modules\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882747 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-var-lib-kubelet\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882781 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882805 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-conf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882821 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-tmp\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882838 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hckcf\" (UniqueName: \"kubernetes.io/projected/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-kube-api-access-hckcf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882857 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2s4\" (UniqueName: \"kubernetes.io/projected/553c3828-58db-4a38-947d-ef38652969fe-kube-api-access-gl2s4\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-lib-modules\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882892 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e101cb6-425f-4c3c-87fb-eadc117d93bc-agent-certs\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.882950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-var-lib-kubelet\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883018 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883016 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-conf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883047 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-run\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-serviceca\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883079 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-sysctl-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883078 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-kubernetes\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-kubernetes\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883121 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/553c3828-58db-4a38-947d-ef38652969fe-tmp-dir\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883156 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e101cb6-425f-4c3c-87fb-eadc117d93bc-konnectivity-ca\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-run\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883173 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-systemd\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883207 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-host\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883225 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-modprobe-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-modprobe-d\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-systemd\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-host\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.883653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/553c3828-58db-4a38-947d-ef38652969fe-tmp-dir\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.884319 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.883873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e101cb6-425f-4c3c-87fb-eadc117d93bc-konnectivity-ca\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.885288 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.885254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-tmp\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.885520 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.885482 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-etc-tuned\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.885772 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.885752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e101cb6-425f-4c3c-87fb-eadc117d93bc-agent-certs\") pod \"konnectivity-agent-f7m5r\" (UID: \"6e101cb6-425f-4c3c-87fb-eadc117d93bc\") " pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:07.893988 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.893971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hckcf\" (UniqueName: \"kubernetes.io/projected/9813f9c9-9f2c-400a-acaa-b63c5708f3c5-kube-api-access-hckcf\") pod \"tuned-6m96c\" (UID: \"9813f9c9-9f2c-400a-acaa-b63c5708f3c5\") " pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:07.894068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.894055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2s4\" (UniqueName: \"kubernetes.io/projected/553c3828-58db-4a38-947d-ef38652969fe-kube-api-access-gl2s4\") pod \"node-resolver-ftfbj\" (UID: \"553c3828-58db-4a38-947d-ef38652969fe\") " pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:07.894204 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.894188 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46zm\" (UniqueName: \"kubernetes.io/projected/13932eed-1d3d-46d1-9bfc-4f9c54d62f5d-kube-api-access-c46zm\") pod \"node-ca-48wgk\" (UID: \"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d\") " pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:07.967210 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.967176 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cl52h" May 21 17:43:07.975472 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.975451 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dwqn" May 21 17:43:07.986252 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.986234 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:07.991826 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.991808 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" May 21 17:43:07.999388 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:07.999370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-plxxb" May 21 17:43:08.005952 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.005932 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48wgk" May 21 17:43:08.012524 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.012508 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:08.020053 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.020005 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6m96c" May 21 17:43:08.026560 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.026543 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftfbj" May 21 17:43:08.286980 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.286904 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:08.287130 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.287059 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:08.287187 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.287137 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:09.287117219 +0000 UTC m=+4.050412801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:08.383355 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.383287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e101cb6_425f_4c3c_87fb_eadc117d93bc.slice/crio-5c02551fd6e4e6b32c1bc9aa7f25563dadf605de3595089fc2c209c0d0adcd26 WatchSource:0}: Error finding container 5c02551fd6e4e6b32c1bc9aa7f25563dadf605de3595089fc2c209c0d0adcd26: Status 404 returned error can't find the container with id 5c02551fd6e4e6b32c1bc9aa7f25563dadf605de3595089fc2c209c0d0adcd26 May 21 17:43:08.386084 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.386058 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9a25f2_fb5a_4082_b0dc_e58001bd8269.slice/crio-6d2bf28aee9b74bf914af51c1c6a318d4f45b502abe5e4bbc0322d6caca6e8f3 WatchSource:0}: Error finding container 6d2bf28aee9b74bf914af51c1c6a318d4f45b502abe5e4bbc0322d6caca6e8f3: Status 404 returned error can't find the container with id 6d2bf28aee9b74bf914af51c1c6a318d4f45b502abe5e4bbc0322d6caca6e8f3 May 21 17:43:08.387431 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.387385 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:08.387562 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.387533 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:08.387627 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.387565 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:08.387627 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.387579 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:08.387714 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:08.387643 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:09.387616974 +0000 UTC m=+4.150912540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:08.389481 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.389455 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec5cd19_8573_49bd_85c0_69504d92dc74.slice/crio-b7d9d700d87d2c1cac3048b0c0800310ac00cdbe80bc6842dd6f377dc77332c6 WatchSource:0}: Error finding container b7d9d700d87d2c1cac3048b0c0800310ac00cdbe80bc6842dd6f377dc77332c6: Status 404 returned error can't find the container with id b7d9d700d87d2c1cac3048b0c0800310ac00cdbe80bc6842dd6f377dc77332c6 May 21 17:43:08.390179 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.390112 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9940eb66_5590_4034_81f8_bf733769bb41.slice/crio-b1a0003b30ef6655964859350549f9b3cb91f06b4b4b4a5a0b8fb5f9938cc674 WatchSource:0}: Error finding container b1a0003b30ef6655964859350549f9b3cb91f06b4b4b4a5a0b8fb5f9938cc674: Status 404 returned error can't find the container with id b1a0003b30ef6655964859350549f9b3cb91f06b4b4b4a5a0b8fb5f9938cc674 May 21 17:43:08.391149 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.391128 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9813f9c9_9f2c_400a_acaa_b63c5708f3c5.slice/crio-f4695876935aae6490f92846f70609e45226c80ab0768f2b55148935d9d84343 WatchSource:0}: Error finding container f4695876935aae6490f92846f70609e45226c80ab0768f2b55148935d9d84343: Status 404 returned error can't find the container with id f4695876935aae6490f92846f70609e45226c80ab0768f2b55148935d9d84343 May 21 17:43:08.391800 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.391710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdc2ab9_658b_4aeb_a097_6336d87cc9df.slice/crio-d44075ff9509e5fec18406027e534a680cb71d24a94e6741b3cd0ea08ff54414 WatchSource:0}: Error finding container d44075ff9509e5fec18406027e534a680cb71d24a94e6741b3cd0ea08ff54414: Status 404 returned error can't find the container with id d44075ff9509e5fec18406027e534a680cb71d24a94e6741b3cd0ea08ff54414 May 21 17:43:08.413217 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:08.413200 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13932eed_1d3d_46d1_9bfc_4f9c54d62f5d.slice/crio-602c72208494292990d471116b6fce5e0c8becefc3d062ca97b9ba0c60b11b06 WatchSource:0}: Error finding container 602c72208494292990d471116b6fce5e0c8becefc3d062ca97b9ba0c60b11b06: Status 404 returned error can't find the container with id 602c72208494292990d471116b6fce5e0c8becefc3d062ca97b9ba0c60b11b06 May 21 17:43:08.707315 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.707104 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:38:06 +0000 UTC" deadline="2027-10-31 05:56:36.297615807 +0000 UTC" May 21 17:43:08.707589 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.707316 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12660h13m27.590303276s" May 21 17:43:08.765423 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.765363 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48wgk" event={"ID":"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d","Type":"ContainerStarted","Data":"602c72208494292990d471116b6fce5e0c8becefc3d062ca97b9ba0c60b11b06"} May 21 17:43:08.767453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.767031 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" event={"ID":"7bdc2ab9-658b-4aeb-a097-6336d87cc9df","Type":"ContainerStarted","Data":"d44075ff9509e5fec18406027e534a680cb71d24a94e6741b3cd0ea08ff54414"} May 21 17:43:08.769317 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.769228 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6m96c" event={"ID":"9813f9c9-9f2c-400a-acaa-b63c5708f3c5","Type":"ContainerStarted","Data":"f4695876935aae6490f92846f70609e45226c80ab0768f2b55148935d9d84343"} May 21 17:43:08.772347 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.772306 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerStarted","Data":"b1a0003b30ef6655964859350549f9b3cb91f06b4b4b4a5a0b8fb5f9938cc674"} May 21 17:43:08.773838 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.773796 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-plxxb" event={"ID":"0ec5cd19-8573-49bd-85c0-69504d92dc74","Type":"ContainerStarted","Data":"b7d9d700d87d2c1cac3048b0c0800310ac00cdbe80bc6842dd6f377dc77332c6"} May 21 17:43:08.777425 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.777194 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" event={"ID":"611eecdfcb1ec0a5b7063b2d0d811571","Type":"ContainerStarted","Data":"2e67cd35cff639a87bd66d7ef48cacb49e74816f856285dcd5484b4ac3d75169"} May 21 17:43:08.796286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.787332 2565 generic.go:358] "Generic (PLEG): container finished" podID="2fe40143f031aeba447bcd02faec5391" containerID="c71155ac2cd7aa239a041bb334f4b44653be379f197430a495fbc435df0323c4" exitCode=0 May 21 17:43:08.796286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.787406 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" event={"ID":"2fe40143f031aeba447bcd02faec5391","Type":"ContainerDied","Data":"c71155ac2cd7aa239a041bb334f4b44653be379f197430a495fbc435df0323c4"} May 21 17:43:08.796286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.792954 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftfbj" event={"ID":"553c3828-58db-4a38-947d-ef38652969fe","Type":"ContainerStarted","Data":"7778919331eee915bbe98661cf52bd0806b14760e636be29b9a517ceba229289"} May 21 17:43:08.796286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.794318 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"4e02789c9e297a0c839544100db731a79227fae4ca3a15745b5e9096b2db3d86"} May 21 17:43:08.796837 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.796790 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dwqn" event={"ID":"8f9a25f2-fb5a-4082-b0dc-e58001bd8269","Type":"ContainerStarted","Data":"6d2bf28aee9b74bf914af51c1c6a318d4f45b502abe5e4bbc0322d6caca6e8f3"} May 21 17:43:08.799985 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.799947 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7m5r" event={"ID":"6e101cb6-425f-4c3c-87fb-eadc117d93bc","Type":"ContainerStarted","Data":"5c02551fd6e4e6b32c1bc9aa7f25563dadf605de3595089fc2c209c0d0adcd26"} May 21 17:43:08.808020 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:08.807962 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-214.ec2.internal" podStartSLOduration=1.807947591 podStartE2EDuration="1.807947591s" podCreationTimestamp="2026-05-21 17:43:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:43:08.791194987 +0000 UTC m=+3.554490576" watchObservedRunningTime="2026-05-21 17:43:08.807947591 +0000 UTC m=+3.571243180" May 21 17:43:09.293549 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.293451 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:43:09.296624 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.296575 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:09.296759 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.296741 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:09.296827 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.296804 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:11.29678714 +0000 UTC m=+6.060082715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:09.397365 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.397327 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:09.397626 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.397608 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:09.397691 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.397634 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:09.397691 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.397647 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:09.397802 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.397707 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:11.39768886 +0000 UTC m=+6.160984432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:09.757362 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.756648 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:09.757362 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.756795 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:09.757362 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.757208 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:09.757362 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:09.757312 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:09.813204 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.813169 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" event={"ID":"2fe40143f031aeba447bcd02faec5391","Type":"ContainerStarted","Data":"1a17101d4ea4e3a23cd05363f5374d68559e06eab2446199bdcb8b2cbff23305"} May 21 17:43:09.826958 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:09.826910 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-214.ec2.internal" podStartSLOduration=2.826893926 podStartE2EDuration="2.826893926s" podCreationTimestamp="2026-05-21 17:43:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:43:09.826291775 +0000 UTC m=+4.589587364" watchObservedRunningTime="2026-05-21 17:43:09.826893926 +0000 UTC m=+4.590189517" May 21 17:43:11.312622 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:11.311846 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:11.312622 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.312059 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:11.312622 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.312213 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:15.312193722 +0000 UTC m=+10.075489292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:11.412442 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:11.412402 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:11.412645 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.412579 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:11.412645 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.412600 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:11.412645 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.412612 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:11.412865 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.412672 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:15.412653282 +0000 UTC m=+10.175948903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:11.755086 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:11.755009 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:11.755252 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.755129 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:11.757769 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:11.757746 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:11.757892 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:11.757866 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:13.754904 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:13.754866 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:13.755370 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:13.755001 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:13.755370 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:13.755109 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:13.755370 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:13.755336 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:15.343832 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:15.343800 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:15.344410 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.343930 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:15.344410 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.343994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:23.343975543 +0000 UTC m=+18.107271127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:15.444914 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:15.444877 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:15.445079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.445050 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:15.445079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.445068 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:15.445079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.445080 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:15.445235 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.445144 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:23.445117772 +0000 UTC m=+18.208413344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:15.755556 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:15.755461 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:15.755716 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.755598 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:15.755955 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:15.755803 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:15.755955 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:15.755915 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:17.754543 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:17.754507 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:17.755199 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:17.754507 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:17.755199 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:17.754652 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:17.755199 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:17.754671 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:19.754717 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:19.754678 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:19.755072 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:19.754683 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:19.755072 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:19.754816 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:19.755072 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:19.754874 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:21.754373 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:21.754339 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:21.754373 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:21.754356 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:21.754959 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:21.754463 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:21.754959 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:21.754618 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:23.409386 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:23.409342 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:23.409802 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.409518 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:23.409802 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.409582 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:39.409565517 +0000 UTC m=+34.172861084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:23.510499 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:23.510451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:23.510670 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.510586 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:23.510670 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.510604 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:23.510670 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.510613 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:23.510670 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.510654 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:39.510641251 +0000 UTC m=+34.273936817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:23.754716 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:23.754639 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:23.754858 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.754742 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:23.754858 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:23.754836 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:23.754978 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:23.754955 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:24.608978 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.608944 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qr5gz"] May 21 17:43:24.715888 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.715855 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.716067 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:24.715948 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:24.817900 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.817865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-kubelet-config\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.818047 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.817930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-dbus\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.818047 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.818024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919081 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.919002 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-dbus\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919081 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.919068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919270 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.919114 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-kubelet-config\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919270 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.919180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-kubelet-config\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919270 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:24.919208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-dbus\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:24.919392 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:24.919264 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:43:24.919392 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:24.919334 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret podName:c1cc59a9-f3ea-49db-bb46-66193ecdcbb3 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:25.419317326 +0000 UTC m=+20.182612897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret") pod "global-pull-secret-syncer-qr5gz" (UID: "c1cc59a9-f3ea-49db-bb46-66193ecdcbb3") : object "kube-system"/"original-pull-secret" not registered May 21 17:43:25.422230 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:25.422201 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:25.422425 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:25.422327 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:43:25.422425 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:25.422393 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret podName:c1cc59a9-f3ea-49db-bb46-66193ecdcbb3 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:26.422375195 +0000 UTC m=+21.185670761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret") pod "global-pull-secret-syncer-qr5gz" (UID: "c1cc59a9-f3ea-49db-bb46-66193ecdcbb3") : object "kube-system"/"original-pull-secret" not registered May 21 17:43:25.754750 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:25.754680 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:25.755087 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:25.754762 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:25.755087 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:25.754849 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:25.755087 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:25.754945 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:26.431456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.431277 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:26.431568 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:26.431434 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:43:26.431634 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:26.431582 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret podName:c1cc59a9-f3ea-49db-bb46-66193ecdcbb3 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:28.431560544 +0000 UTC m=+23.194856123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret") pod "global-pull-secret-syncer-qr5gz" (UID: "c1cc59a9-f3ea-49db-bb46-66193ecdcbb3") : object "kube-system"/"original-pull-secret" not registered May 21 17:43:26.755133 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.754968 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:26.755688 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:26.755220 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:26.842355 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.842322 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6m96c" event={"ID":"9813f9c9-9f2c-400a-acaa-b63c5708f3c5","Type":"ContainerStarted","Data":"07a25e5620fee98efcb6e146e2806055663f4273765325e8e0be3e2fc4c435a6"} May 21 17:43:26.843904 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.843851 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="8c9ee8ddbfdf36dc7a1f87d529a874bd0342071abb145343a711016d7be6b09b" exitCode=0 May 21 17:43:26.844025 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.843958 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"8c9ee8ddbfdf36dc7a1f87d529a874bd0342071abb145343a711016d7be6b09b"} May 21 17:43:26.845830 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.845804 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-plxxb" event={"ID":"0ec5cd19-8573-49bd-85c0-69504d92dc74","Type":"ContainerStarted","Data":"3afab6c93cdf4bf1bb8e95c6e7fce24186770864312c976d61ab5132fb853c70"} May 21 17:43:26.847749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.847708 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftfbj" event={"ID":"553c3828-58db-4a38-947d-ef38652969fe","Type":"ContainerStarted","Data":"7f365c848fa7fee53d0c58b804b72af668209a1a329fff42d13ea7c9ab35313b"} May 21 17:43:26.852183 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.852163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:43:26.854533 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854464 2565 generic.go:358] "Generic (PLEG): container finished" podID="71a34b9a-570b-46cd-94da-2d423ac89e74" containerID="366b10196a8aeac248300cdb3d8ec33b7e8075ee088bb9d81e4054390ee138b4" exitCode=1 May 21 17:43:26.854646 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854521 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"d9cd3a836a4402c969dfb4ea162e1af272c2d6a392a46513bf1e6409d3cd5b16"} May 21 17:43:26.854720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854665 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"2bdfa98b73e80fcb9df7dfbbcab83d9b48908bcf5fbfbef9da88bc5e878327a4"} May 21 17:43:26.854720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854690 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"8cc65d7d67dd044a2090f3ceb1c450ddf83fabbd5dcc6aadd76fb5a0f969a8b8"} May 21 17:43:26.854720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854703 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"df6127af90525ea93148c408d3ad29be77e8169903b3b405aff89b29af3cf4d0"} May 21 17:43:26.854720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854714 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerDied","Data":"366b10196a8aeac248300cdb3d8ec33b7e8075ee088bb9d81e4054390ee138b4"} May 21 17:43:26.854896 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.854728 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"6418b556510289b543733f4f34d0e9477192a5b5240b6aa00c6ca94e15723aae"} May 21 17:43:26.856236 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.856214 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7m5r" event={"ID":"6e101cb6-425f-4c3c-87fb-eadc117d93bc","Type":"ContainerStarted","Data":"b5b774ee1fed76bf96beddd65bdb19a801194693ebbd812f03d0cec510d460c6"} May 21 17:43:26.857986 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.857946 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6m96c" podStartSLOduration=4.180655587 podStartE2EDuration="21.857933853s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.412327843 +0000 UTC m=+3.175623426" lastFinishedPulling="2026-05-21 17:43:26.089606118 +0000 UTC m=+20.852901692" observedRunningTime="2026-05-21 17:43:26.857322808 +0000 UTC m=+21.620618399" watchObservedRunningTime="2026-05-21 17:43:26.857933853 +0000 UTC m=+21.621229443" May 21 17:43:26.858686 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.858662 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48wgk" event={"ID":"13932eed-1d3d-46d1-9bfc-4f9c54d62f5d","Type":"ContainerStarted","Data":"2e2492bcdda04130a3e79ce005d58f2d64ebbb39650176f04157d53f45fd4930"} May 21 17:43:26.860701 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.860680 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" event={"ID":"7bdc2ab9-658b-4aeb-a097-6336d87cc9df","Type":"ContainerStarted","Data":"a70a1d1ec6bd2faaf16da3f63ae602907a46461ada2405d786cdc1ecbb2bc653"} May 21 17:43:26.870722 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.870682 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ftfbj" podStartSLOduration=4.200346498 podStartE2EDuration="21.870672517s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.41926282 +0000 UTC m=+3.182558389" lastFinishedPulling="2026-05-21 17:43:26.089588822 +0000 UTC m=+20.852884408" observedRunningTime="2026-05-21 17:43:26.870563073 +0000 UTC m=+21.633858658" watchObservedRunningTime="2026-05-21 17:43:26.870672517 +0000 UTC m=+21.633968107" May 21 17:43:26.885552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.885506 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-plxxb" podStartSLOduration=4.143857374 podStartE2EDuration="21.88547758s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.391416164 +0000 UTC m=+3.154711744" lastFinishedPulling="2026-05-21 17:43:26.133036381 +0000 UTC m=+20.896331950" observedRunningTime="2026-05-21 17:43:26.885347885 +0000 UTC m=+21.648643484" watchObservedRunningTime="2026-05-21 17:43:26.88547758 +0000 UTC m=+21.648773167" May 21 17:43:26.898274 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.898242 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f7m5r" podStartSLOduration=4.193915945 podStartE2EDuration="21.898232275s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.385359807 +0000 UTC m=+3.148655388" lastFinishedPulling="2026-05-21 17:43:26.089676139 +0000 UTC m=+20.852971718" observedRunningTime="2026-05-21 17:43:26.89777099 +0000 UTC m=+21.661066600" watchObservedRunningTime="2026-05-21 17:43:26.898232275 +0000 UTC m=+21.661527863" May 21 17:43:26.931346 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:26.931316 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-48wgk" podStartSLOduration=12.198752117 podStartE2EDuration="21.931306809s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.4193551 +0000 UTC m=+3.182650666" lastFinishedPulling="2026-05-21 17:43:18.151909789 +0000 UTC m=+12.915205358" observedRunningTime="2026-05-21 17:43:26.931215509 +0000 UTC m=+21.694511097" watchObservedRunningTime="2026-05-21 17:43:26.931306809 +0000 UTC m=+21.694602379" May 21 17:43:27.539426 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.539402 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 17:43:27.738235 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.738065 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T17:43:27.539423076Z","UUID":"3ca81ab7-18b9-4bd4-9f6e-5635edcf7ab8","Handler":null,"Name":"","Endpoint":""} May 21 17:43:27.740603 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.740561 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 17:43:27.740603 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.740597 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 17:43:27.754260 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.754158 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:27.754386 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:27.754269 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:27.754386 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.754307 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:27.754524 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:27.754422 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:27.875543 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.875519 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" event={"ID":"7bdc2ab9-658b-4aeb-a097-6336d87cc9df","Type":"ContainerStarted","Data":"8c062b7823338041be92f3470073fc02f044ce30e0c07b1dcb4b693eea87b28d"} May 21 17:43:27.876857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.876830 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dwqn" event={"ID":"8f9a25f2-fb5a-4082-b0dc-e58001bd8269","Type":"ContainerStarted","Data":"c306d318a4ecbef783ad80df57dc7df23a49e2e5fc2d0a1618a44b3e27089cb7"} May 21 17:43:27.895464 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:27.895417 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7dwqn" podStartSLOduration=5.194308354 podStartE2EDuration="22.895401162s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.388528675 +0000 UTC m=+3.151824245" lastFinishedPulling="2026-05-21 17:43:26.089621468 +0000 UTC m=+20.852917053" observedRunningTime="2026-05-21 17:43:27.89490382 +0000 UTC m=+22.658199440" watchObservedRunningTime="2026-05-21 17:43:27.895401162 +0000 UTC m=+22.658696830" May 21 17:43:28.447852 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.447812 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:28.448012 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:28.447973 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:43:28.448085 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:28.448057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret podName:c1cc59a9-f3ea-49db-bb46-66193ecdcbb3 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:32.448035466 +0000 UTC m=+27.211331049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret") pod "global-pull-secret-syncer-qr5gz" (UID: "c1cc59a9-f3ea-49db-bb46-66193ecdcbb3") : object "kube-system"/"original-pull-secret" not registered May 21 17:43:28.754573 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.754533 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:28.754839 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:28.754663 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:28.765630 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.765609 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:28.766236 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.766219 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:28.881034 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.881000 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" event={"ID":"7bdc2ab9-658b-4aeb-a097-6336d87cc9df","Type":"ContainerStarted","Data":"cdf9933b80782088910fa109d5de9611873ef0dfd8f66d0d95958fe0a5393b8c"} May 21 17:43:28.896658 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:28.896479 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzpks" podStartSLOduration=3.61045725 podStartE2EDuration="23.896467557s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.412241005 +0000 UTC m=+3.175536574" lastFinishedPulling="2026-05-21 17:43:28.698251303 +0000 UTC m=+23.461546881" observedRunningTime="2026-05-21 17:43:28.896028442 +0000 UTC m=+23.659324030" watchObservedRunningTime="2026-05-21 17:43:28.896467557 +0000 UTC m=+23.659763144" May 21 17:43:29.754521 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:29.754473 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:29.754735 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:29.754610 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:29.754735 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:29.754674 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:29.754875 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:29.754851 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:29.887245 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:29.887206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:43:29.887784 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:29.887766 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 17:43:29.887863 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:29.887761 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"455b4295b88c4615d43d5f5aa9b0dc025dc7e4fbe6c1a29b135602b4ed471394"} May 21 17:43:30.755106 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:30.755067 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:30.755283 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:30.755183 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:31.754463 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.754287 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:31.755216 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.754340 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:31.755216 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:31.754801 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:31.755216 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:31.754937 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:31.892754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.892733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:43:31.893086 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.893061 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"16a51e019cd760cd51dc41240a601f2f5040488702c3d8771f960c08b4aa9f16"} May 21 17:43:31.893364 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.893344 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:31.893482 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.893369 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:31.893574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.893557 2565 scope.go:117] "RemoveContainer" containerID="366b10196a8aeac248300cdb3d8ec33b7e8075ee088bb9d81e4054390ee138b4" May 21 17:43:31.894711 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.894689 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="01d67873ef280fcfac7fccc067c912334292dbaee9f32cbdc08176d481e6a297" exitCode=0 May 21 17:43:31.894811 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.894732 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"01d67873ef280fcfac7fccc067c912334292dbaee9f32cbdc08176d481e6a297"} May 21 17:43:31.908678 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:31.908660 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:32.482122 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.482089 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:32.482290 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:32.482234 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:43:32.482356 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:32.482302 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret podName:c1cc59a9-f3ea-49db-bb46-66193ecdcbb3 nodeName:}" failed. No retries permitted until 2026-05-21 17:43:40.482283434 +0000 UTC m=+35.245579004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret") pod "global-pull-secret-syncer-qr5gz" (UID: "c1cc59a9-f3ea-49db-bb46-66193ecdcbb3") : object "kube-system"/"original-pull-secret" not registered May 21 17:43:32.754877 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.754788 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:32.755241 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:32.754904 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:32.899541 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.899512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:43:32.899869 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.899836 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" event={"ID":"71a34b9a-570b-46cd-94da-2d423ac89e74","Type":"ContainerStarted","Data":"d8a170ff0ebdb5b1efe16350cb1874152a73c4bc43fa808a36b6fb4592a6f17f"} May 21 17:43:32.900040 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.900024 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:32.901797 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.901776 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="c5773a4162e037835e525582b7e81dd0d3958924d0e5d5f985c32cfbecb950f7" exitCode=0 May 21 17:43:32.901889 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.901812 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"c5773a4162e037835e525582b7e81dd0d3958924d0e5d5f985c32cfbecb950f7"} May 21 17:43:32.923075 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.923040 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:43:32.946283 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:32.946227 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" podStartSLOduration=10.250175485 podStartE2EDuration="27.946210799s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.419351384 +0000 UTC m=+3.182646963" lastFinishedPulling="2026-05-21 17:43:26.115386699 +0000 UTC m=+20.878682277" observedRunningTime="2026-05-21 17:43:32.945414532 +0000 UTC m=+27.708710119" watchObservedRunningTime="2026-05-21 17:43:32.946210799 +0000 UTC m=+27.709506368" May 21 17:43:33.515905 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.515875 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvbql"] May 21 17:43:33.516043 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.516030 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:33.516147 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:33.516128 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:33.519077 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.519056 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nf2kh"] May 21 17:43:33.519189 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.519172 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:33.519310 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:33.519287 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:33.519816 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.519796 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qr5gz"] May 21 17:43:33.519908 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.519897 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:33.519987 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:33.519971 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:33.905150 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.905121 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="67d886716dd0b490276f81917190b0eaf830c5875f000418cac291472697df4e" exitCode=0 May 21 17:43:33.905595 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:33.905215 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"67d886716dd0b490276f81917190b0eaf830c5875f000418cac291472697df4e"} May 21 17:43:35.755914 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:35.755735 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:35.756293 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:35.755806 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:35.756293 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:35.755990 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:35.756293 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:35.756069 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:35.756293 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:35.755835 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:35.756293 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:35.756163 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:36.034785 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:36.034753 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:36.035041 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:36.034886 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 17:43:36.035421 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:36.035394 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f7m5r" May 21 17:43:37.754159 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:37.754130 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:37.754593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:37.754130 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:37.754593 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:37.754235 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:43:37.754593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:37.754136 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:37.754593 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:37.754296 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qr5gz" podUID="c1cc59a9-f3ea-49db-bb46-66193ecdcbb3" May 21 17:43:37.754593 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:37.754378 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rvbql" podUID="6e56f168-53fb-4800-b612-5b1824b79e23" May 21 17:43:39.039783 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.039719 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-214.ec2.internal" event="NodeReady" May 21 17:43:39.040272 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.039843 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 17:43:39.091251 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.091213 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrr4"] May 21 17:43:39.095839 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.095814 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p5d42"] May 21 17:43:39.095971 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.095933 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.098133 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.098032 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 17:43:39.098249 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.098197 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 17:43:39.098249 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.098202 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5t9n8\"" May 21 17:43:39.098352 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.098281 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 17:43:39.099625 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.099604 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.101346 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.101326 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrr4"] May 21 17:43:39.101889 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.101867 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 17:43:39.101973 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.101916 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5rz\"" May 21 17:43:39.102281 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.102256 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 17:43:39.117350 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.117330 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5d42"] May 21 17:43:39.231726 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.231696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd8e22-15ef-4872-b966-d7a7ca24707f-config-volume\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.231899 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.231763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cd8e22-15ef-4872-b966-d7a7ca24707f-tmp-dir\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.231899 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.231824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5spd\" (UniqueName: \"kubernetes.io/projected/51cd8e22-15ef-4872-b966-d7a7ca24707f-kube-api-access-r5spd\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.231899 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.231879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.232060 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.231936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.232060 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.232037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn5t9\" (UniqueName: \"kubernetes.io/projected/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-kube-api-access-bn5t9\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.332613 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332578 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5spd\" (UniqueName: \"kubernetes.io/projected/51cd8e22-15ef-4872-b966-d7a7ca24707f-kube-api-access-r5spd\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.332758 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332631 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.332758 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332662 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.332758 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332746 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn5t9\" (UniqueName: \"kubernetes.io/projected/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-kube-api-access-bn5t9\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.332882 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.332751 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:39.332882 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.332812 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:43:39.832797373 +0000 UTC m=+34.596092944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:43:39.332882 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.332851 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:39.332882 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332870 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd8e22-15ef-4872-b966-d7a7ca24707f-config-volume\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.333045 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.332896 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cd8e22-15ef-4872-b966-d7a7ca24707f-tmp-dir\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.333045 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.332908 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:43:39.832890883 +0000 UTC m=+34.596186464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:39.333239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.333219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cd8e22-15ef-4872-b966-d7a7ca24707f-tmp-dir\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.333469 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.333453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51cd8e22-15ef-4872-b966-d7a7ca24707f-config-volume\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.344928 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.344906 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5spd\" (UniqueName: \"kubernetes.io/projected/51cd8e22-15ef-4872-b966-d7a7ca24707f-kube-api-access-r5spd\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.345029 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.344975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn5t9\" (UniqueName: \"kubernetes.io/projected/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-kube-api-access-bn5t9\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.434089 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.434050 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:39.434243 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.434164 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:39.434243 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.434231 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:44:11.434212361 +0000 UTC m=+66.197507949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:43:39.534963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.534932 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:39.535125 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.535096 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:43:39.535125 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.535117 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:43:39.535125 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.535127 2565 projected.go:194] Error preparing data for projected volume kube-api-access-29phr for pod openshift-network-diagnostics/network-check-target-rvbql: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:39.535288 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.535188 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr podName:6e56f168-53fb-4800-b612-5b1824b79e23 nodeName:}" failed. No retries permitted until 2026-05-21 17:44:11.53517066 +0000 UTC m=+66.298466243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-29phr" (UniqueName: "kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr") pod "network-check-target-rvbql" (UID: "6e56f168-53fb-4800-b612-5b1824b79e23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:43:39.755097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.755010 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:39.755097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.755035 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:43:39.755315 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.755144 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:43:39.758582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758462 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4sh9\"" May 21 17:43:39.758582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758529 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 17:43:39.758582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758535 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kt2hm\"" May 21 17:43:39.758795 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758602 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 17:43:39.758795 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758462 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:43:39.758795 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.758717 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 17:43:39.837427 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.837400 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:39.837568 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:39.837433 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:39.837631 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.837589 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:39.837685 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.837643 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:39.837685 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.837656 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:43:40.83763696 +0000 UTC m=+35.600932536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:43:39.837778 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:39.837693 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:43:40.837676994 +0000 UTC m=+35.600972564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:40.543987 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.543953 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:40.546227 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.546209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1cc59a9-f3ea-49db-bb46-66193ecdcbb3-original-pull-secret\") pod \"global-pull-secret-syncer-qr5gz\" (UID: \"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3\") " pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:40.666983 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.666953 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qr5gz" May 21 17:43:40.847061 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.846878 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:40.847061 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.847042 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:40.847209 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:40.847013 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:40.847209 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:40.847155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:43:42.847139052 +0000 UTC m=+37.610434623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:43:40.847209 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:40.847172 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:40.847318 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:40.847215 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:43:42.847203649 +0000 UTC m=+37.610499216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:40.850389 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.850363 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qr5gz"] May 21 17:43:40.859991 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:43:40.859972 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cc59a9_f3ea_49db_bb46_66193ecdcbb3.slice/crio-ea29207eb580558aec4cefd05ea104e381ed630005c55c7d1095467f4717ef3b WatchSource:0}: Error finding container ea29207eb580558aec4cefd05ea104e381ed630005c55c7d1095467f4717ef3b: Status 404 returned error can't find the container with id ea29207eb580558aec4cefd05ea104e381ed630005c55c7d1095467f4717ef3b May 21 17:43:40.919652 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.919629 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="c34b5fdf8a6d5c923962f2503e315e00b2de7a1b9b7719dea3fbad087d6627da" exitCode=0 May 21 17:43:40.919745 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.919709 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"c34b5fdf8a6d5c923962f2503e315e00b2de7a1b9b7719dea3fbad087d6627da"} May 21 17:43:40.920639 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:40.920622 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qr5gz" event={"ID":"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3","Type":"ContainerStarted","Data":"ea29207eb580558aec4cefd05ea104e381ed630005c55c7d1095467f4717ef3b"} May 21 17:43:41.925789 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:41.925752 2565 generic.go:358] "Generic (PLEG): container finished" podID="9940eb66-5590-4034-81f8-bf733769bb41" containerID="330eef3e52cbf625c45990a302f9985f047b3ba6769e8c41ef4a2b0272cfff8e" exitCode=0 May 21 17:43:41.926206 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:41.925808 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerDied","Data":"330eef3e52cbf625c45990a302f9985f047b3ba6769e8c41ef4a2b0272cfff8e"} May 21 17:43:42.862803 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:42.862763 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:42.862981 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:42.862817 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:42.862981 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:42.862921 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:42.863079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:42.862983 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:43:46.862967957 +0000 UTC m=+41.626263523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:42.863079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:42.862921 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:42.863079 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:42.863027 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:43:46.863017471 +0000 UTC m=+41.626313041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:43:42.930651 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:42.930619 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl52h" event={"ID":"9940eb66-5590-4034-81f8-bf733769bb41","Type":"ContainerStarted","Data":"7f0ae3e3a845892cfe42af57dc6dee9c756d5d214fc16fcea4e3a16d2deaf10b"} May 21 17:43:42.955573 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:42.954394 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cl52h" podStartSLOduration=6.031278033 podStartE2EDuration="37.954372973s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:43:08.412229871 +0000 UTC m=+3.175525436" lastFinishedPulling="2026-05-21 17:43:40.335324798 +0000 UTC m=+35.098620376" observedRunningTime="2026-05-21 17:43:42.950221769 +0000 UTC m=+37.713517369" watchObservedRunningTime="2026-05-21 17:43:42.954372973 +0000 UTC m=+37.717668564" May 21 17:43:44.935670 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:44.935410 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qr5gz" event={"ID":"c1cc59a9-f3ea-49db-bb46-66193ecdcbb3","Type":"ContainerStarted","Data":"ec4ded1d68012ffa4559f59ddf6e63393945ed9ce6fd3a6a1f22ceea4a96f272"} May 21 17:43:44.949599 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:44.949549 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qr5gz" podStartSLOduration=17.157883059 podStartE2EDuration="20.949536386s" podCreationTimestamp="2026-05-21 17:43:24 +0000 UTC" firstStartedPulling="2026-05-21 17:43:40.861632341 +0000 UTC m=+35.624927907" lastFinishedPulling="2026-05-21 17:43:44.653285668 +0000 UTC m=+39.416581234" observedRunningTime="2026-05-21 17:43:44.94948043 +0000 UTC m=+39.712776017" watchObservedRunningTime="2026-05-21 17:43:44.949536386 +0000 UTC m=+39.712831952" May 21 17:43:46.887563 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:46.887531 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:46.887563 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:46.887565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:46.887938 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:46.887678 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:46.887938 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:46.887730 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:43:54.887716264 +0000 UTC m=+49.651011830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:46.887938 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:46.887678 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:46.887938 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:46.887809 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:43:54.887797654 +0000 UTC m=+49.651093235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:43:54.935453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:54.935415 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:43:54.935453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:43:54.935453 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:43:54.935946 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:54.935568 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:43:54.935946 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:54.935570 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:43:54.935946 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:54.935634 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:44:10.93562019 +0000 UTC m=+65.698915769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:43:54.935946 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:43:54.935648 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:44:10.935641582 +0000 UTC m=+65.698937148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:44:04.918070 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:04.918017 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92r2p" May 21 17:44:10.937721 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:10.937684 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:44:10.937721 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:10.937722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:44:10.938128 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:10.937821 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:44:10.938128 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:10.937877 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:44:42.937862909 +0000 UTC m=+97.701158487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:44:10.938128 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:10.937889 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:44:10.938128 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:10.937934 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:44:42.937923076 +0000 UTC m=+97.701218653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:44:11.440566 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.440531 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:44:11.443277 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.443257 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:44:11.451168 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:11.451151 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:44:11.451243 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:11.451205 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:45:15.451188481 +0000 UTC m=+130.214484046 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : secret "metrics-daemon-secret" not found May 21 17:44:11.541049 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.541017 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:44:11.543448 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.543432 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 17:44:11.553205 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.553187 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 17:44:11.565613 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.565587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/6e56f168-53fb-4800-b612-5b1824b79e23-kube-api-access-29phr\") pod \"network-check-target-rvbql\" (UID: \"6e56f168-53fb-4800-b612-5b1824b79e23\") " pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:44:11.581369 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.581344 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kt2hm\"" May 21 17:44:11.590024 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.590004 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:44:11.704217 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.704151 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rvbql"] May 21 17:44:11.708656 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:44:11.708628 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e56f168_53fb_4800_b612_5b1824b79e23.slice/crio-e10d56dd262e77ca089645139e27d2482c79c12bde8ff692ebc7ab2e0d2d5930 WatchSource:0}: Error finding container e10d56dd262e77ca089645139e27d2482c79c12bde8ff692ebc7ab2e0d2d5930: Status 404 returned error can't find the container with id e10d56dd262e77ca089645139e27d2482c79c12bde8ff692ebc7ab2e0d2d5930 May 21 17:44:11.984179 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:11.984099 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvbql" event={"ID":"6e56f168-53fb-4800-b612-5b1824b79e23","Type":"ContainerStarted","Data":"e10d56dd262e77ca089645139e27d2482c79c12bde8ff692ebc7ab2e0d2d5930"} May 21 17:44:14.991061 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:14.990990 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rvbql" event={"ID":"6e56f168-53fb-4800-b612-5b1824b79e23","Type":"ContainerStarted","Data":"939d06ad0522b8433138f1765ff0ac170c309d497485878e65e7ff786a0e01fd"} May 21 17:44:14.991363 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:14.991192 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:44:42.940327 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:42.940191 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:44:42.940327 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:42.940232 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:44:42.940826 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:42.940328 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:44:42.940826 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:42.940365 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:44:42.940826 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:42.940412 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert podName:19c33939-51c8-4ab9-9c8a-110c98d1d6fc nodeName:}" failed. No retries permitted until 2026-05-21 17:45:46.940394316 +0000 UTC m=+161.703689895 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert") pod "ingress-canary-4nrr4" (UID: "19c33939-51c8-4ab9-9c8a-110c98d1d6fc") : secret "canary-serving-cert" not found May 21 17:44:42.940826 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:44:42.940429 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls podName:51cd8e22-15ef-4872-b966-d7a7ca24707f nodeName:}" failed. No retries permitted until 2026-05-21 17:45:46.940421287 +0000 UTC m=+161.703716866 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls") pod "dns-default-p5d42" (UID: "51cd8e22-15ef-4872-b966-d7a7ca24707f") : secret "dns-default-metrics-tls" not found May 21 17:44:45.995064 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:45.995036 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rvbql" May 21 17:44:46.009593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:44:46.009546 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rvbql" podStartSLOduration=98.142818718 podStartE2EDuration="1m41.009533682s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:44:11.710331773 +0000 UTC m=+66.473627339" lastFinishedPulling="2026-05-21 17:44:14.577046737 +0000 UTC m=+69.340342303" observedRunningTime="2026-05-21 17:44:15.007572467 +0000 UTC m=+69.770868068" watchObservedRunningTime="2026-05-21 17:44:46.009533682 +0000 UTC m=+100.772829270" May 21 17:45:15.545786 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:15.545733 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:45:15.546297 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:15.545875 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:45:15.546297 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:15.545956 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs podName:7d1f90c2-c4a5-4731-a31b-b3c9b5330e49 nodeName:}" failed. No retries permitted until 2026-05-21 17:47:17.545939755 +0000 UTC m=+252.309235321 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs") pod "network-metrics-daemon-nf2kh" (UID: "7d1f90c2-c4a5-4731-a31b-b3c9b5330e49") : secret "metrics-daemon-secret" not found May 21 17:45:16.551735 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.551702 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:45:16.554433 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.554416 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.556899 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.556867 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 17:45:16.557036 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.557019 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qnr4m\"" May 21 17:45:16.557197 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.557169 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 17:45:16.557331 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.557313 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 17:45:16.562070 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.561972 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 17:45:16.568350 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.568324 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:45:16.650921 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.650902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651069 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.650928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651069 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.650946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651069 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.650962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651069 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.651030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmhz\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651261 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.651090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651261 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.651150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651261 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.651173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.651897 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.651876 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw"] May 21 17:45:16.654598 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.654578 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" May 21 17:45:16.656981 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.656963 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 17:45:16.657141 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.657124 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 17:45:16.657323 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.657311 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r6w24\"" May 21 17:45:16.662983 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.662962 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw"] May 21 17:45:16.751956 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.751927 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmhz\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752081 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.751988 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752081 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslkx\" (UniqueName: \"kubernetes.io/projected/cd25a913-3b51-44ed-aaaf-a75c6e37238d-kube-api-access-bslkx\") pod \"volume-data-source-validator-5cf8c89d64-fvdkw\" (UID: \"cd25a913-3b51-44ed-aaaf-a75c6e37238d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" May 21 17:45:16.752081 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752065 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752092 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752142 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752181 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752211 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752236 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752481 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:16.752251 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:45:16.752481 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:16.752270 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6bd5476d-7mjzk: secret "image-registry-tls" not found May 21 17:45:16.752481 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:16.752331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls podName:85033e0e-05c4-4876-a2c1-8b2436af2f4d nodeName:}" failed. No retries permitted until 2026-05-21 17:45:17.252310816 +0000 UTC m=+132.015606397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls") pod "image-registry-5c6bd5476d-7mjzk" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d") : secret "image-registry-tls" not found May 21 17:45:16.752481 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.752805 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.752780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.753037 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.753016 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.754644 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.754616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.754825 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.754660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.755433 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.755413 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qh4k2"] May 21 17:45:16.758349 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.758333 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.760582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.760565 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 17:45:16.760844 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.760825 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 17:45:16.761117 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.761096 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 17:45:16.761207 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.761156 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 17:45:16.761650 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.761633 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lwqbj\"" May 21 17:45:16.766461 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.766441 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 17:45:16.769113 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.769093 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qh4k2"] May 21 17:45:16.772076 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.772051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.772169 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.772150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmhz\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:16.853325 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.853307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-trusted-ca\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.853418 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.853372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-config\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.853418 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.853393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bslkx\" (UniqueName: \"kubernetes.io/projected/cd25a913-3b51-44ed-aaaf-a75c6e37238d-kube-api-access-bslkx\") pod \"volume-data-source-validator-5cf8c89d64-fvdkw\" (UID: \"cd25a913-3b51-44ed-aaaf-a75c6e37238d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" May 21 17:45:16.853507 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.853436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-serving-cert\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.853550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.853511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88np\" (UniqueName: \"kubernetes.io/projected/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-kube-api-access-r88np\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.860343 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.860320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslkx\" (UniqueName: \"kubernetes.io/projected/cd25a913-3b51-44ed-aaaf-a75c6e37238d-kube-api-access-bslkx\") pod \"volume-data-source-validator-5cf8c89d64-fvdkw\" (UID: \"cd25a913-3b51-44ed-aaaf-a75c6e37238d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" May 21 17:45:16.954720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.954696 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-config\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.954801 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.954725 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-serving-cert\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.954801 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.954751 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r88np\" (UniqueName: \"kubernetes.io/projected/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-kube-api-access-r88np\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.954868 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.954833 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-trusted-ca\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.955453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.955433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-config\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.955558 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.955483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-trusted-ca\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.956734 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.956716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-serving-cert\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.962359 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.962337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88np\" (UniqueName: \"kubernetes.io/projected/a1e5afee-bcfd-4881-9b50-e7ec2801a9ae-kube-api-access-r88np\") pod \"console-operator-76dff48d59-qh4k2\" (UID: \"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae\") " pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:16.962427 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:16.962388 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" May 21 17:45:17.070950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:17.070924 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:17.075298 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:17.075270 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw"] May 21 17:45:17.078177 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:17.078150 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd25a913_3b51_44ed_aaaf_a75c6e37238d.slice/crio-2211b330a6cb6d273be223f2e17c5c446d0f1228f84e63b31518bc0bf52bf92b WatchSource:0}: Error finding container 2211b330a6cb6d273be223f2e17c5c446d0f1228f84e63b31518bc0bf52bf92b: Status 404 returned error can't find the container with id 2211b330a6cb6d273be223f2e17c5c446d0f1228f84e63b31518bc0bf52bf92b May 21 17:45:17.104582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:17.104516 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" event={"ID":"cd25a913-3b51-44ed-aaaf-a75c6e37238d","Type":"ContainerStarted","Data":"2211b330a6cb6d273be223f2e17c5c446d0f1228f84e63b31518bc0bf52bf92b"} May 21 17:45:17.184023 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:17.183997 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qh4k2"] May 21 17:45:17.186792 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:17.186760 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e5afee_bcfd_4881_9b50_e7ec2801a9ae.slice/crio-4ce8a85d68f71ee27d195e2284245d3365d7caab73065b94af838986ec0a6916 WatchSource:0}: Error finding container 4ce8a85d68f71ee27d195e2284245d3365d7caab73065b94af838986ec0a6916: Status 404 returned error can't find the container with id 4ce8a85d68f71ee27d195e2284245d3365d7caab73065b94af838986ec0a6916 May 21 17:45:17.258157 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:17.258128 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:17.258279 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:17.258261 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:45:17.258320 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:17.258281 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6bd5476d-7mjzk: secret "image-registry-tls" not found May 21 17:45:17.258352 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:17.258327 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls podName:85033e0e-05c4-4876-a2c1-8b2436af2f4d nodeName:}" failed. No retries permitted until 2026-05-21 17:45:18.258313539 +0000 UTC m=+133.021609111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls") pod "image-registry-5c6bd5476d-7mjzk" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d") : secret "image-registry-tls" not found May 21 17:45:18.107483 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:18.107439 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" event={"ID":"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae","Type":"ContainerStarted","Data":"4ce8a85d68f71ee27d195e2284245d3365d7caab73065b94af838986ec0a6916"} May 21 17:45:18.267148 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:18.267114 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:18.267348 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:18.267244 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:45:18.267348 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:18.267256 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6bd5476d-7mjzk: secret "image-registry-tls" not found May 21 17:45:18.267348 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:18.267314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls podName:85033e0e-05c4-4876-a2c1-8b2436af2f4d nodeName:}" failed. No retries permitted until 2026-05-21 17:45:20.267298618 +0000 UTC m=+135.030594184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls") pod "image-registry-5c6bd5476d-7mjzk" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d") : secret "image-registry-tls" not found May 21 17:45:19.111131 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:19.111096 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" event={"ID":"cd25a913-3b51-44ed-aaaf-a75c6e37238d","Type":"ContainerStarted","Data":"467c3a6da28eac9521500f06870c0833c1a318c857a96083ebdbbfbd3cd92bf7"} May 21 17:45:19.127032 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:19.126984 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fvdkw" podStartSLOduration=1.576227407 podStartE2EDuration="3.126966566s" podCreationTimestamp="2026-05-21 17:45:16 +0000 UTC" firstStartedPulling="2026-05-21 17:45:17.079871364 +0000 UTC m=+131.843166932" lastFinishedPulling="2026-05-21 17:45:18.630610506 +0000 UTC m=+133.393906091" observedRunningTime="2026-05-21 17:45:19.125746534 +0000 UTC m=+133.889042124" watchObservedRunningTime="2026-05-21 17:45:19.126966566 +0000 UTC m=+133.890262158" May 21 17:45:20.114063 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:20.114038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/0.log" May 21 17:45:20.114416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:20.114079 2565 generic.go:358] "Generic (PLEG): container finished" podID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" containerID="c81e71e8efeb42f9e54e83a349e13ec34e2844de3dc6201f3d2b68d06c46ff21" exitCode=255 May 21 17:45:20.114416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:20.114176 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" event={"ID":"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae","Type":"ContainerDied","Data":"c81e71e8efeb42f9e54e83a349e13ec34e2844de3dc6201f3d2b68d06c46ff21"} May 21 17:45:20.114416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:20.114370 2565 scope.go:117] "RemoveContainer" containerID="c81e71e8efeb42f9e54e83a349e13ec34e2844de3dc6201f3d2b68d06c46ff21" May 21 17:45:20.281549 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:20.281518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:20.281658 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:20.281644 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:45:20.281696 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:20.281659 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6bd5476d-7mjzk: secret "image-registry-tls" not found May 21 17:45:20.281726 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:20.281710 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls podName:85033e0e-05c4-4876-a2c1-8b2436af2f4d nodeName:}" failed. No retries permitted until 2026-05-21 17:45:24.281694947 +0000 UTC m=+139.044990515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls") pod "image-registry-5c6bd5476d-7mjzk" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d") : secret "image-registry-tls" not found May 21 17:45:21.117215 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/1.log" May 21 17:45:21.117706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/0.log" May 21 17:45:21.117706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117570 2565 generic.go:358] "Generic (PLEG): container finished" podID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" exitCode=255 May 21 17:45:21.117706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" event={"ID":"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae","Type":"ContainerDied","Data":"d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7"} May 21 17:45:21.117706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117632 2565 scope.go:117] "RemoveContainer" containerID="c81e71e8efeb42f9e54e83a349e13ec34e2844de3dc6201f3d2b68d06c46ff21" May 21 17:45:21.117871 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.117857 2565 scope.go:117] "RemoveContainer" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" May 21 17:45:21.118069 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:21.118047 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qh4k2_openshift-console-operator(a1e5afee-bcfd-4881-9b50-e7ec2801a9ae)\"" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podUID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" May 21 17:45:21.929594 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.929561 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq"] May 21 17:45:21.933743 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.933722 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" May 21 17:45:21.935794 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.935776 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 17:45:21.935794 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.935785 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wtgxk\"" May 21 17:45:21.936442 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.936430 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 17:45:21.940758 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.940734 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq"] May 21 17:45:21.992621 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:21.992601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9h68\" (UniqueName: \"kubernetes.io/projected/6833f75c-ec93-47c4-9391-431c75fc4a1a-kube-api-access-b9h68\") pod \"migrator-b985f5d89-qnnjq\" (UID: \"6833f75c-ec93-47c4-9391-431c75fc4a1a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" May 21 17:45:22.093272 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.093255 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9h68\" (UniqueName: \"kubernetes.io/projected/6833f75c-ec93-47c4-9391-431c75fc4a1a-kube-api-access-b9h68\") pod \"migrator-b985f5d89-qnnjq\" (UID: \"6833f75c-ec93-47c4-9391-431c75fc4a1a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" May 21 17:45:22.100402 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.100375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9h68\" (UniqueName: \"kubernetes.io/projected/6833f75c-ec93-47c4-9391-431c75fc4a1a-kube-api-access-b9h68\") pod \"migrator-b985f5d89-qnnjq\" (UID: \"6833f75c-ec93-47c4-9391-431c75fc4a1a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" May 21 17:45:22.120700 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.120679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/1.log" May 21 17:45:22.120972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.120950 2565 scope.go:117] "RemoveContainer" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" May 21 17:45:22.121113 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:22.121096 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qh4k2_openshift-console-operator(a1e5afee-bcfd-4881-9b50-e7ec2801a9ae)\"" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podUID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" May 21 17:45:22.242941 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.242890 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" May 21 17:45:22.355693 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.355667 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq"] May 21 17:45:22.358631 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:22.358609 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6833f75c_ec93_47c4_9391_431c75fc4a1a.slice/crio-4356102d9e835997aef93a04108200dad79cf405a24068c9141c3873a8f88006 WatchSource:0}: Error finding container 4356102d9e835997aef93a04108200dad79cf405a24068c9141c3873a8f88006: Status 404 returned error can't find the container with id 4356102d9e835997aef93a04108200dad79cf405a24068c9141c3873a8f88006 May 21 17:45:22.990643 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:22.990617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftfbj_553c3828-58db-4a38-947d-ef38652969fe/dns-node-resolver/0.log" May 21 17:45:23.123905 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:23.123869 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" event={"ID":"6833f75c-ec93-47c4-9391-431c75fc4a1a","Type":"ContainerStarted","Data":"4356102d9e835997aef93a04108200dad79cf405a24068c9141c3873a8f88006"} May 21 17:45:23.991196 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:23.991167 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48wgk_13932eed-1d3d-46d1-9bfc-4f9c54d62f5d/node-ca/0.log" May 21 17:45:24.068776 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.068752 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cl8zw"] May 21 17:45:24.071629 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.071615 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.074093 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.074076 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 17:45:24.074819 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.074801 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 17:45:24.074898 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.074835 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gc7fv\"" May 21 17:45:24.074898 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.074853 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 17:45:24.074990 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.074908 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 17:45:24.080993 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.080967 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cl8zw"] May 21 17:45:24.127990 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.127961 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" event={"ID":"6833f75c-ec93-47c4-9391-431c75fc4a1a","Type":"ContainerStarted","Data":"1ea8a9f104ce334df5858324c28e39cc511fd461d452c98838743526023e7075"} May 21 17:45:24.127990 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.127991 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" event={"ID":"6833f75c-ec93-47c4-9391-431c75fc4a1a","Type":"ContainerStarted","Data":"580a3cf282e7115ce0cc339ec1d2b04516dc0acdfaefa3f0769b778552b11334"} May 21 17:45:24.148032 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.147985 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qnnjq" podStartSLOduration=1.9747660740000001 podStartE2EDuration="3.147964304s" podCreationTimestamp="2026-05-21 17:45:21 +0000 UTC" firstStartedPulling="2026-05-21 17:45:22.360360129 +0000 UTC m=+137.123655699" lastFinishedPulling="2026-05-21 17:45:23.533558348 +0000 UTC m=+138.296853929" observedRunningTime="2026-05-21 17:45:24.147725781 +0000 UTC m=+138.911021371" watchObservedRunningTime="2026-05-21 17:45:24.147964304 +0000 UTC m=+138.911259895" May 21 17:45:24.211192 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.211161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-key\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.211290 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.211276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcrp\" (UniqueName: \"kubernetes.io/projected/25013b7f-c596-4069-9e84-93aeca1fe8fc-kube-api-access-pdcrp\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.211340 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.211306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-cabundle\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.312420 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.312401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcrp\" (UniqueName: \"kubernetes.io/projected/25013b7f-c596-4069-9e84-93aeca1fe8fc-kube-api-access-pdcrp\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.312518 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.312430 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-cabundle\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.312518 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.312460 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:24.312622 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.312565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-key\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.312717 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:24.312698 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:45:24.312717 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:24.312717 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6bd5476d-7mjzk: secret "image-registry-tls" not found May 21 17:45:24.312801 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:24.312760 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls podName:85033e0e-05c4-4876-a2c1-8b2436af2f4d nodeName:}" failed. No retries permitted until 2026-05-21 17:45:32.312748414 +0000 UTC m=+147.076043980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls") pod "image-registry-5c6bd5476d-7mjzk" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d") : secret "image-registry-tls" not found May 21 17:45:24.312968 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.312945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-cabundle\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.314834 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.314809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/25013b7f-c596-4069-9e84-93aeca1fe8fc-signing-key\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.319729 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.319705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcrp\" (UniqueName: \"kubernetes.io/projected/25013b7f-c596-4069-9e84-93aeca1fe8fc-kube-api-access-pdcrp\") pod \"service-ca-67d667c7d-cl8zw\" (UID: \"25013b7f-c596-4069-9e84-93aeca1fe8fc\") " pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.379776 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.379757 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" May 21 17:45:24.491546 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:24.491516 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cl8zw"] May 21 17:45:24.494326 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:24.494298 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25013b7f_c596_4069_9e84_93aeca1fe8fc.slice/crio-f7d89e9faaf680237e5de3b166191037418497275383e6604255884e29452c11 WatchSource:0}: Error finding container f7d89e9faaf680237e5de3b166191037418497275383e6604255884e29452c11: Status 404 returned error can't find the container with id f7d89e9faaf680237e5de3b166191037418497275383e6604255884e29452c11 May 21 17:45:25.131788 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:25.131752 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" event={"ID":"25013b7f-c596-4069-9e84-93aeca1fe8fc","Type":"ContainerStarted","Data":"f7d89e9faaf680237e5de3b166191037418497275383e6604255884e29452c11"} May 21 17:45:27.071724 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:27.071689 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:27.071724 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:27.071728 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:27.072227 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:27.072132 2565 scope.go:117] "RemoveContainer" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" May 21 17:45:27.072348 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:27.072326 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qh4k2_openshift-console-operator(a1e5afee-bcfd-4881-9b50-e7ec2801a9ae)\"" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podUID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" May 21 17:45:27.137651 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:27.137623 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" event={"ID":"25013b7f-c596-4069-9e84-93aeca1fe8fc","Type":"ContainerStarted","Data":"ac14a7748941fc7bd72a4f84822b7f2150175ea1469b0b29c78d7c2d8f527f33"} May 21 17:45:27.153963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:27.153923 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-cl8zw" podStartSLOduration=1.547142673 podStartE2EDuration="3.153911041s" podCreationTimestamp="2026-05-21 17:45:24 +0000 UTC" firstStartedPulling="2026-05-21 17:45:24.495994693 +0000 UTC m=+139.259290259" lastFinishedPulling="2026-05-21 17:45:26.102763048 +0000 UTC m=+140.866058627" observedRunningTime="2026-05-21 17:45:27.15295161 +0000 UTC m=+141.916247199" watchObservedRunningTime="2026-05-21 17:45:27.153911041 +0000 UTC m=+141.917206628" May 21 17:45:32.367409 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:32.367376 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:32.369707 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:32.369683 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"image-registry-5c6bd5476d-7mjzk\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:32.464728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:32.464702 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:32.592970 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:32.592940 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:45:32.596551 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:32.596525 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85033e0e_05c4_4876_a2c1_8b2436af2f4d.slice/crio-ebc500cb29fdffc964d29ab71bc6a587cd08627963dcfd0f20f079feddda52ee WatchSource:0}: Error finding container ebc500cb29fdffc964d29ab71bc6a587cd08627963dcfd0f20f079feddda52ee: Status 404 returned error can't find the container with id ebc500cb29fdffc964d29ab71bc6a587cd08627963dcfd0f20f079feddda52ee May 21 17:45:33.152558 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:33.152521 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" event={"ID":"85033e0e-05c4-4876-a2c1-8b2436af2f4d","Type":"ContainerStarted","Data":"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308"} May 21 17:45:33.152558 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:33.152560 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" event={"ID":"85033e0e-05c4-4876-a2c1-8b2436af2f4d","Type":"ContainerStarted","Data":"ebc500cb29fdffc964d29ab71bc6a587cd08627963dcfd0f20f079feddda52ee"} May 21 17:45:33.152804 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:33.152639 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:45:33.171728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:33.171688 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" podStartSLOduration=17.171677415 podStartE2EDuration="17.171677415s" podCreationTimestamp="2026-05-21 17:45:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:45:33.170072949 +0000 UTC m=+147.933368537" watchObservedRunningTime="2026-05-21 17:45:33.171677415 +0000 UTC m=+147.934973029" May 21 17:45:39.754898 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:39.754866 2565 scope.go:117] "RemoveContainer" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" May 21 17:45:40.169354 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.169327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:45:40.169767 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.169753 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/1.log" May 21 17:45:40.169820 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.169784 2565 generic.go:358] "Generic (PLEG): container finished" podID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" containerID="49ef144d34569e6c63811c58fda9d38d0b92218b14183af5b4a9f050c4cc617a" exitCode=255 May 21 17:45:40.169855 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.169840 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" event={"ID":"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae","Type":"ContainerDied","Data":"49ef144d34569e6c63811c58fda9d38d0b92218b14183af5b4a9f050c4cc617a"} May 21 17:45:40.169894 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.169871 2565 scope.go:117] "RemoveContainer" containerID="d45965070165f3f6bee9884d6cd8409d72a51caed4cafe56dcf18e57a11f61e7" May 21 17:45:40.170148 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:40.170128 2565 scope.go:117] "RemoveContainer" containerID="49ef144d34569e6c63811c58fda9d38d0b92218b14183af5b4a9f050c4cc617a" May 21 17:45:40.170344 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:40.170325 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-qh4k2_openshift-console-operator(a1e5afee-bcfd-4881-9b50-e7ec2801a9ae)\"" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podUID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" May 21 17:45:41.173597 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:41.173573 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:45:42.109660 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:42.109616 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-4nrr4" podUID="19c33939-51c8-4ab9-9c8a-110c98d1d6fc" May 21 17:45:42.114737 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:42.114713 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p5d42" podUID="51cd8e22-15ef-4872-b966-d7a7ca24707f" May 21 17:45:42.175838 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:42.175808 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5d42" May 21 17:45:42.176163 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:42.175808 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:45:42.773724 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:42.773680 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nf2kh" podUID="7d1f90c2-c4a5-4731-a31b-b3c9b5330e49" May 21 17:45:44.686199 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.686165 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:45:44.696774 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.696746 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5959fdf665-dq6kd"] May 21 17:45:44.700296 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.700279 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.703169 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.703145 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4bzkb"] May 21 17:45:44.706422 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.706406 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.709183 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.709164 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 17:45:44.709455 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.709417 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9cn4m\"" May 21 17:45:44.709557 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.709503 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 17:45:44.709557 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.709508 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 17:45:44.709670 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.709612 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 17:45:44.714345 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.714328 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5959fdf665-dq6kd"] May 21 17:45:44.716981 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.716960 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bzkb"] May 21 17:45:44.846363 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-certificates\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846526 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/015c829a-bc7c-424c-8ba6-c912284f8bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.846526 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-bound-sa-token\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846526 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-trusted-ca\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846526 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75v9\" (UniqueName: \"kubernetes.io/projected/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-api-access-k75v9\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.846731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-image-registry-private-configuration\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.846731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-installation-pull-secrets\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-tls\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/015c829a-bc7c-424c-8ba6-c912284f8bb8-crio-socket\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.846913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q58c\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-kube-api-access-9q58c\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.846913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/015c829a-bc7c-424c-8ba6-c912284f8bb8-data-volume\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.846913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.846833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-ca-trust-extracted\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947534 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947434 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-tls\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947534 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/015c829a-bc7c-424c-8ba6-c912284f8bb8-crio-socket\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.947742 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/015c829a-bc7c-424c-8ba6-c912284f8bb8-crio-socket\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.947742 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947589 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9q58c\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-kube-api-access-9q58c\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947742 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947613 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/015c829a-bc7c-424c-8ba6-c912284f8bb8-data-volume\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.947742 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947629 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-ca-trust-extracted\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947765 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-certificates\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947800 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/015c829a-bc7c-424c-8ba6-c912284f8bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.947939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947833 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-bound-sa-token\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.947939 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947887 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-trusted-ca\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.948118 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947940 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k75v9\" (UniqueName: \"kubernetes.io/projected/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-api-access-k75v9\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.948118 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/015c829a-bc7c-424c-8ba6-c912284f8bb8-data-volume\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.948118 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.947984 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-image-registry-private-configuration\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.948118 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.948020 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.948118 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.948045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-installation-pull-secrets\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.948590 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.948549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.948824 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.948801 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-ca-trust-extracted\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.949293 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.949269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-certificates\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.949414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.949376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-trusted-ca\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.950228 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.950198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-registry-tls\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.950362 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.950343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/015c829a-bc7c-424c-8ba6-c912284f8bb8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:44.950572 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.950553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-installation-pull-secrets\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.950834 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.950813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-image-registry-private-configuration\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.960851 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.960827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-bound-sa-token\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.961277 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.961261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q58c\" (UniqueName: \"kubernetes.io/projected/e1c695de-cc28-4bb9-b8ca-08a36e2eb00d-kube-api-access-9q58c\") pod \"image-registry-5959fdf665-dq6kd\" (UID: \"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d\") " pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:44.962443 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:44.962423 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75v9\" (UniqueName: \"kubernetes.io/projected/015c829a-bc7c-424c-8ba6-c912284f8bb8-kube-api-access-k75v9\") pod \"insights-runtime-extractor-4bzkb\" (UID: \"015c829a-bc7c-424c-8ba6-c912284f8bb8\") " pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:45.009629 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.009602 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:45.016295 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.016277 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bzkb" May 21 17:45:45.134761 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.134729 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5959fdf665-dq6kd"] May 21 17:45:45.138064 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:45.138038 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c695de_cc28_4bb9_b8ca_08a36e2eb00d.slice/crio-2b00617371a2d40373eb127a0efdd7d6130fc6b74cda4fe9313ed7ad79eb9af1 WatchSource:0}: Error finding container 2b00617371a2d40373eb127a0efdd7d6130fc6b74cda4fe9313ed7ad79eb9af1: Status 404 returned error can't find the container with id 2b00617371a2d40373eb127a0efdd7d6130fc6b74cda4fe9313ed7ad79eb9af1 May 21 17:45:45.150287 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.150262 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bzkb"] May 21 17:45:45.153560 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:45.153538 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015c829a_bc7c_424c_8ba6_c912284f8bb8.slice/crio-0e236330161b255f3afb811eff1f0111f3eb3428c55a0d1c28fd269607c296bd WatchSource:0}: Error finding container 0e236330161b255f3afb811eff1f0111f3eb3428c55a0d1c28fd269607c296bd: Status 404 returned error can't find the container with id 0e236330161b255f3afb811eff1f0111f3eb3428c55a0d1c28fd269607c296bd May 21 17:45:45.185153 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.185120 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bzkb" event={"ID":"015c829a-bc7c-424c-8ba6-c912284f8bb8","Type":"ContainerStarted","Data":"0e236330161b255f3afb811eff1f0111f3eb3428c55a0d1c28fd269607c296bd"} May 21 17:45:45.186914 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:45.186895 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" event={"ID":"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d","Type":"ContainerStarted","Data":"2b00617371a2d40373eb127a0efdd7d6130fc6b74cda4fe9313ed7ad79eb9af1"} May 21 17:45:46.190826 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.190748 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bzkb" event={"ID":"015c829a-bc7c-424c-8ba6-c912284f8bb8","Type":"ContainerStarted","Data":"fc4a11d73ebecae3b90091ce83d8be0f442338a41f6a7332c4faad3dda042b62"} May 21 17:45:46.190826 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.190788 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bzkb" event={"ID":"015c829a-bc7c-424c-8ba6-c912284f8bb8","Type":"ContainerStarted","Data":"8a8f78b1a59f15aac422b128c282638aa5fc64a674e36e3303f7b45f58f474bf"} May 21 17:45:46.191886 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.191860 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" event={"ID":"e1c695de-cc28-4bb9-b8ca-08a36e2eb00d","Type":"ContainerStarted","Data":"077a4d3b5297e7392be7fe8f69fac92d073d53c0776c9f0b82746f259c174300"} May 21 17:45:46.191977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.191965 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:45:46.209431 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.209356 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" podStartSLOduration=2.20934267 podStartE2EDuration="2.20934267s" podCreationTimestamp="2026-05-21 17:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:45:46.20866176 +0000 UTC m=+160.971957347" watchObservedRunningTime="2026-05-21 17:45:46.20934267 +0000 UTC m=+160.972638258" May 21 17:45:46.964574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.964542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:45:46.964725 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.964578 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:45:46.966924 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.966898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51cd8e22-15ef-4872-b966-d7a7ca24707f-metrics-tls\") pod \"dns-default-p5d42\" (UID: \"51cd8e22-15ef-4872-b966-d7a7ca24707f\") " pod="openshift-dns/dns-default-p5d42" May 21 17:45:46.967032 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.966901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19c33939-51c8-4ab9-9c8a-110c98d1d6fc-cert\") pod \"ingress-canary-4nrr4\" (UID: \"19c33939-51c8-4ab9-9c8a-110c98d1d6fc\") " pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:45:46.978949 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.978926 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5t9n8\"" May 21 17:45:46.979688 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.979666 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5rz\"" May 21 17:45:46.987171 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.987155 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrr4" May 21 17:45:46.987269 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:46.987253 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5d42" May 21 17:45:47.071516 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.071477 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:47.071615 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.071531 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:45:47.071886 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.071869 2565 scope.go:117] "RemoveContainer" containerID="49ef144d34569e6c63811c58fda9d38d0b92218b14183af5b4a9f050c4cc617a" May 21 17:45:47.072085 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:45:47.072066 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-qh4k2_openshift-console-operator(a1e5afee-bcfd-4881-9b50-e7ec2801a9ae)\"" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podUID="a1e5afee-bcfd-4881-9b50-e7ec2801a9ae" May 21 17:45:47.148387 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.148339 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5d42"] May 21 17:45:47.151699 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:47.151668 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cd8e22_15ef_4872_b966_d7a7ca24707f.slice/crio-edb4f74defa48f76a4d26ce5a8639aa802d846f93be96eb6cfec714bc51d6e22 WatchSource:0}: Error finding container edb4f74defa48f76a4d26ce5a8639aa802d846f93be96eb6cfec714bc51d6e22: Status 404 returned error can't find the container with id edb4f74defa48f76a4d26ce5a8639aa802d846f93be96eb6cfec714bc51d6e22 May 21 17:45:47.162822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.162794 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrr4"] May 21 17:45:47.166346 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:47.166317 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c33939_51c8_4ab9_9c8a_110c98d1d6fc.slice/crio-d36f2746e77f7b764cd314e489555863797edcbf7276991174a3d48c2faecf90 WatchSource:0}: Error finding container d36f2746e77f7b764cd314e489555863797edcbf7276991174a3d48c2faecf90: Status 404 returned error can't find the container with id d36f2746e77f7b764cd314e489555863797edcbf7276991174a3d48c2faecf90 May 21 17:45:47.195812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.195773 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5d42" event={"ID":"51cd8e22-15ef-4872-b966-d7a7ca24707f","Type":"ContainerStarted","Data":"edb4f74defa48f76a4d26ce5a8639aa802d846f93be96eb6cfec714bc51d6e22"} May 21 17:45:47.197016 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:47.196991 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nrr4" event={"ID":"19c33939-51c8-4ab9-9c8a-110c98d1d6fc","Type":"ContainerStarted","Data":"d36f2746e77f7b764cd314e489555863797edcbf7276991174a3d48c2faecf90"} May 21 17:45:48.202204 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:48.202122 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bzkb" event={"ID":"015c829a-bc7c-424c-8ba6-c912284f8bb8","Type":"ContainerStarted","Data":"b28dbf3da10f9a7f3d92bbc30702c96a8b6b95eee98ccda08f45a0ad00b4a178"} May 21 17:45:48.219057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:48.219012 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4bzkb" podStartSLOduration=1.579214026 podStartE2EDuration="4.218994795s" podCreationTimestamp="2026-05-21 17:45:44 +0000 UTC" firstStartedPulling="2026-05-21 17:45:45.20134384 +0000 UTC m=+159.964639423" lastFinishedPulling="2026-05-21 17:45:47.841124612 +0000 UTC m=+162.604420192" observedRunningTime="2026-05-21 17:45:48.217410614 +0000 UTC m=+162.980706204" watchObservedRunningTime="2026-05-21 17:45:48.218994795 +0000 UTC m=+162.982290384" May 21 17:45:50.208946 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.208912 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5d42" event={"ID":"51cd8e22-15ef-4872-b966-d7a7ca24707f","Type":"ContainerStarted","Data":"f74e3eab054840cc44eb050114338be47b26b5d0689a5cef8dc2b4c3248a95fe"} May 21 17:45:50.208946 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.208948 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5d42" event={"ID":"51cd8e22-15ef-4872-b966-d7a7ca24707f","Type":"ContainerStarted","Data":"63d8b7151364a485a5e87aea6991480a019f2bba94915f299c02d9d0bed3d506"} May 21 17:45:50.209396 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.209009 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p5d42" May 21 17:45:50.210174 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.210152 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nrr4" event={"ID":"19c33939-51c8-4ab9-9c8a-110c98d1d6fc","Type":"ContainerStarted","Data":"2a4e0bc7f1dd92252a947039a759620497df34bc0403a815cf0f0c9a6529deab"} May 21 17:45:50.224875 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.224827 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-p5d42" podStartSLOduration=128.619402433 podStartE2EDuration="2m11.224817128s" podCreationTimestamp="2026-05-21 17:43:39 +0000 UTC" firstStartedPulling="2026-05-21 17:45:47.15398677 +0000 UTC m=+161.917282337" lastFinishedPulling="2026-05-21 17:45:49.759401456 +0000 UTC m=+164.522697032" observedRunningTime="2026-05-21 17:45:50.223418906 +0000 UTC m=+164.986714518" watchObservedRunningTime="2026-05-21 17:45:50.224817128 +0000 UTC m=+164.988112716" May 21 17:45:50.237338 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:50.237281 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4nrr4" podStartSLOduration=128.64672141 podStartE2EDuration="2m11.237267968s" podCreationTimestamp="2026-05-21 17:43:39 +0000 UTC" firstStartedPulling="2026-05-21 17:45:47.168578252 +0000 UTC m=+161.931873834" lastFinishedPulling="2026-05-21 17:45:49.759124826 +0000 UTC m=+164.522420392" observedRunningTime="2026-05-21 17:45:50.236196533 +0000 UTC m=+164.999492112" watchObservedRunningTime="2026-05-21 17:45:50.237267968 +0000 UTC m=+165.000563556" May 21 17:45:54.691228 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:54.691196 2565 patch_prober.go:28] interesting pod/image-registry-5c6bd5476d-7mjzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 17:45:54.691727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:54.691251 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 17:45:57.755126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:57.755089 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:45:59.577025 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.576975 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc"] May 21 17:45:59.581847 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.581812 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kgl8m"] May 21 17:45:59.582008 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.581988 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.584475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.584455 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 17:45:59.584603 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.584461 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 17:45:59.584603 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.584461 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 17:45:59.584603 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.584502 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 17:45:59.585076 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.585056 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 17:45:59.585183 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.585112 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 17:45:59.585183 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.585126 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jlzlp\"" May 21 17:45:59.585183 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.585168 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.586946 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.586927 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 17:45:59.587159 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.587143 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 17:45:59.587298 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.587273 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 17:45:59.587425 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.587408 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5mg5j\"" May 21 17:45:59.591516 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.591474 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc"] May 21 17:45:59.755006 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.754978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.755127 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.755127 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755127 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-root\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755127 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755302 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmnf8\" (UniqueName: \"kubernetes.io/projected/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-api-access-mmnf8\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.755302 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-metrics-client-ca\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755302 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.755302 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-tls\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755302 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.755480 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tdtj\" (UniqueName: \"kubernetes.io/projected/7700683a-368a-4a1e-b41d-b4d1a68a4d13-kube-api-access-9tdtj\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755480 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-sys\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755480 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-textfile\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755480 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755365 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-wtmp\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.755480 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.755388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856198 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856145 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-tls\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856198 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856172 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856198 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856195 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tdtj\" (UniqueName: \"kubernetes.io/projected/7700683a-368a-4a1e-b41d-b4d1a68a4d13-kube-api-access-9tdtj\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856210 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-sys\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856227 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-textfile\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856247 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-wtmp\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856272 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856298 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-sys\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856304 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856348 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856379 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-wtmp\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856418 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-root\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856456 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856485 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmnf8\" (UniqueName: \"kubernetes.io/projected/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-api-access-mmnf8\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856534 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-metrics-client-ca\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.856833 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856566 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.857123 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.857123 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-textfile\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.857123 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7700683a-368a-4a1e-b41d-b4d1a68a4d13-root\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.857123 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.856995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.857123 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.857029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.857531 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.857509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7700683a-368a-4a1e-b41d-b4d1a68a4d13-metrics-client-ca\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.857678 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.857627 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.858846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.858823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-tls\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.859221 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.859203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.859284 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.859240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.859391 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.859372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7700683a-368a-4a1e-b41d-b4d1a68a4d13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.863187 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.863165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tdtj\" (UniqueName: \"kubernetes.io/projected/7700683a-368a-4a1e-b41d-b4d1a68a4d13-kube-api-access-9tdtj\") pod \"node-exporter-kgl8m\" (UID: \"7700683a-368a-4a1e-b41d-b4d1a68a4d13\") " pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.863532 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.863516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmnf8\" (UniqueName: \"kubernetes.io/projected/1f9b341b-1dfd-4f4e-aa31-381e10d381c7-kube-api-access-mmnf8\") pod \"kube-state-metrics-54fd6bc5c4-s8kkc\" (UID: \"1f9b341b-1dfd-4f4e-aa31-381e10d381c7\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.895414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.895394 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" May 21 17:45:59.900401 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:45:59.900360 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgl8m" May 21 17:45:59.912697 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:45:59.912665 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7700683a_368a_4a1e_b41d_b4d1a68a4d13.slice/crio-e1b92bc525c2dfc46c161424f7a627a826b39eb7b0098b2170b5f7fd9728172f WatchSource:0}: Error finding container e1b92bc525c2dfc46c161424f7a627a826b39eb7b0098b2170b5f7fd9728172f: Status 404 returned error can't find the container with id e1b92bc525c2dfc46c161424f7a627a826b39eb7b0098b2170b5f7fd9728172f May 21 17:46:00.023471 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:00.023443 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc"] May 21 17:46:00.026527 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:46:00.026476 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9b341b_1dfd_4f4e_aa31_381e10d381c7.slice/crio-f08e8d26db0930ee3a30047f8604c4d3894f8f9241cdfabe06925d38bc8b877c WatchSource:0}: Error finding container f08e8d26db0930ee3a30047f8604c4d3894f8f9241cdfabe06925d38bc8b877c: Status 404 returned error can't find the container with id f08e8d26db0930ee3a30047f8604c4d3894f8f9241cdfabe06925d38bc8b877c May 21 17:46:00.214972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:00.214922 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p5d42" May 21 17:46:00.235851 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:00.235814 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgl8m" event={"ID":"7700683a-368a-4a1e-b41d-b4d1a68a4d13","Type":"ContainerStarted","Data":"e1b92bc525c2dfc46c161424f7a627a826b39eb7b0098b2170b5f7fd9728172f"} May 21 17:46:00.236737 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:00.236712 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" event={"ID":"1f9b341b-1dfd-4f4e-aa31-381e10d381c7","Type":"ContainerStarted","Data":"f08e8d26db0930ee3a30047f8604c4d3894f8f9241cdfabe06925d38bc8b877c"} May 21 17:46:01.754737 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:01.754713 2565 scope.go:117] "RemoveContainer" containerID="49ef144d34569e6c63811c58fda9d38d0b92218b14183af5b4a9f050c4cc617a" May 21 17:46:02.242634 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.242609 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:46:02.242801 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.242690 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" event={"ID":"a1e5afee-bcfd-4881-9b50-e7ec2801a9ae","Type":"ContainerStarted","Data":"8b17380bd680f35ee9e316088d9eb4febf70c8bee70ca08c35256bf6777c2eda"} May 21 17:46:02.243026 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.243002 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:46:02.244280 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.244256 2565 generic.go:358] "Generic (PLEG): container finished" podID="7700683a-368a-4a1e-b41d-b4d1a68a4d13" containerID="f8702e711184aff819d653b30733696a7e056e4bcfba5cd361a6f9944598808c" exitCode=0 May 21 17:46:02.244388 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.244330 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgl8m" event={"ID":"7700683a-368a-4a1e-b41d-b4d1a68a4d13","Type":"ContainerDied","Data":"f8702e711184aff819d653b30733696a7e056e4bcfba5cd361a6f9944598808c"} May 21 17:46:02.246319 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.246277 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" event={"ID":"1f9b341b-1dfd-4f4e-aa31-381e10d381c7","Type":"ContainerStarted","Data":"1701d589eeb1708110849625cac9aea23523fe04a3345982b96e09ed8dff5d1e"} May 21 17:46:02.246414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.246326 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" event={"ID":"1f9b341b-1dfd-4f4e-aa31-381e10d381c7","Type":"ContainerStarted","Data":"4501575fcbb6eda950d5080c1d3cb369672d124741287661ddbbc796f15d2b4f"} May 21 17:46:02.246414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.246340 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" event={"ID":"1f9b341b-1dfd-4f4e-aa31-381e10d381c7","Type":"ContainerStarted","Data":"7a5910e3e533f08ad9ad364f7280b4d7c092199152e85b05237c71309509c36b"} May 21 17:46:02.259236 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.259200 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" podStartSLOduration=44.166361661 podStartE2EDuration="46.259189628s" podCreationTimestamp="2026-05-21 17:45:16 +0000 UTC" firstStartedPulling="2026-05-21 17:45:17.188508477 +0000 UTC m=+131.951804044" lastFinishedPulling="2026-05-21 17:45:19.281336445 +0000 UTC m=+134.044632011" observedRunningTime="2026-05-21 17:46:02.258199684 +0000 UTC m=+177.021495275" watchObservedRunningTime="2026-05-21 17:46:02.259189628 +0000 UTC m=+177.022485216" May 21 17:46:02.292974 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.292929 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-s8kkc" podStartSLOduration=1.775765731 podStartE2EDuration="3.292914575s" podCreationTimestamp="2026-05-21 17:45:59 +0000 UTC" firstStartedPulling="2026-05-21 17:46:00.028408515 +0000 UTC m=+174.791704080" lastFinishedPulling="2026-05-21 17:46:01.54555734 +0000 UTC m=+176.308852924" observedRunningTime="2026-05-21 17:46:02.291892794 +0000 UTC m=+177.055188420" watchObservedRunningTime="2026-05-21 17:46:02.292914575 +0000 UTC m=+177.056210165" May 21 17:46:02.460556 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.460523 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-qh4k2" May 21 17:46:02.635551 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.635522 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-ttsbl"] May 21 17:46:02.638653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.638636 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:02.640925 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.640901 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-r46gq\"" May 21 17:46:02.640925 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.640913 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 17:46:02.641064 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.640915 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 17:46:02.648890 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.648866 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-ttsbl"] May 21 17:46:02.679696 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.679673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jhvw\" (UniqueName: \"kubernetes.io/projected/e16c1885-64de-4860-befd-3ecfa7db3408-kube-api-access-8jhvw\") pod \"downloads-57bd96b888-ttsbl\" (UID: \"e16c1885-64de-4860-befd-3ecfa7db3408\") " pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:02.780913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.780889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jhvw\" (UniqueName: \"kubernetes.io/projected/e16c1885-64de-4860-befd-3ecfa7db3408-kube-api-access-8jhvw\") pod \"downloads-57bd96b888-ttsbl\" (UID: \"e16c1885-64de-4860-befd-3ecfa7db3408\") " pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:02.790300 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.790274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jhvw\" (UniqueName: \"kubernetes.io/projected/e16c1885-64de-4860-befd-3ecfa7db3408-kube-api-access-8jhvw\") pod \"downloads-57bd96b888-ttsbl\" (UID: \"e16c1885-64de-4860-befd-3ecfa7db3408\") " pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:02.948397 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:02.948328 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:03.068806 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.068774 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-ttsbl"] May 21 17:46:03.071783 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:46:03.071750 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16c1885_64de_4860_befd_3ecfa7db3408.slice/crio-106d05c3e917a732a572a9031bd99e863d2cc5e2b445585d2773ca3c2561acc1 WatchSource:0}: Error finding container 106d05c3e917a732a572a9031bd99e863d2cc5e2b445585d2773ca3c2561acc1: Status 404 returned error can't find the container with id 106d05c3e917a732a572a9031bd99e863d2cc5e2b445585d2773ca3c2561acc1 May 21 17:46:03.253956 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.253862 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-ttsbl" event={"ID":"e16c1885-64de-4860-befd-3ecfa7db3408","Type":"ContainerStarted","Data":"106d05c3e917a732a572a9031bd99e863d2cc5e2b445585d2773ca3c2561acc1"} May 21 17:46:03.255822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.255789 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgl8m" event={"ID":"7700683a-368a-4a1e-b41d-b4d1a68a4d13","Type":"ContainerStarted","Data":"703b4154b5331e47702728738c47d8182f61215b6dd118307bff14550d40463a"} May 21 17:46:03.255954 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.255836 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgl8m" event={"ID":"7700683a-368a-4a1e-b41d-b4d1a68a4d13","Type":"ContainerStarted","Data":"0b9d5f1f2632b44d590d1527268031d5850018fc4d3939dd06a13021a5622b71"} May 21 17:46:03.273445 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.273403 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kgl8m" podStartSLOduration=2.644905292 podStartE2EDuration="4.27339221s" podCreationTimestamp="2026-05-21 17:45:59 +0000 UTC" firstStartedPulling="2026-05-21 17:45:59.914689558 +0000 UTC m=+174.677985129" lastFinishedPulling="2026-05-21 17:46:01.543176472 +0000 UTC m=+176.306472047" observedRunningTime="2026-05-21 17:46:03.271840031 +0000 UTC m=+178.035135618" watchObservedRunningTime="2026-05-21 17:46:03.27339221 +0000 UTC m=+178.036687851" May 21 17:46:03.985570 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.985535 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-669666dcbb-mslgk"] May 21 17:46:03.988825 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.988805 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.990828 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.990802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.990964 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.990864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-metrics-server-audit-profiles\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.990964 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.990942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-client-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.991052 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.990982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbfl\" (UniqueName: \"kubernetes.io/projected/376bfffb-02ec-4012-aadb-393497af0970-kube-api-access-tnbfl\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.991102 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-client-certs\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.991150 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376bfffb-02ec-4012-aadb-393497af0970-audit-log\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.991150 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-tls\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:03.991777 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991758 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vx565\"" May 21 17:46:03.991880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991798 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 17:46:03.991880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.991811 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 17:46:03.992122 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.992104 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 17:46:03.992277 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.992250 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6e99vomg6qgh3\"" May 21 17:46:03.992374 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.992310 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 17:46:03.999086 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:03.998853 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669666dcbb-mslgk"] May 21 17:46:04.091590 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.091759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091620 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-metrics-server-audit-profiles\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.091759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091659 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-client-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.091759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091683 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbfl\" (UniqueName: \"kubernetes.io/projected/376bfffb-02ec-4012-aadb-393497af0970-kube-api-access-tnbfl\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.091759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091714 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-client-certs\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.091759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091753 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376bfffb-02ec-4012-aadb-393497af0970-audit-log\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.092011 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.091783 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-tls\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.092303 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.092236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376bfffb-02ec-4012-aadb-393497af0970-audit-log\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.092407 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.092367 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.092677 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.092651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376bfffb-02ec-4012-aadb-393497af0970-metrics-server-audit-profiles\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.094842 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.094818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-client-ca-bundle\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.094842 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.094835 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-tls\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.094994 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.094818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376bfffb-02ec-4012-aadb-393497af0970-secret-metrics-server-client-certs\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.101145 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.101087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbfl\" (UniqueName: \"kubernetes.io/projected/376bfffb-02ec-4012-aadb-393497af0970-kube-api-access-tnbfl\") pod \"metrics-server-669666dcbb-mslgk\" (UID: \"376bfffb-02ec-4012-aadb-393497af0970\") " pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.300888 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.300715 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:04.372687 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.372548 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pbl46"] May 21 17:46:04.377141 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.377119 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:04.380092 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.379699 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-h6vzj\"" May 21 17:46:04.380092 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.379948 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 17:46:04.386582 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.385583 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pbl46"] May 21 17:46:04.395229 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.394971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pbl46\" (UID: \"021f4e49-6538-435d-80aa-acdce8aea7c9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:04.457689 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.457664 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669666dcbb-mslgk"] May 21 17:46:04.460630 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:46:04.460605 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376bfffb_02ec_4012_aadb_393497af0970.slice/crio-6adf83a7fac479d8897c5d3b088c4491979d38fdc940eff873259927976434a8 WatchSource:0}: Error finding container 6adf83a7fac479d8897c5d3b088c4491979d38fdc940eff873259927976434a8: Status 404 returned error can't find the container with id 6adf83a7fac479d8897c5d3b088c4491979d38fdc940eff873259927976434a8 May 21 17:46:04.496249 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.496186 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pbl46\" (UID: \"021f4e49-6538-435d-80aa-acdce8aea7c9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:04.496361 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:46:04.496342 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 17:46:04.496424 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:46:04.496413 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert podName:021f4e49-6538-435d-80aa-acdce8aea7c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:46:04.996391992 +0000 UTC m=+179.759687571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-pbl46" (UID: "021f4e49-6538-435d-80aa-acdce8aea7c9") : secret "monitoring-plugin-cert" not found May 21 17:46:04.695453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.695416 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:46:04.999867 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:04.999782 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pbl46\" (UID: \"021f4e49-6538-435d-80aa-acdce8aea7c9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:05.002433 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.002412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/021f4e49-6538-435d-80aa-acdce8aea7c9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pbl46\" (UID: \"021f4e49-6538-435d-80aa-acdce8aea7c9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:05.014907 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.014882 2565 patch_prober.go:28] interesting pod/image-registry-5959fdf665-dq6kd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 17:46:05.015029 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.014937 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" podUID="e1c695de-cc28-4bb9-b8ca-08a36e2eb00d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 17:46:05.264143 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.264066 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" event={"ID":"376bfffb-02ec-4012-aadb-393497af0970","Type":"ContainerStarted","Data":"6adf83a7fac479d8897c5d3b088c4491979d38fdc940eff873259927976434a8"} May 21 17:46:05.293323 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.293291 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:05.443509 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.443452 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pbl46"] May 21 17:46:05.446744 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:46:05.446710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021f4e49_6538_435d_80aa_acdce8aea7c9.slice/crio-535a736aeae1b6429bf4330559bb2d64ba2f5c22e127546d4f53171f2b8afb85 WatchSource:0}: Error finding container 535a736aeae1b6429bf4330559bb2d64ba2f5c22e127546d4f53171f2b8afb85: Status 404 returned error can't find the container with id 535a736aeae1b6429bf4330559bb2d64ba2f5c22e127546d4f53171f2b8afb85 May 21 17:46:05.763010 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.762978 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:46:05.768445 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.768421 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.770915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.770803 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 17:46:05.770915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.770803 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 17:46:05.770915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.770840 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 17:46:05.770915 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.770892 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mqw5f\"" May 21 17:46:05.771212 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.770806 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 17:46:05.771295 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771272 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5jgf7deifhstl\"" May 21 17:46:05.771427 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771301 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 17:46:05.771706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771673 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 17:46:05.771706 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771688 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 17:46:05.771860 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771690 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 17:46:05.771921 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771887 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 17:46:05.771975 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.771939 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 17:46:05.772148 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.772130 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 17:46:05.773673 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.773647 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 17:46:05.777584 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.777559 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:46:05.806120 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806239 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806326 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806326 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806326 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclg2\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806621 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806621 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806621 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.806822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.806809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907418 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907352 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907418 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907417 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907698 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907600 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907698 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907647 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907698 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907708 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zclg2\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907737 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907764 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907793 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.907846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907820 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.908083 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907871 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.908083 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.907900 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.908247 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.908221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.908817 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.908789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.909320 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.908996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909466 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909525 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909586 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909614 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909656 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.909686 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.910407 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.910145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.911089 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.911045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.911089 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.911081 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.911348 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.911321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.911557 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.911535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.912420 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.912396 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.912586 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.912564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.913324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.913238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.915331 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.915287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.915428 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.915376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.915763 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.915742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.916179 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.916151 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.916692 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.916650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclg2\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.916782 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.916723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:05.917195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:05.917158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:06.079916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.079883 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:06.232780 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.232677 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:46:06.235933 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:46:06.235896 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0662617_d818_4deb_ba55_020f590ce4f3.slice/crio-f35220998cd6160b55720530e715db3882f578fb777ef0a1eb5e25822824987b WatchSource:0}: Error finding container f35220998cd6160b55720530e715db3882f578fb777ef0a1eb5e25822824987b: Status 404 returned error can't find the container with id f35220998cd6160b55720530e715db3882f578fb777ef0a1eb5e25822824987b May 21 17:46:06.268473 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.268384 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"f35220998cd6160b55720530e715db3882f578fb777ef0a1eb5e25822824987b"} May 21 17:46:06.269890 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.269839 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" event={"ID":"021f4e49-6538-435d-80aa-acdce8aea7c9","Type":"ContainerStarted","Data":"535a736aeae1b6429bf4330559bb2d64ba2f5c22e127546d4f53171f2b8afb85"} May 21 17:46:06.272257 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.272213 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" event={"ID":"376bfffb-02ec-4012-aadb-393497af0970","Type":"ContainerStarted","Data":"05285178e7e5ed8f1adf2a2fe9ee87a08d696d7e7392a380e1a82392f77236cf"} May 21 17:46:06.293752 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:06.292017 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" podStartSLOduration=1.632976768 podStartE2EDuration="3.292002495s" podCreationTimestamp="2026-05-21 17:46:03 +0000 UTC" firstStartedPulling="2026-05-21 17:46:04.463123953 +0000 UTC m=+179.226419518" lastFinishedPulling="2026-05-21 17:46:06.122149675 +0000 UTC m=+180.885445245" observedRunningTime="2026-05-21 17:46:06.291695663 +0000 UTC m=+181.054991255" watchObservedRunningTime="2026-05-21 17:46:06.292002495 +0000 UTC m=+181.055298087" May 21 17:46:07.203265 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:07.203232 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5959fdf665-dq6kd" May 21 17:46:08.280121 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.279996 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" exitCode=0 May 21 17:46:08.280121 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.280057 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} May 21 17:46:08.281684 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.281644 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" event={"ID":"021f4e49-6538-435d-80aa-acdce8aea7c9","Type":"ContainerStarted","Data":"678ba5d5c4166b08bf980e7c4a6bae624fad6473b86ca707c4b49f60d01b9112"} May 21 17:46:08.281850 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.281833 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:08.287350 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.287323 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" May 21 17:46:08.319100 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:08.319044 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pbl46" podStartSLOduration=2.208585768 podStartE2EDuration="4.319031042s" podCreationTimestamp="2026-05-21 17:46:04 +0000 UTC" firstStartedPulling="2026-05-21 17:46:05.449671383 +0000 UTC m=+180.212966955" lastFinishedPulling="2026-05-21 17:46:07.560116657 +0000 UTC m=+182.323412229" observedRunningTime="2026-05-21 17:46:08.318679843 +0000 UTC m=+183.081975439" watchObservedRunningTime="2026-05-21 17:46:08.319031042 +0000 UTC m=+183.082326630" May 21 17:46:09.705161 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:09.705081 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerName="registry" containerID="cri-o://8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308" gracePeriod=30 May 21 17:46:09.974522 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:09.974479 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:46:10.047071 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047033 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047213 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047083 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mmhz\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047213 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047115 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047213 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047151 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047387 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047231 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047387 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047259 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047387 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047305 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047387 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047337 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca\") pod \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\" (UID: \"85033e0e-05c4-4876-a2c1-8b2436af2f4d\") " May 21 17:46:10.047608 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047435 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:46:10.047608 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047565 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-certificates\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.047962 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.047899 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:46:10.050063 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.050032 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:46:10.050182 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.050120 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:46:10.050332 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.050305 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:46:10.051439 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.051405 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz" (OuterVolumeSpecName: "kube-api-access-6mmhz") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "kube-api-access-6mmhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:46:10.051892 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.051865 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:46:10.059187 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.059162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85033e0e-05c4-4876-a2c1-8b2436af2f4d" (UID: "85033e0e-05c4-4876-a2c1-8b2436af2f4d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:46:10.148756 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148733 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mmhz\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-kube-api-access-6mmhz\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148756 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148756 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85033e0e-05c4-4876-a2c1-8b2436af2f4d-ca-trust-extracted\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148923 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148766 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-registry-tls\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148923 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148776 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-image-registry-private-configuration\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148923 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148790 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85033e0e-05c4-4876-a2c1-8b2436af2f4d-bound-sa-token\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148923 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148806 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85033e0e-05c4-4876-a2c1-8b2436af2f4d-installation-pull-secrets\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.148923 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.148819 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85033e0e-05c4-4876-a2c1-8b2436af2f4d-trusted-ca\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:46:10.289727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.289633 2565 generic.go:358] "Generic (PLEG): container finished" podID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerID="8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308" exitCode=0 May 21 17:46:10.289727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.289721 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" May 21 17:46:10.289937 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.289719 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" event={"ID":"85033e0e-05c4-4876-a2c1-8b2436af2f4d","Type":"ContainerDied","Data":"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308"} May 21 17:46:10.289937 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.289765 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6bd5476d-7mjzk" event={"ID":"85033e0e-05c4-4876-a2c1-8b2436af2f4d","Type":"ContainerDied","Data":"ebc500cb29fdffc964d29ab71bc6a587cd08627963dcfd0f20f079feddda52ee"} May 21 17:46:10.289937 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.289786 2565 scope.go:117] "RemoveContainer" containerID="8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308" May 21 17:46:10.312976 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.312947 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:46:10.316976 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:10.316957 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c6bd5476d-7mjzk"] May 21 17:46:11.251389 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:11.251178 2565 scope.go:117] "RemoveContainer" containerID="8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308" May 21 17:46:11.251713 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:46:11.251554 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308\": container with ID starting with 8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308 not found: ID does not exist" containerID="8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308" May 21 17:46:11.251713 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:11.251596 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308"} err="failed to get container status \"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308\": rpc error: code = NotFound desc = could not find container \"8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308\": container with ID starting with 8f7ed1ff25921be1cc00da1b3342aaee32f3be0c53ed00b36a7f74bc55eda308 not found: ID does not exist" May 21 17:46:11.759839 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:11.759808 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" path="/var/lib/kubelet/pods/85033e0e-05c4-4876-a2c1-8b2436af2f4d/volumes" May 21 17:46:12.299511 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:12.299423 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} May 21 17:46:12.299511 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:12.299465 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} May 21 17:46:20.324403 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.324354 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-ttsbl" event={"ID":"e16c1885-64de-4860-befd-3ecfa7db3408","Type":"ContainerStarted","Data":"cda7d47b2810e8855a3d562d6cefc0912678360c584441cdaa91fee1a2ea9934"} May 21 17:46:20.324812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.324611 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:20.326432 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.326147 2565 patch_prober.go:28] interesting pod/downloads-57bd96b888-ttsbl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body= May 21 17:46:20.326432 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.326182 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-ttsbl" podUID="e16c1885-64de-4860-befd-3ecfa7db3408" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" May 21 17:46:20.327459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.327414 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} May 21 17:46:20.327459 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.327435 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} May 21 17:46:20.340463 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:20.340419 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-ttsbl" podStartSLOduration=1.227771773 podStartE2EDuration="18.340407256s" podCreationTimestamp="2026-05-21 17:46:02 +0000 UTC" firstStartedPulling="2026-05-21 17:46:03.073638363 +0000 UTC m=+177.836933930" lastFinishedPulling="2026-05-21 17:46:20.186273839 +0000 UTC m=+194.949569413" observedRunningTime="2026-05-21 17:46:20.339546443 +0000 UTC m=+195.102842033" watchObservedRunningTime="2026-05-21 17:46:20.340407256 +0000 UTC m=+195.103702843" May 21 17:46:21.334726 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:21.334690 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} May 21 17:46:21.335178 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:21.334736 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerStarted","Data":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} May 21 17:46:21.346134 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:21.346103 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-ttsbl" May 21 17:46:21.366519 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:21.366461 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.464203545 podStartE2EDuration="16.36644447s" podCreationTimestamp="2026-05-21 17:46:05 +0000 UTC" firstStartedPulling="2026-05-21 17:46:06.238911607 +0000 UTC m=+181.002207176" lastFinishedPulling="2026-05-21 17:46:20.141152535 +0000 UTC m=+194.904448101" observedRunningTime="2026-05-21 17:46:21.364053726 +0000 UTC m=+196.127349349" watchObservedRunningTime="2026-05-21 17:46:21.36644447 +0000 UTC m=+196.129740059" May 21 17:46:24.301246 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:24.301195 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:24.301697 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:24.301257 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:26.079998 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:26.079962 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:46:44.306460 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:44.306427 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:46:44.310326 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:46:44.310304 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-669666dcbb-mslgk" May 21 17:47:06.080329 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:06.080298 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:06.148069 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:06.148042 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:06.483378 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:06.483310 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:17.606145 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:17.606064 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:47:17.608319 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:17.608299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d1f90c2-c4a5-4731-a31b-b3c9b5330e49-metrics-certs\") pod \"network-metrics-daemon-nf2kh\" (UID: \"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49\") " pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:47:17.858356 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:17.858287 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4sh9\"" May 21 17:47:17.866153 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:17.866130 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf2kh" May 21 17:47:17.983199 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:17.983173 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nf2kh"] May 21 17:47:17.985779 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:47:17.985751 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1f90c2_c4a5_4731_a31b_b3c9b5330e49.slice/crio-6daec3ee69a4a278b6fc2c0c9567583bd263ff34c0c3e334138cd3d5c88dd1f2 WatchSource:0}: Error finding container 6daec3ee69a4a278b6fc2c0c9567583bd263ff34c0c3e334138cd3d5c88dd1f2: Status 404 returned error can't find the container with id 6daec3ee69a4a278b6fc2c0c9567583bd263ff34c0c3e334138cd3d5c88dd1f2 May 21 17:47:18.501286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:18.501247 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf2kh" event={"ID":"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49","Type":"ContainerStarted","Data":"6daec3ee69a4a278b6fc2c0c9567583bd263ff34c0c3e334138cd3d5c88dd1f2"} May 21 17:47:19.505962 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:19.505928 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf2kh" event={"ID":"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49","Type":"ContainerStarted","Data":"7b21477bad9a994900de7216b872ff2f4dc927d7f7fc3179f0f348a898271286"} May 21 17:47:19.506305 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:19.505968 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf2kh" event={"ID":"7d1f90c2-c4a5-4731-a31b-b3c9b5330e49","Type":"ContainerStarted","Data":"0a85d78a535342d6ae5bbdf97c0f4e23f15e0db90ca121d968e3b2d72523708e"} May 21 17:47:19.520722 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:19.520676 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nf2kh" podStartSLOduration=253.449565248 podStartE2EDuration="4m14.520660421s" podCreationTimestamp="2026-05-21 17:43:05 +0000 UTC" firstStartedPulling="2026-05-21 17:47:17.987638624 +0000 UTC m=+252.750934193" lastFinishedPulling="2026-05-21 17:47:19.058733786 +0000 UTC m=+253.822029366" observedRunningTime="2026-05-21 17:47:19.519953717 +0000 UTC m=+254.283249306" watchObservedRunningTime="2026-05-21 17:47:19.520660421 +0000 UTC m=+254.283956006" May 21 17:47:24.138039 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.137997 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:24.138571 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138481 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy" containerID="cri-o://a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" gracePeriod=600 May 21 17:47:24.138713 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138547 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="thanos-sidecar" containerID="cri-o://dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" gracePeriod=600 May 21 17:47:24.138713 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138569 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" gracePeriod=600 May 21 17:47:24.138713 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138606 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-web" containerID="cri-o://9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" gracePeriod=600 May 21 17:47:24.138891 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138469 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="prometheus" containerID="cri-o://e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" gracePeriod=600 May 21 17:47:24.138891 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.138644 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="config-reloader" containerID="cri-o://4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" gracePeriod=600 May 21 17:47:24.372954 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.372932 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.457070 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.456999 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457070 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457042 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zclg2\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457221 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457077 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457315 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457295 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457369 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457343 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457422 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457398 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457432 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457464 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457607 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457524 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457607 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457556 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457607 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457584 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457626 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457657 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:47:24.457749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457666 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457749 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457732 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457942 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457765 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457942 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457777 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:47:24.457942 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457799 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.457942 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457931 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.458133 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.457964 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle\") pod \"e0662617-d818-4deb-ba55-020f590ce4f3\" (UID: \"e0662617-d818-4deb-ba55-020f590ce4f3\") " May 21 17:47:24.458963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.458218 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-metrics-client-ca\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.458963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.458244 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.458963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.458602 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:47:24.458963 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.458929 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:47:24.459918 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.459882 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:47:24.460136 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460110 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.460271 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460231 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config" (OuterVolumeSpecName: "config") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.460389 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460304 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:47:24.460453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460423 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.460453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460439 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2" (OuterVolumeSpecName: "kube-api-access-zclg2") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "kube-api-access-zclg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:47:24.460935 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.460900 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.461415 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.461380 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.461415 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.461405 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.461964 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.461943 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.462068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.461959 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out" (OuterVolumeSpecName: "config-out") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:47:24.462068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.462028 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:47:24.462244 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.462228 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.472060 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.472040 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config" (OuterVolumeSpecName: "web-config") pod "e0662617-d818-4deb-ba55-020f590ce4f3" (UID: "e0662617-d818-4deb-ba55-020f590ce4f3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:47:24.521462 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521436 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" exitCode=0 May 21 17:47:24.521462 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521457 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" exitCode=0 May 21 17:47:24.521462 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521465 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" exitCode=0 May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521470 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" exitCode=0 May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521475 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" exitCode=0 May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521483 2565 generic.go:358] "Generic (PLEG): container finished" podID="e0662617-d818-4deb-ba55-020f590ce4f3" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" exitCode=0 May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521516 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521551 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521553 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521562 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521571 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521581 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521594 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521603 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0662617-d818-4deb-ba55-020f590ce4f3","Type":"ContainerDied","Data":"f35220998cd6160b55720530e715db3882f578fb777ef0a1eb5e25822824987b"} May 21 17:47:24.521635 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.521617 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.528473 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.528455 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.534879 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.534864 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.541066 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.541045 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.544773 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.544752 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:24.547712 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.547693 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.549700 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.549676 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:24.555116 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.555098 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.558767 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558743 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-config-out\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558776 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-kube-rbac-proxy\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558797 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558819 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558838 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-grpc-tls\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558858 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-tls-assets\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558872 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-db\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558888 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558901 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558914 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558934 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-metrics-client-certs\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558943 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-web-config\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558952 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0662617-d818-4deb-ba55-020f590ce4f3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558960 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558969 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zclg2\" (UniqueName: \"kubernetes.io/projected/e0662617-d818-4deb-ba55-020f590ce4f3-kube-api-access-zclg2\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.558977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.558977 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0662617-d818-4deb-ba55-020f590ce4f3-config\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:47:24.561621 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.561603 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.570595 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.570566 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.570804 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.570788 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:24.570888 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.570869 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.570948 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.570900 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.570948 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.570927 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.571088 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571075 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-thanos" May 21 17:47:24.571132 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571088 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-thanos" May 21 17:47:24.571132 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571104 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-web" May 21 17:47:24.571132 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571111 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-web" May 21 17:47:24.571132 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571119 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="prometheus" May 21 17:47:24.571132 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571125 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="prometheus" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571138 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerName="registry" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571146 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerName="registry" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571155 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="init-config-reloader" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571162 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="init-config-reloader" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571172 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="thanos-sidecar" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571177 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="thanos-sidecar" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571184 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571189 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.571189 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571221 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571244 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571201 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="config-reloader" May 21 17:47:24.571294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571299 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="config-reloader" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571394 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-thanos" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571410 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="thanos-sidecar" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571421 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy-web" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571434 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="kube-rbac-proxy" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571445 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="prometheus" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571455 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="85033e0e-05c4-4876-a2c1-8b2436af2f4d" containerName="registry" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571465 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" containerName="config-reloader" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.571485 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571530 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571551 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.571780 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571808 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.571916 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.571824 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.572031 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572050 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572065 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.572255 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572281 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572296 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:47:24.572511 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572532 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.572592 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572548 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.573002 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572757 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.573002 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572772 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.573002 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572956 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.573002 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.572969 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.573152 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573142 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.573190 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573154 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.573324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573308 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.573324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573323 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.573479 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573465 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.573555 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573479 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.573657 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573629 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.573657 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573649 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.573799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573785 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.573844 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573799 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.573959 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573945 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.574006 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.573959 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.574130 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574111 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.574196 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574133 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.574329 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574314 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.574375 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574330 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.574560 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574540 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.574611 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574561 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.574782 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574760 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.574843 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574783 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.574972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574953 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.575016 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.574973 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.575174 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575155 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.575238 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575175 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.575379 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575360 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.575379 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575377 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.575604 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575584 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.575658 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575605 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.575837 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575813 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.575920 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.575839 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.576093 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576073 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.576147 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576096 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.576323 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576303 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.576397 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576325 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.576556 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576534 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.576556 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576556 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.576772 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576752 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.576772 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576771 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.576887 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576877 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.576985 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576965 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.577037 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.576987 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.577277 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577224 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.577361 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577277 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.577571 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577544 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.577652 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577572 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.577845 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577825 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.577845 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.577844 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.578046 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578016 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.578046 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578042 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.578278 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578257 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.578340 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578279 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.578521 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578478 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.578566 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578523 2565 scope.go:117] "RemoveContainer" containerID="31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3" May 21 17:47:24.578759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578715 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3"} err="failed to get container status \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": rpc error: code = NotFound desc = could not find container \"31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3\": container with ID starting with 31605fe024c71ba49ca5b34c5de3e381e169b81df4beecf98664d80cf810fff3 not found: ID does not exist" May 21 17:47:24.578759 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578736 2565 scope.go:117] "RemoveContainer" containerID="a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d" May 21 17:47:24.578976 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578952 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d"} err="failed to get container status \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": rpc error: code = NotFound desc = could not find container \"a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d\": container with ID starting with a9ee7ba5c09a2bb2f83a736aae437f373f43b05fe9ddf80084b1ecc70c366f5d not found: ID does not exist" May 21 17:47:24.579030 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.578979 2565 scope.go:117] "RemoveContainer" containerID="9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d" May 21 17:47:24.579229 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579203 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d"} err="failed to get container status \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": rpc error: code = NotFound desc = could not find container \"9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d\": container with ID starting with 9b49406ee80fbb829e21c5751a5f856b66b8e45277e7de503bf5d911d9ba633d not found: ID does not exist" May 21 17:47:24.579229 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579228 2565 scope.go:117] "RemoveContainer" containerID="dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb" May 21 17:47:24.579358 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579270 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 17:47:24.579416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579358 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 17:47:24.579564 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579541 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb"} err="failed to get container status \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": rpc error: code = NotFound desc = could not find container \"dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb\": container with ID starting with dd977f5e7a172741afd2bebb35afbecaeadf53f6b072a2190e390d8744020dfb not found: ID does not exist" May 21 17:47:24.579627 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579567 2565 scope.go:117] "RemoveContainer" containerID="4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a" May 21 17:47:24.579754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579722 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 17:47:24.579754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579722 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mqw5f\"" May 21 17:47:24.579872 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579822 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a"} err="failed to get container status \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": rpc error: code = NotFound desc = could not find container \"4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a\": container with ID starting with 4c0d68b26f5ffb9e1f93fff8543d1d21c2705cfbb8141be703b60eb910ab935a not found: ID does not exist" May 21 17:47:24.579872 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579845 2565 scope.go:117] "RemoveContainer" containerID="e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52" May 21 17:47:24.579978 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.579961 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 17:47:24.580084 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580066 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5jgf7deifhstl\"" May 21 17:47:24.580145 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580127 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52"} err="failed to get container status \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": rpc error: code = NotFound desc = could not find container \"e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52\": container with ID starting with e7d4f2c54d16f28ce5d69f061f0ec7620e879658f8df66f3a1e1667ccf6cee52 not found: ID does not exist" May 21 17:47:24.580200 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580151 2565 scope.go:117] "RemoveContainer" containerID="de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1" May 21 17:47:24.580316 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580298 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 17:47:24.580381 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580323 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 17:47:24.580381 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580370 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 17:47:24.580498 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580422 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 17:47:24.580560 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580509 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1"} err="failed to get container status \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": rpc error: code = NotFound desc = could not find container \"de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1\": container with ID starting with de5b86a57a750035b2b8ff9bc7a78d21a2a0799e157a2a000aa6ac671dc030e1 not found: ID does not exist" May 21 17:47:24.580731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580712 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 17:47:24.580776 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.580709 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 17:47:24.582580 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.582562 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 17:47:24.586301 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.586131 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 17:47:24.586682 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.586659 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:24.660208 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660294 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ldj\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-kube-api-access-k7ldj\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660458 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.660728 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.660630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761347 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761296 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761347 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761324 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761469 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761469 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761376 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761484 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761544 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761662 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761572 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761662 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761599 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ldj\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-kube-api-access-k7ldj\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761662 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761645 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761705 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761734 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761755 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.761799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761794 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.762056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761818 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.762056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761843 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.762056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761870 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.762056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.761933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.762678 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.762653 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.763424 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.762834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.763424 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.762975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.763424 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.763102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.763959 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.763941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.764472 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.764450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.764863 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.764837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.764937 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.764864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.765054 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.765038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.765357 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.765333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.765569 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.765433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.766241 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.766217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.766537 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.766519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.766596 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.766532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.766904 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.766886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.767033 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.767017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.767598 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.767582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.772399 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.772381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ldj\" (UniqueName: \"kubernetes.io/projected/b25989bb-8e6a-42f7-87d4-1cd628dc5cd9-kube-api-access-k7ldj\") pod \"prometheus-k8s-0\" (UID: \"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:24.887948 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:24.887930 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:47:25.013526 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:25.013427 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:47:25.016911 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:47:25.016885 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25989bb_8e6a_42f7_87d4_1cd628dc5cd9.slice/crio-bf1e6296136c833e293ba117c7d4697cd847bb9334447cb6ce8fd5b78723e060 WatchSource:0}: Error finding container bf1e6296136c833e293ba117c7d4697cd847bb9334447cb6ce8fd5b78723e060: Status 404 returned error can't find the container with id bf1e6296136c833e293ba117c7d4697cd847bb9334447cb6ce8fd5b78723e060 May 21 17:47:25.529411 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:25.529378 2565 generic.go:358] "Generic (PLEG): container finished" podID="b25989bb-8e6a-42f7-87d4-1cd628dc5cd9" containerID="0e03542133f0b261b01c3e0055ab501fcb21c83147ab75bbe94da09eae824d84" exitCode=0 May 21 17:47:25.529790 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:25.529442 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerDied","Data":"0e03542133f0b261b01c3e0055ab501fcb21c83147ab75bbe94da09eae824d84"} May 21 17:47:25.529790 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:25.529485 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"bf1e6296136c833e293ba117c7d4697cd847bb9334447cb6ce8fd5b78723e060"} May 21 17:47:25.760159 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:25.760126 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0662617-d818-4deb-ba55-020f590ce4f3" path="/var/lib/kubelet/pods/e0662617-d818-4deb-ba55-020f590ce4f3/volumes" May 21 17:47:26.535252 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535219 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"2a28a5951c4aba32d1dfc42d4af72109884b30bf4a705fd6fbd15dedf0789899"} May 21 17:47:26.535252 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535256 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"fa911d9b83776633d3d259541e38cb55b4c2d2bba3ac994cfa68d0263c520963"} May 21 17:47:26.535672 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535271 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"0766d4ab1b5901ce18bd83aa2236889fb0120d8895807eb18094c10b6e0034b5"} May 21 17:47:26.535672 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535283 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"37c841ab19ecf2665ea348b648f4029487908d9f63fd4297d4e38bb859c8792b"} May 21 17:47:26.535672 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535291 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"90fcf36bec9648dea9ba5b98e2065e5c7df5f205301ac807ece63fcaa7cbda95"} May 21 17:47:26.535672 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.535299 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b25989bb-8e6a-42f7-87d4-1cd628dc5cd9","Type":"ContainerStarted","Data":"a3d507d69d98ec93c7235b45b6796aa4623bd2c365d6dbab2b505bc55838e0d7"} May 21 17:47:26.560694 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:26.560643 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.560627793 podStartE2EDuration="2.560627793s" podCreationTimestamp="2026-05-21 17:47:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:47:26.558284254 +0000 UTC m=+261.321579841" watchObservedRunningTime="2026-05-21 17:47:26.560627793 +0000 UTC m=+261.323923380" May 21 17:47:29.888993 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:47:29.888955 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:48:05.676432 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:05.676398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:48:05.677494 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:05.677466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:48:05.679393 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:05.679369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:48:05.680414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:05.680388 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:48:05.686834 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:05.686819 2565 kubelet.go:1628] "Image garbage collection succeeded" May 21 17:48:24.888746 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:24.888709 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:48:24.903912 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:24.903889 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:48:25.731116 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:48:25.731081 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:50:09.087471 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.087439 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt"] May 21 17:50:09.090655 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.090636 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.093022 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.093001 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 17:50:09.093898 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.093882 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qxbhd\"" May 21 17:50:09.093976 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.093882 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 17:50:09.098002 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.097983 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt"] May 21 17:50:09.132454 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.132429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gkmm\" (UniqueName: \"kubernetes.io/projected/0eee86ae-dea8-4680-8ec5-d622fd345523-kube-api-access-9gkmm\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.132558 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.132471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eee86ae-dea8-4680-8ec5-d622fd345523-tmp\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.233750 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.233722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gkmm\" (UniqueName: \"kubernetes.io/projected/0eee86ae-dea8-4680-8ec5-d622fd345523-kube-api-access-9gkmm\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.233902 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.233782 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eee86ae-dea8-4680-8ec5-d622fd345523-tmp\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.234189 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.234170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eee86ae-dea8-4680-8ec5-d622fd345523-tmp\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.241371 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.241352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gkmm\" (UniqueName: \"kubernetes.io/projected/0eee86ae-dea8-4680-8ec5-d622fd345523-kube-api-access-9gkmm\") pod \"openshift-lws-operator-bfc7f696d-mhcwt\" (UID: \"0eee86ae-dea8-4680-8ec5-d622fd345523\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.409891 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.409828 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" May 21 17:50:09.532102 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.532003 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt"] May 21 17:50:09.534901 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:50:09.534860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0eee86ae_dea8_4680_8ec5_d622fd345523.slice/crio-3942971032ab2ce7329162c3e1cd9440eeacff8beacecc8e8f732a1af90a060d WatchSource:0}: Error finding container 3942971032ab2ce7329162c3e1cd9440eeacff8beacecc8e8f732a1af90a060d: Status 404 returned error can't find the container with id 3942971032ab2ce7329162c3e1cd9440eeacff8beacecc8e8f732a1af90a060d May 21 17:50:09.536215 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.536198 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:50:09.983483 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:09.983446 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" event={"ID":"0eee86ae-dea8-4680-8ec5-d622fd345523","Type":"ContainerStarted","Data":"3942971032ab2ce7329162c3e1cd9440eeacff8beacecc8e8f732a1af90a060d"} May 21 17:50:12.995015 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:12.994978 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" event={"ID":"0eee86ae-dea8-4680-8ec5-d622fd345523","Type":"ContainerStarted","Data":"6a0039dd029374f648a72af13213165d15b4dfd293becd4fe0767088cca09eb8"} May 21 17:50:13.010711 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:13.010667 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mhcwt" podStartSLOduration=1.411766082 podStartE2EDuration="4.010653624s" podCreationTimestamp="2026-05-21 17:50:09 +0000 UTC" firstStartedPulling="2026-05-21 17:50:09.536322968 +0000 UTC m=+424.299618533" lastFinishedPulling="2026-05-21 17:50:12.135210506 +0000 UTC m=+426.898506075" observedRunningTime="2026-05-21 17:50:13.009302234 +0000 UTC m=+427.772597819" watchObservedRunningTime="2026-05-21 17:50:13.010653624 +0000 UTC m=+427.773949213" May 21 17:50:21.844966 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.844889 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr"] May 21 17:50:21.848077 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.848061 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:21.851395 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.851371 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lfh8z\"" May 21 17:50:21.851519 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.851371 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 17:50:21.851691 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.851674 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 17:50:21.851754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.851679 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 17:50:21.863258 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.863238 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr"] May 21 17:50:21.931027 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.931005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:21.931134 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.931040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gcw\" (UniqueName: \"kubernetes.io/projected/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-kube-api-access-p2gcw\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:21.931134 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.931085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-manager-config\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:21.931134 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:21.931107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-metrics-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.031936 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.031911 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.032050 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.031950 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gcw\" (UniqueName: \"kubernetes.io/projected/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-kube-api-access-p2gcw\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.032050 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.031984 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-manager-config\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.032050 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.032010 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-metrics-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.032676 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.032650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-manager-config\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.034260 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.034240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-metrics-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.034397 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.034378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-cert\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.039736 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.039718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gcw\" (UniqueName: \"kubernetes.io/projected/dbacdf70-7e01-4657-8976-a2b86d2ab7cd-kube-api-access-p2gcw\") pod \"lws-controller-manager-786cf8fdc-4dskr\" (UID: \"dbacdf70-7e01-4657-8976-a2b86d2ab7cd\") " pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.157403 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.157318 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:22.278950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:22.278919 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr"] May 21 17:50:22.282454 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:50:22.282429 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbacdf70_7e01_4657_8976_a2b86d2ab7cd.slice/crio-317d7d33e0f2c8d84f13470f45ff70aa0047ed7341524b136115af416392998d WatchSource:0}: Error finding container 317d7d33e0f2c8d84f13470f45ff70aa0047ed7341524b136115af416392998d: Status 404 returned error can't find the container with id 317d7d33e0f2c8d84f13470f45ff70aa0047ed7341524b136115af416392998d May 21 17:50:23.022142 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:23.022108 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" event={"ID":"dbacdf70-7e01-4657-8976-a2b86d2ab7cd","Type":"ContainerStarted","Data":"317d7d33e0f2c8d84f13470f45ff70aa0047ed7341524b136115af416392998d"} May 21 17:50:25.028948 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:25.028912 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" event={"ID":"dbacdf70-7e01-4657-8976-a2b86d2ab7cd","Type":"ContainerStarted","Data":"d0e9cac36c85f5ed7d3345f9605ced893bf2b0c33a735cfec23c5a046844eaad"} May 21 17:50:25.029355 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:25.029080 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:25.045641 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:25.045598 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" podStartSLOduration=1.851713996 podStartE2EDuration="4.045584946s" podCreationTimestamp="2026-05-21 17:50:21 +0000 UTC" firstStartedPulling="2026-05-21 17:50:22.284313965 +0000 UTC m=+437.047609532" lastFinishedPulling="2026-05-21 17:50:24.478184917 +0000 UTC m=+439.241480482" observedRunningTime="2026-05-21 17:50:25.04326854 +0000 UTC m=+439.806564168" watchObservedRunningTime="2026-05-21 17:50:25.045584946 +0000 UTC m=+439.808880530" May 21 17:50:31.944634 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.944603 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv"] May 21 17:50:31.948359 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.948336 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:31.951148 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.951114 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 17:50:31.951425 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.951404 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 17:50:31.954324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.952302 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 17:50:31.954324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.952347 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6hwvz\"" May 21 17:50:31.954324 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.952599 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 17:50:31.963971 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:31.963947 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv"] May 21 17:50:32.116424 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.116394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5snk\" (UniqueName: \"kubernetes.io/projected/b8b65cf1-3fff-4190-ace4-caf41904619e-kube-api-access-v5snk\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.116551 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.116452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.116551 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.116525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.217550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.217463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.217660 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.217558 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5snk\" (UniqueName: \"kubernetes.io/projected/b8b65cf1-3fff-4190-ace4-caf41904619e-kube-api-access-v5snk\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.217660 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.217627 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.219907 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.219880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.219994 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.219880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8b65cf1-3fff-4190-ace4-caf41904619e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.225456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.225434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5snk\" (UniqueName: \"kubernetes.io/projected/b8b65cf1-3fff-4190-ace4-caf41904619e-kube-api-access-v5snk\") pod \"opendatahub-operator-controller-manager-5b676496df-dqpvv\" (UID: \"b8b65cf1-3fff-4190-ace4-caf41904619e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.262403 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.262379 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:32.386815 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:32.386784 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv"] May 21 17:50:32.389443 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:50:32.389410 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b65cf1_3fff_4190_ace4_caf41904619e.slice/crio-f764207307358f36e15d064456caac07f47c788ef88b4aceee455ebc13523b93 WatchSource:0}: Error finding container f764207307358f36e15d064456caac07f47c788ef88b4aceee455ebc13523b93: Status 404 returned error can't find the container with id f764207307358f36e15d064456caac07f47c788ef88b4aceee455ebc13523b93 May 21 17:50:33.057513 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:33.057440 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" event={"ID":"b8b65cf1-3fff-4190-ace4-caf41904619e","Type":"ContainerStarted","Data":"f764207307358f36e15d064456caac07f47c788ef88b4aceee455ebc13523b93"} May 21 17:50:35.065364 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:35.065329 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" event={"ID":"b8b65cf1-3fff-4190-ace4-caf41904619e","Type":"ContainerStarted","Data":"e14273b79f7ff4d689b4eb29e61918e8b2759285602066e53e904a21b22e0272"} May 21 17:50:35.065741 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:35.065423 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:50:35.086882 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:35.086797 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" podStartSLOduration=1.6486287590000002 podStartE2EDuration="4.086785937s" podCreationTimestamp="2026-05-21 17:50:31 +0000 UTC" firstStartedPulling="2026-05-21 17:50:32.391104415 +0000 UTC m=+447.154399985" lastFinishedPulling="2026-05-21 17:50:34.829261588 +0000 UTC m=+449.592557163" observedRunningTime="2026-05-21 17:50:35.084426697 +0000 UTC m=+449.847722285" watchObservedRunningTime="2026-05-21 17:50:35.086785937 +0000 UTC m=+449.850081599" May 21 17:50:36.034633 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:36.034602 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-786cf8fdc-4dskr" May 21 17:50:46.071224 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:50:46.071192 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b676496df-dqpvv" May 21 17:51:00.052056 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.052026 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn"] May 21 17:51:00.054968 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.054949 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.057710 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.057690 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 17:51:00.058389 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.058369 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 17:51:00.058484 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.058384 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 17:51:00.058484 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.058393 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 17:51:00.058770 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.058738 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x2sct\"" May 21 17:51:00.074283 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.074259 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn"] May 21 17:51:00.137394 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.137359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f180e-47cf-49eb-b304-de0364a049f9-tmp\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.137571 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.137412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbs2\" (UniqueName: \"kubernetes.io/projected/3c6f180e-47cf-49eb-b304-de0364a049f9-kube-api-access-xvbs2\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.137571 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.137442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6f180e-47cf-49eb-b304-de0364a049f9-tls-certs\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.238692 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.238642 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6f180e-47cf-49eb-b304-de0364a049f9-tls-certs\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.238857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.238734 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f180e-47cf-49eb-b304-de0364a049f9-tmp\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.238857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.238817 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbs2\" (UniqueName: \"kubernetes.io/projected/3c6f180e-47cf-49eb-b304-de0364a049f9-kube-api-access-xvbs2\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.241083 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.241051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f180e-47cf-49eb-b304-de0364a049f9-tmp\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.241307 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.241284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6f180e-47cf-49eb-b304-de0364a049f9-tls-certs\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.249920 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.249895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbs2\" (UniqueName: \"kubernetes.io/projected/3c6f180e-47cf-49eb-b304-de0364a049f9-kube-api-access-xvbs2\") pod \"kube-auth-proxy-54f55555d9-h8jxn\" (UID: \"3c6f180e-47cf-49eb-b304-de0364a049f9\") " pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.365656 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.365628 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" May 21 17:51:00.488751 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:00.488582 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn"] May 21 17:51:00.490912 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:51:00.490883 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6f180e_47cf_49eb_b304_de0364a049f9.slice/crio-bf5755fd83a879576b23aa226591d483e15936135661035a3776485f1c1aa0c6 WatchSource:0}: Error finding container bf5755fd83a879576b23aa226591d483e15936135661035a3776485f1c1aa0c6: Status 404 returned error can't find the container with id bf5755fd83a879576b23aa226591d483e15936135661035a3776485f1c1aa0c6 May 21 17:51:01.146038 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:01.145843 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" event={"ID":"3c6f180e-47cf-49eb-b304-de0364a049f9","Type":"ContainerStarted","Data":"bf5755fd83a879576b23aa226591d483e15936135661035a3776485f1c1aa0c6"} May 21 17:51:04.159003 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:04.158966 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" event={"ID":"3c6f180e-47cf-49eb-b304-de0364a049f9","Type":"ContainerStarted","Data":"58279da597aee421629acd88d0864b50d4c9e19928bfc5cd5b8ef459d3c5c997"} May 21 17:51:04.176813 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:51:04.176771 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54f55555d9-h8jxn" podStartSLOduration=1.316278425 podStartE2EDuration="4.176757494s" podCreationTimestamp="2026-05-21 17:51:00 +0000 UTC" firstStartedPulling="2026-05-21 17:51:00.492552408 +0000 UTC m=+475.255847976" lastFinishedPulling="2026-05-21 17:51:03.353031466 +0000 UTC m=+478.116327045" observedRunningTime="2026-05-21 17:51:04.17468313 +0000 UTC m=+478.937978718" watchObservedRunningTime="2026-05-21 17:51:04.176757494 +0000 UTC m=+478.940053081" May 21 17:52:35.167240 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.167207 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f"] May 21 17:52:35.170434 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.170407 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.172646 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.172624 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 17:52:35.173282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.173262 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 17:52:35.173282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.173273 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 17:52:35.173417 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.173305 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97l5b\"" May 21 17:52:35.173417 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.173353 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 17:52:35.177107 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.177087 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f"] May 21 17:52:35.271461 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.271423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486c033c-4d41-4ca5-a591-1c5a4beabcdb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.271656 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.271482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.271656 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.271548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtpfr\" (UniqueName: \"kubernetes.io/projected/486c033c-4d41-4ca5-a591-1c5a4beabcdb-kube-api-access-jtpfr\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.372260 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.372220 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.372456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.372276 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtpfr\" (UniqueName: \"kubernetes.io/projected/486c033c-4d41-4ca5-a591-1c5a4beabcdb-kube-api-access-jtpfr\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.372456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.372317 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486c033c-4d41-4ca5-a591-1c5a4beabcdb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.372456 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:52:35.372364 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 17:52:35.372456 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:52:35.372444 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert podName:486c033c-4d41-4ca5-a591-1c5a4beabcdb nodeName:}" failed. No retries permitted until 2026-05-21 17:52:35.872426593 +0000 UTC m=+570.635722164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-cwz9f" (UID: "486c033c-4d41-4ca5-a591-1c5a4beabcdb") : secret "plugin-serving-cert" not found May 21 17:52:35.372932 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.372911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/486c033c-4d41-4ca5-a591-1c5a4beabcdb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.389207 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.389184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtpfr\" (UniqueName: \"kubernetes.io/projected/486c033c-4d41-4ca5-a591-1c5a4beabcdb-kube-api-access-jtpfr\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.876313 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.876275 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:35.878666 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:35.878635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/486c033c-4d41-4ca5-a591-1c5a4beabcdb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-cwz9f\" (UID: \"486c033c-4d41-4ca5-a591-1c5a4beabcdb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:36.081280 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:36.081245 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" May 21 17:52:36.215275 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:36.215249 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f"] May 21 17:52:36.217565 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:52:36.217536 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod486c033c_4d41_4ca5_a591_1c5a4beabcdb.slice/crio-7540adbeed03c45dc005cab5b7ed4501bf40181d8afde3f27df3df7788873429 WatchSource:0}: Error finding container 7540adbeed03c45dc005cab5b7ed4501bf40181d8afde3f27df3df7788873429: Status 404 returned error can't find the container with id 7540adbeed03c45dc005cab5b7ed4501bf40181d8afde3f27df3df7788873429 May 21 17:52:36.460641 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:36.460551 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" event={"ID":"486c033c-4d41-4ca5-a591-1c5a4beabcdb","Type":"ContainerStarted","Data":"7540adbeed03c45dc005cab5b7ed4501bf40181d8afde3f27df3df7788873429"} May 21 17:52:58.542651 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:58.542611 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" event={"ID":"486c033c-4d41-4ca5-a591-1c5a4beabcdb","Type":"ContainerStarted","Data":"ae67f44fb289eb8e7b41efb64b4e5df8877d1c383169ec5c14b461500b381f0f"} May 21 17:52:58.559949 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:52:58.559905 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-cwz9f" podStartSLOduration=1.83410011 podStartE2EDuration="23.559892218s" podCreationTimestamp="2026-05-21 17:52:35 +0000 UTC" firstStartedPulling="2026-05-21 17:52:36.218878946 +0000 UTC m=+570.982174512" lastFinishedPulling="2026-05-21 17:52:57.944671037 +0000 UTC m=+592.707966620" observedRunningTime="2026-05-21 17:52:58.558565668 +0000 UTC m=+593.321861258" watchObservedRunningTime="2026-05-21 17:52:58.559892218 +0000 UTC m=+593.323187806" May 21 17:53:05.701006 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:05.700972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:53:05.701418 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:05.701262 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:53:05.703620 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:05.703601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:53:05.703962 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:05.703942 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:53:29.202436 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.202402 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:29.206057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.206025 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:29.208103 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.208077 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wm5dh\"" May 21 17:53:29.209076 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.209050 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:29.333682 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.333650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2qs\" (UniqueName: \"kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs\") pod \"authorino-f99f4b5cd-rmhqq\" (UID: \"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4\") " pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:29.405384 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.405351 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:53:29.408780 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.408759 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:53:29.414628 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.414593 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:53:29.434414 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.434389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2qs\" (UniqueName: \"kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs\") pod \"authorino-f99f4b5cd-rmhqq\" (UID: \"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4\") " pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:29.441756 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.441734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2qs\" (UniqueName: \"kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs\") pod \"authorino-f99f4b5cd-rmhqq\" (UID: \"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4\") " pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:29.516946 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.516872 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:29.534987 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.534960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xkhk\" (UniqueName: \"kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk\") pod \"authorino-7498df8756-vdxnr\" (UID: \"e627b57f-a736-4f2c-9245-3080e8545fd0\") " pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:53:29.636068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.636035 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xkhk\" (UniqueName: \"kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk\") pod \"authorino-7498df8756-vdxnr\" (UID: \"e627b57f-a736-4f2c-9245-3080e8545fd0\") " pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:53:29.641088 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.641058 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:29.644124 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:53:29.644088 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e4c45a9_3054_4b7c_9bbc_c93efcf952f4.slice/crio-e27f69a480ab7f07860dc9ab0d4586992f6ac9f35e50a91dae18428584281acf WatchSource:0}: Error finding container e27f69a480ab7f07860dc9ab0d4586992f6ac9f35e50a91dae18428584281acf: Status 404 returned error can't find the container with id e27f69a480ab7f07860dc9ab0d4586992f6ac9f35e50a91dae18428584281acf May 21 17:53:29.644275 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.644254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xkhk\" (UniqueName: \"kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk\") pod \"authorino-7498df8756-vdxnr\" (UID: \"e627b57f-a736-4f2c-9245-3080e8545fd0\") " pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:53:29.719552 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.719526 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:53:29.849512 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:29.849393 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:53:29.852051 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:53:29.852024 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode627b57f_a736_4f2c_9245_3080e8545fd0.slice/crio-903f2f1f2df7530ec2105f5e25d85df145713c407115940fbfe928302906d321 WatchSource:0}: Error finding container 903f2f1f2df7530ec2105f5e25d85df145713c407115940fbfe928302906d321: Status 404 returned error can't find the container with id 903f2f1f2df7530ec2105f5e25d85df145713c407115940fbfe928302906d321 May 21 17:53:30.653312 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:30.653268 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" event={"ID":"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4","Type":"ContainerStarted","Data":"e27f69a480ab7f07860dc9ab0d4586992f6ac9f35e50a91dae18428584281acf"} May 21 17:53:30.656542 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:30.656512 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-vdxnr" event={"ID":"e627b57f-a736-4f2c-9245-3080e8545fd0","Type":"ContainerStarted","Data":"903f2f1f2df7530ec2105f5e25d85df145713c407115940fbfe928302906d321"} May 21 17:53:33.667741 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:33.667696 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-vdxnr" event={"ID":"e627b57f-a736-4f2c-9245-3080e8545fd0","Type":"ContainerStarted","Data":"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be"} May 21 17:53:33.669034 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:33.669006 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" event={"ID":"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4","Type":"ContainerStarted","Data":"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b"} May 21 17:53:33.681563 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:33.681521 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-vdxnr" podStartSLOduration=1.274050234 podStartE2EDuration="4.681507405s" podCreationTimestamp="2026-05-21 17:53:29 +0000 UTC" firstStartedPulling="2026-05-21 17:53:29.85330302 +0000 UTC m=+624.616598586" lastFinishedPulling="2026-05-21 17:53:33.260760177 +0000 UTC m=+628.024055757" observedRunningTime="2026-05-21 17:53:33.679923276 +0000 UTC m=+628.443218866" watchObservedRunningTime="2026-05-21 17:53:33.681507405 +0000 UTC m=+628.444802990" May 21 17:53:33.693262 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:33.693214 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" podStartSLOduration=1.088109861 podStartE2EDuration="4.693200549s" podCreationTimestamp="2026-05-21 17:53:29 +0000 UTC" firstStartedPulling="2026-05-21 17:53:29.645377911 +0000 UTC m=+624.408673478" lastFinishedPulling="2026-05-21 17:53:33.250468597 +0000 UTC m=+628.013764166" observedRunningTime="2026-05-21 17:53:33.692084875 +0000 UTC m=+628.455380460" watchObservedRunningTime="2026-05-21 17:53:33.693200549 +0000 UTC m=+628.456496115" May 21 17:53:33.715424 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:33.715391 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:35.677412 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:35.677372 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" podUID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" containerName="authorino" containerID="cri-o://1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b" gracePeriod=30 May 21 17:53:35.921755 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:35.921727 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:36.098400 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.098371 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m2qs\" (UniqueName: \"kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs\") pod \"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4\" (UID: \"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4\") " May 21 17:53:36.100520 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.100497 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs" (OuterVolumeSpecName: "kube-api-access-9m2qs") pod "3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" (UID: "3e4c45a9-3054-4b7c-9bbc-c93efcf952f4"). InnerVolumeSpecName "kube-api-access-9m2qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:53:36.199992 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.199962 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m2qs\" (UniqueName: \"kubernetes.io/projected/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4-kube-api-access-9m2qs\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:53:36.681903 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.681868 2565 generic.go:358] "Generic (PLEG): container finished" podID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" containerID="1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b" exitCode=0 May 21 17:53:36.682375 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.681938 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" May 21 17:53:36.682375 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.681938 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" event={"ID":"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4","Type":"ContainerDied","Data":"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b"} May 21 17:53:36.682375 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.682055 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-rmhqq" event={"ID":"3e4c45a9-3054-4b7c-9bbc-c93efcf952f4","Type":"ContainerDied","Data":"e27f69a480ab7f07860dc9ab0d4586992f6ac9f35e50a91dae18428584281acf"} May 21 17:53:36.682375 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.682080 2565 scope.go:117] "RemoveContainer" containerID="1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b" May 21 17:53:36.691617 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.691076 2565 scope.go:117] "RemoveContainer" containerID="1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b" May 21 17:53:36.693018 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:53:36.692992 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b\": container with ID starting with 1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b not found: ID does not exist" containerID="1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b" May 21 17:53:36.693119 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.693023 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b"} err="failed to get container status \"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b\": rpc error: code = NotFound desc = could not find container \"1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b\": container with ID starting with 1b544e1bc3dfd13af4dd551bc5a8a6cb27c4ef61c9ed25e573202e7e38731f1b not found: ID does not exist" May 21 17:53:36.701475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.701450 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:36.705145 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:36.705123 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-rmhqq"] May 21 17:53:37.759323 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:37.759286 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" path="/var/lib/kubelet/pods/3e4c45a9-3054-4b7c-9bbc-c93efcf952f4/volumes" May 21 17:53:59.771730 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.771699 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-6kcw2"] May 21 17:53:59.772165 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.771998 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" containerName="authorino" May 21 17:53:59.772165 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.772009 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" containerName="authorino" May 21 17:53:59.772165 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.772067 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e4c45a9-3054-4b7c-9bbc-c93efcf952f4" containerName="authorino" May 21 17:53:59.774967 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.774950 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:53:59.780106 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.780082 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-6kcw2"] May 21 17:53:59.891617 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.891580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqtg\" (UniqueName: \"kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg\") pod \"authorino-8b475cf9f-6kcw2\" (UID: \"213b1c76-796c-4be1-a09d-04e28e8ba5c4\") " pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:53:59.930468 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.930439 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-6kcw2"] May 21 17:53:59.930746 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:53:59.930722 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8gqtg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-6kcw2" podUID="213b1c76-796c-4be1-a09d-04e28e8ba5c4" May 21 17:53:59.954634 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.954598 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-6z7pl"] May 21 17:53:59.957857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.957833 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:53:59.959922 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.959902 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 17:53:59.964786 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.964647 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-6z7pl"] May 21 17:53:59.992893 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:53:59.992871 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqtg\" (UniqueName: \"kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg\") pod \"authorino-8b475cf9f-6kcw2\" (UID: \"213b1c76-796c-4be1-a09d-04e28e8ba5c4\") " pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:54:00.000748 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.000730 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqtg\" (UniqueName: \"kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg\") pod \"authorino-8b475cf9f-6kcw2\" (UID: \"213b1c76-796c-4be1-a09d-04e28e8ba5c4\") " pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:54:00.039656 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.039594 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-6z7pl"] May 21 17:54:00.039832 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:54:00.039812 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wd65w tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-wd65w tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-6z7pl" podUID="dafb7ac4-788e-4ee2-93b9-55cdea8840ab" May 21 17:54:00.084380 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.084347 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:54:00.087484 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.087465 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.093543 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.093516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.093633 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.093589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd65w\" (UniqueName: \"kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.108537 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.108515 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:54:00.194730 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.194695 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.194880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.194746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kd5m\" (UniqueName: \"kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.194880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.194783 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd65w\" (UniqueName: \"kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.194880 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.194799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.197067 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.197045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.201569 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.201551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd65w\" (UniqueName: \"kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w\") pod \"authorino-56fdd757f5-6z7pl\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.295410 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.295343 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kd5m\" (UniqueName: \"kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.295410 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.295388 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.297605 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.297588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.302739 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.302713 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kd5m\" (UniqueName: \"kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m\") pod \"authorino-6dc49475ff-6vdvl\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.396282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.396247 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:54:00.518637 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.518609 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:54:00.521759 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:54:00.521728 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c5a279_4bd1_4c93_b2f1_13a48ee131e4.slice/crio-0948111915a733611b58c06f584f9df28a7d545007b0ea7393a5e9a217e1e603 WatchSource:0}: Error finding container 0948111915a733611b58c06f584f9df28a7d545007b0ea7393a5e9a217e1e603: Status 404 returned error can't find the container with id 0948111915a733611b58c06f584f9df28a7d545007b0ea7393a5e9a217e1e603 May 21 17:54:00.761351 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.761317 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" event={"ID":"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4","Type":"ContainerStarted","Data":"0948111915a733611b58c06f584f9df28a7d545007b0ea7393a5e9a217e1e603"} May 21 17:54:00.761351 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.761343 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:54:00.761587 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.761343 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.766188 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.766160 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:54:00.769440 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.769424 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:00.900468 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.900438 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert\") pod \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " May 21 17:54:00.900846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.900549 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gqtg\" (UniqueName: \"kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg\") pod \"213b1c76-796c-4be1-a09d-04e28e8ba5c4\" (UID: \"213b1c76-796c-4be1-a09d-04e28e8ba5c4\") " May 21 17:54:00.900846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.900616 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd65w\" (UniqueName: \"kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w\") pod \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\" (UID: \"dafb7ac4-788e-4ee2-93b9-55cdea8840ab\") " May 21 17:54:00.902484 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.902453 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dafb7ac4-788e-4ee2-93b9-55cdea8840ab" (UID: "dafb7ac4-788e-4ee2-93b9-55cdea8840ab"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:54:00.902602 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.902589 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg" (OuterVolumeSpecName: "kube-api-access-8gqtg") pod "213b1c76-796c-4be1-a09d-04e28e8ba5c4" (UID: "213b1c76-796c-4be1-a09d-04e28e8ba5c4"). InnerVolumeSpecName "kube-api-access-8gqtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:54:00.902655 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:00.902637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w" (OuterVolumeSpecName: "kube-api-access-wd65w") pod "dafb7ac4-788e-4ee2-93b9-55cdea8840ab" (UID: "dafb7ac4-788e-4ee2-93b9-55cdea8840ab"). InnerVolumeSpecName "kube-api-access-wd65w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:54:01.002271 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.002234 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-tls-cert\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:01.002271 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.002271 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gqtg\" (UniqueName: \"kubernetes.io/projected/213b1c76-796c-4be1-a09d-04e28e8ba5c4-kube-api-access-8gqtg\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:01.002465 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.002289 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd65w\" (UniqueName: \"kubernetes.io/projected/dafb7ac4-788e-4ee2-93b9-55cdea8840ab-kube-api-access-wd65w\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:01.770421 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.770388 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" event={"ID":"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4","Type":"ContainerStarted","Data":"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa"} May 21 17:54:01.770555 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.770443 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-6z7pl" May 21 17:54:01.770555 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.770519 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-6kcw2" May 21 17:54:01.784186 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.784147 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" podStartSLOduration=1.448867848 podStartE2EDuration="1.784137755s" podCreationTimestamp="2026-05-21 17:54:00 +0000 UTC" firstStartedPulling="2026-05-21 17:54:00.522881243 +0000 UTC m=+655.286176810" lastFinishedPulling="2026-05-21 17:54:00.858151138 +0000 UTC m=+655.621446717" observedRunningTime="2026-05-21 17:54:01.783197007 +0000 UTC m=+656.546492595" watchObservedRunningTime="2026-05-21 17:54:01.784137755 +0000 UTC m=+656.547433385" May 21 17:54:01.804270 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.804242 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-6kcw2"] May 21 17:54:01.809742 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.809715 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:54:01.809949 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.809930 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-vdxnr" podUID="e627b57f-a736-4f2c-9245-3080e8545fd0" containerName="authorino" containerID="cri-o://7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be" gracePeriod=30 May 21 17:54:01.812662 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.812637 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-6kcw2"] May 21 17:54:01.836727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.836698 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-6z7pl"] May 21 17:54:01.839479 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:01.839454 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-6z7pl"] May 21 17:54:02.050775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.050753 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:54:02.110672 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.110642 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xkhk\" (UniqueName: \"kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk\") pod \"e627b57f-a736-4f2c-9245-3080e8545fd0\" (UID: \"e627b57f-a736-4f2c-9245-3080e8545fd0\") " May 21 17:54:02.112730 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.112702 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk" (OuterVolumeSpecName: "kube-api-access-4xkhk") pod "e627b57f-a736-4f2c-9245-3080e8545fd0" (UID: "e627b57f-a736-4f2c-9245-3080e8545fd0"). InnerVolumeSpecName "kube-api-access-4xkhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:54:02.212217 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.212188 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xkhk\" (UniqueName: \"kubernetes.io/projected/e627b57f-a736-4f2c-9245-3080e8545fd0-kube-api-access-4xkhk\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:02.774216 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.774180 2565 generic.go:358] "Generic (PLEG): container finished" podID="e627b57f-a736-4f2c-9245-3080e8545fd0" containerID="7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be" exitCode=0 May 21 17:54:02.774416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.774235 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-vdxnr" event={"ID":"e627b57f-a736-4f2c-9245-3080e8545fd0","Type":"ContainerDied","Data":"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be"} May 21 17:54:02.774416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.774258 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-vdxnr" event={"ID":"e627b57f-a736-4f2c-9245-3080e8545fd0","Type":"ContainerDied","Data":"903f2f1f2df7530ec2105f5e25d85df145713c407115940fbfe928302906d321"} May 21 17:54:02.774416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.774272 2565 scope.go:117] "RemoveContainer" containerID="7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be" May 21 17:54:02.774416 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.774274 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-vdxnr" May 21 17:54:02.782050 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.782026 2565 scope.go:117] "RemoveContainer" containerID="7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be" May 21 17:54:02.782333 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:54:02.782300 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be\": container with ID starting with 7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be not found: ID does not exist" containerID="7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be" May 21 17:54:02.782420 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.782340 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be"} err="failed to get container status \"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be\": rpc error: code = NotFound desc = could not find container \"7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be\": container with ID starting with 7ba41d20ed1eaf2f97f1dd78143b98ffe04c12215ef007a3ca0ed735aeac11be not found: ID does not exist" May 21 17:54:02.793983 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.793960 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:54:02.797580 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:02.797559 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-vdxnr"] May 21 17:54:03.758712 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:03.758674 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="213b1c76-796c-4be1-a09d-04e28e8ba5c4" path="/var/lib/kubelet/pods/213b1c76-796c-4be1-a09d-04e28e8ba5c4/volumes" May 21 17:54:03.759060 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:03.758931 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dafb7ac4-788e-4ee2-93b9-55cdea8840ab" path="/var/lib/kubelet/pods/dafb7ac4-788e-4ee2-93b9-55cdea8840ab/volumes" May 21 17:54:03.759114 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:03.759103 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e627b57f-a736-4f2c-9245-3080e8545fd0" path="/var/lib/kubelet/pods/e627b57f-a736-4f2c-9245-3080e8545fd0/volumes" May 21 17:54:04.728394 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.728363 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:04.728710 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.728697 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e627b57f-a736-4f2c-9245-3080e8545fd0" containerName="authorino" May 21 17:54:04.728710 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.728711 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e627b57f-a736-4f2c-9245-3080e8545fd0" containerName="authorino" May 21 17:54:04.728847 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.728774 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e627b57f-a736-4f2c-9245-3080e8545fd0" containerName="authorino" May 21 17:54:04.736925 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.736891 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:04.739538 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.739513 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h6z9t\"" May 21 17:54:04.739671 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.739627 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 17:54:04.740748 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.740725 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:04.836061 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.836025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4nt9\" (UniqueName: \"kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9\") pod \"maas-controller-7df575f8c9-6flzz\" (UID: \"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848\") " pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:04.937390 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.937359 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4nt9\" (UniqueName: \"kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9\") pod \"maas-controller-7df575f8c9-6flzz\" (UID: \"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848\") " pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:04.944475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:04.944441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4nt9\" (UniqueName: \"kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9\") pod \"maas-controller-7df575f8c9-6flzz\" (UID: \"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848\") " pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:05.010473 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.010398 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:05.014260 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.014240 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:05.020457 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.020434 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:05.050029 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.049996 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:05.139286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.139241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grl5k\" (UniqueName: \"kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k\") pod \"maas-controller-76f94bcf8b-t2g52\" (UID: \"d09de011-97f8-45ef-9318-3908711057e3\") " pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:05.176941 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.176917 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:05.179248 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:54:05.179219 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdd9bc8_1d0d_4c86_97e3_199e6eab6848.slice/crio-f8a21038efe75d1c74650579c78fd50d605d92b6920a533ac503f1bbe73f784a WatchSource:0}: Error finding container f8a21038efe75d1c74650579c78fd50d605d92b6920a533ac503f1bbe73f784a: Status 404 returned error can't find the container with id f8a21038efe75d1c74650579c78fd50d605d92b6920a533ac503f1bbe73f784a May 21 17:54:05.239757 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.239722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grl5k\" (UniqueName: \"kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k\") pod \"maas-controller-76f94bcf8b-t2g52\" (UID: \"d09de011-97f8-45ef-9318-3908711057e3\") " pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:05.246789 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.246764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grl5k\" (UniqueName: \"kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k\") pod \"maas-controller-76f94bcf8b-t2g52\" (UID: \"d09de011-97f8-45ef-9318-3908711057e3\") " pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:05.326699 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.326672 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:05.453685 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.453662 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:05.455969 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:54:05.455936 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09de011_97f8_45ef_9318_3908711057e3.slice/crio-8653d8e001a9360dd91d5deef652d196be28c202a9edcc3fa28d43b8ee91ee9a WatchSource:0}: Error finding container 8653d8e001a9360dd91d5deef652d196be28c202a9edcc3fa28d43b8ee91ee9a: Status 404 returned error can't find the container with id 8653d8e001a9360dd91d5deef652d196be28c202a9edcc3fa28d43b8ee91ee9a May 21 17:54:05.789434 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.789396 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" event={"ID":"d09de011-97f8-45ef-9318-3908711057e3","Type":"ContainerStarted","Data":"8653d8e001a9360dd91d5deef652d196be28c202a9edcc3fa28d43b8ee91ee9a"} May 21 17:54:05.791177 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:05.791103 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-6flzz" event={"ID":"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848","Type":"ContainerStarted","Data":"f8a21038efe75d1c74650579c78fd50d605d92b6920a533ac503f1bbe73f784a"} May 21 17:54:08.329660 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.329638 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 17:54:08.804028 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.803932 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" event={"ID":"d09de011-97f8-45ef-9318-3908711057e3","Type":"ContainerStarted","Data":"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c"} May 21 17:54:08.804197 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.804028 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:08.805295 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.805269 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-6flzz" event={"ID":"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848","Type":"ContainerStarted","Data":"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c"} May 21 17:54:08.805456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.805444 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:08.819356 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.819315 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" podStartSLOduration=1.949663371 podStartE2EDuration="4.819303468s" podCreationTimestamp="2026-05-21 17:54:04 +0000 UTC" firstStartedPulling="2026-05-21 17:54:05.457267571 +0000 UTC m=+660.220563137" lastFinishedPulling="2026-05-21 17:54:08.326907657 +0000 UTC m=+663.090203234" observedRunningTime="2026-05-21 17:54:08.818259582 +0000 UTC m=+663.581555172" watchObservedRunningTime="2026-05-21 17:54:08.819303468 +0000 UTC m=+663.582599056" May 21 17:54:08.833169 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:08.833122 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7df575f8c9-6flzz" podStartSLOduration=1.690121305 podStartE2EDuration="4.833112083s" podCreationTimestamp="2026-05-21 17:54:04 +0000 UTC" firstStartedPulling="2026-05-21 17:54:05.180541418 +0000 UTC m=+659.943836983" lastFinishedPulling="2026-05-21 17:54:08.323532181 +0000 UTC m=+663.086827761" observedRunningTime="2026-05-21 17:54:08.831853308 +0000 UTC m=+663.595148897" watchObservedRunningTime="2026-05-21 17:54:08.833112083 +0000 UTC m=+663.596407670" May 21 17:54:19.813861 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:19.813834 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:19.814211 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:19.813880 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:19.867016 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:19.866987 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:19.867195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:19.867167 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7df575f8c9-6flzz" podUID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" containerName="manager" containerID="cri-o://03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c" gracePeriod=30 May 21 17:54:20.040525 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.040469 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:54:20.044211 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.044186 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.052953 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.052922 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:54:20.105686 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.105666 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:20.174622 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.174592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvs5\" (UniqueName: \"kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5\") pod \"maas-controller-56c8bf79d5-488lp\" (UID: \"c72f1bb9-cd28-4f05-b8bb-c967fd302289\") " pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.275498 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.275470 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4nt9\" (UniqueName: \"kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9\") pod \"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848\" (UID: \"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848\") " May 21 17:54:20.275645 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.275615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvs5\" (UniqueName: \"kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5\") pod \"maas-controller-56c8bf79d5-488lp\" (UID: \"c72f1bb9-cd28-4f05-b8bb-c967fd302289\") " pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.277692 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.277669 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9" (OuterVolumeSpecName: "kube-api-access-f4nt9") pod "bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" (UID: "bbdd9bc8-1d0d-4c86-97e3-199e6eab6848"). InnerVolumeSpecName "kube-api-access-f4nt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:54:20.283448 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.283417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvs5\" (UniqueName: \"kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5\") pod \"maas-controller-56c8bf79d5-488lp\" (UID: \"c72f1bb9-cd28-4f05-b8bb-c967fd302289\") " pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.358392 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.358326 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.376327 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.376303 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4nt9\" (UniqueName: \"kubernetes.io/projected/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848-kube-api-access-f4nt9\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:20.477250 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.477227 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:54:20.479419 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:54:20.479392 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72f1bb9_cd28_4f05_b8bb_c967fd302289.slice/crio-408ac3deb911f27f1384688c6de56bc9ab5f371fa086d69f8503de5649098087 WatchSource:0}: Error finding container 408ac3deb911f27f1384688c6de56bc9ab5f371fa086d69f8503de5649098087: Status 404 returned error can't find the container with id 408ac3deb911f27f1384688c6de56bc9ab5f371fa086d69f8503de5649098087 May 21 17:54:20.843157 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.843134 2565 generic.go:358] "Generic (PLEG): container finished" podID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" containerID="03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c" exitCode=0 May 21 17:54:20.843515 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.843189 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-6flzz" May 21 17:54:20.843515 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.843201 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-6flzz" event={"ID":"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848","Type":"ContainerDied","Data":"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c"} May 21 17:54:20.843515 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.843236 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-6flzz" event={"ID":"bbdd9bc8-1d0d-4c86-97e3-199e6eab6848","Type":"ContainerDied","Data":"f8a21038efe75d1c74650579c78fd50d605d92b6920a533ac503f1bbe73f784a"} May 21 17:54:20.843515 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.843253 2565 scope.go:117] "RemoveContainer" containerID="03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c" May 21 17:54:20.844703 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.844675 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-488lp" event={"ID":"c72f1bb9-cd28-4f05-b8bb-c967fd302289","Type":"ContainerStarted","Data":"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a"} May 21 17:54:20.844793 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.844708 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-488lp" event={"ID":"c72f1bb9-cd28-4f05-b8bb-c967fd302289","Type":"ContainerStarted","Data":"408ac3deb911f27f1384688c6de56bc9ab5f371fa086d69f8503de5649098087"} May 21 17:54:20.844913 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.844799 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:20.851745 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.851713 2565 scope.go:117] "RemoveContainer" containerID="03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c" May 21 17:54:20.852022 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:54:20.851959 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c\": container with ID starting with 03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c not found: ID does not exist" containerID="03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c" May 21 17:54:20.852022 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.851989 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c"} err="failed to get container status \"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c\": rpc error: code = NotFound desc = could not find container \"03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c\": container with ID starting with 03a392131c02c1a31e259d74ebd344ce42bc660eadc120c108ba7a5e06c71f1c not found: ID does not exist" May 21 17:54:20.860799 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.860758 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56c8bf79d5-488lp" podStartSLOduration=0.558043714 podStartE2EDuration="860.74744ms" podCreationTimestamp="2026-05-21 17:54:20 +0000 UTC" firstStartedPulling="2026-05-21 17:54:20.480828166 +0000 UTC m=+675.244123735" lastFinishedPulling="2026-05-21 17:54:20.783531892 +0000 UTC m=+675.546827461" observedRunningTime="2026-05-21 17:54:20.858936617 +0000 UTC m=+675.622232205" watchObservedRunningTime="2026-05-21 17:54:20.86074744 +0000 UTC m=+675.624043059" May 21 17:54:20.870230 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.870194 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:20.871593 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:20.871568 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-6flzz"] May 21 17:54:21.759231 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:21.759194 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" path="/var/lib/kubelet/pods/bbdd9bc8-1d0d-4c86-97e3-199e6eab6848/volumes" May 21 17:54:31.853366 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:31.853337 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:54:31.890363 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:31.890329 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:31.890667 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:31.890632 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" podUID="d09de011-97f8-45ef-9318-3908711057e3" containerName="manager" containerID="cri-o://3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c" gracePeriod=30 May 21 17:54:32.122283 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.122260 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:32.174987 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.174957 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grl5k\" (UniqueName: \"kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k\") pod \"d09de011-97f8-45ef-9318-3908711057e3\" (UID: \"d09de011-97f8-45ef-9318-3908711057e3\") " May 21 17:54:32.176930 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.176906 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k" (OuterVolumeSpecName: "kube-api-access-grl5k") pod "d09de011-97f8-45ef-9318-3908711057e3" (UID: "d09de011-97f8-45ef-9318-3908711057e3"). InnerVolumeSpecName "kube-api-access-grl5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:54:32.275832 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.275808 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grl5k\" (UniqueName: \"kubernetes.io/projected/d09de011-97f8-45ef-9318-3908711057e3-kube-api-access-grl5k\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:54:32.886867 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.886827 2565 generic.go:358] "Generic (PLEG): container finished" podID="d09de011-97f8-45ef-9318-3908711057e3" containerID="3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c" exitCode=0 May 21 17:54:32.887282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.886890 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" May 21 17:54:32.887282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.886908 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" event={"ID":"d09de011-97f8-45ef-9318-3908711057e3","Type":"ContainerDied","Data":"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c"} May 21 17:54:32.887282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.886944 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f94bcf8b-t2g52" event={"ID":"d09de011-97f8-45ef-9318-3908711057e3","Type":"ContainerDied","Data":"8653d8e001a9360dd91d5deef652d196be28c202a9edcc3fa28d43b8ee91ee9a"} May 21 17:54:32.887282 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.886961 2565 scope.go:117] "RemoveContainer" containerID="3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c" May 21 17:54:32.895116 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.894938 2565 scope.go:117] "RemoveContainer" containerID="3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c" May 21 17:54:32.895235 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:54:32.895213 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c\": container with ID starting with 3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c not found: ID does not exist" containerID="3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c" May 21 17:54:32.895274 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.895246 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c"} err="failed to get container status \"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c\": rpc error: code = NotFound desc = could not find container \"3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c\": container with ID starting with 3140c2f8affa6156d4c6fbfad8431aa9a2cd0cf426bc95679442149df3a1082c not found: ID does not exist" May 21 17:54:32.905857 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.905833 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:32.909620 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:32.909598 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76f94bcf8b-t2g52"] May 21 17:54:33.759370 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:33.759328 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d09de011-97f8-45ef-9318-3908711057e3" path="/var/lib/kubelet/pods/d09de011-97f8-45ef-9318-3908711057e3/volumes" May 21 17:54:51.640569 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640474 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-frd95"] May 21 17:54:51.640911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640890 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d09de011-97f8-45ef-9318-3908711057e3" containerName="manager" May 21 17:54:51.640911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640904 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d09de011-97f8-45ef-9318-3908711057e3" containerName="manager" May 21 17:54:51.640911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640912 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" containerName="manager" May 21 17:54:51.641012 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640917 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" containerName="manager" May 21 17:54:51.641012 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640979 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d09de011-97f8-45ef-9318-3908711057e3" containerName="manager" May 21 17:54:51.641012 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.640988 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbdd9bc8-1d0d-4c86-97e3-199e6eab6848" containerName="manager" May 21 17:54:51.643977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.643960 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:51.646705 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.646684 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 17:54:51.656390 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.656370 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-frd95"] May 21 17:54:51.736986 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.736958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb4np\" (UniqueName: \"kubernetes.io/projected/39b3df8b-5c59-4800-b243-7ea281e2c4c6-kube-api-access-sb4np\") pod \"payload-processing-58b6c8fdc7-frd95\" (UID: \"39b3df8b-5c59-4800-b243-7ea281e2c4c6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:51.837876 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.837836 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb4np\" (UniqueName: \"kubernetes.io/projected/39b3df8b-5c59-4800-b243-7ea281e2c4c6-kube-api-access-sb4np\") pod \"payload-processing-58b6c8fdc7-frd95\" (UID: \"39b3df8b-5c59-4800-b243-7ea281e2c4c6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:51.847761 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.847737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb4np\" (UniqueName: \"kubernetes.io/projected/39b3df8b-5c59-4800-b243-7ea281e2c4c6-kube-api-access-sb4np\") pod \"payload-processing-58b6c8fdc7-frd95\" (UID: \"39b3df8b-5c59-4800-b243-7ea281e2c4c6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:51.954186 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:51.954107 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:52.080945 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:52.080922 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-frd95"] May 21 17:54:52.083543 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:54:52.083515 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b3df8b_5c59_4800_b243_7ea281e2c4c6.slice/crio-ecb7b2d99a84403822976bc30c519b59692fc376c8228ec8768a597ae299dee1 WatchSource:0}: Error finding container ecb7b2d99a84403822976bc30c519b59692fc376c8228ec8768a597ae299dee1: Status 404 returned error can't find the container with id ecb7b2d99a84403822976bc30c519b59692fc376c8228ec8768a597ae299dee1 May 21 17:54:52.959272 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:52.959233 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" event={"ID":"39b3df8b-5c59-4800-b243-7ea281e2c4c6","Type":"ContainerStarted","Data":"ecb7b2d99a84403822976bc30c519b59692fc376c8228ec8768a597ae299dee1"} May 21 17:54:54.966618 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:54.966579 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" event={"ID":"39b3df8b-5c59-4800-b243-7ea281e2c4c6","Type":"ContainerStarted","Data":"63c1be7cdbc2356537ff727fe221ce82cc862d7a56930199ab919bebe090900f"} May 21 17:54:54.966987 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:54.966703 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:54:54.981233 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:54:54.981181 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" podStartSLOduration=1.747257697 podStartE2EDuration="3.981158182s" podCreationTimestamp="2026-05-21 17:54:51 +0000 UTC" firstStartedPulling="2026-05-21 17:54:52.085250025 +0000 UTC m=+706.848545595" lastFinishedPulling="2026-05-21 17:54:54.3191505 +0000 UTC m=+709.082446080" observedRunningTime="2026-05-21 17:54:54.979844652 +0000 UTC m=+709.743140241" watchObservedRunningTime="2026-05-21 17:54:54.981158182 +0000 UTC m=+709.744453772" May 21 17:55:05.973315 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:05.973286 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-frd95" May 21 17:55:10.963044 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.963002 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22"] May 21 17:55:10.967846 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.967820 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:10.970111 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.970091 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 17:55:10.970944 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.970919 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bqdm5\"" May 21 17:55:10.971068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.970919 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 17:55:10.971068 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.970995 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 17:55:10.977145 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:10.977125 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22"] May 21 17:55:11.095655 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.095812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.095812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.095812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.095812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpp8x\" (UniqueName: \"kubernetes.io/projected/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kube-api-access-gpp8x\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.095812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.095786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197063 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197032 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197063 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpp8x\" (UniqueName: \"kubernetes.io/projected/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kube-api-access-gpp8x\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197356 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197423 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197402 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197481 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197443 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197574 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197547 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197722 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.197758 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.197744 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.199613 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.199596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.199911 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.199892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.203805 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.203782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpp8x\" (UniqueName: \"kubernetes.io/projected/40632eec-5166-4ea2-8a3d-8f70dcd4ec7d-kube-api-access-gpp8x\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-grv22\" (UID: \"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.278267 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.278210 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:11.400658 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.400632 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22"] May 21 17:55:11.402580 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:55:11.402545 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40632eec_5166_4ea2_8a3d_8f70dcd4ec7d.slice/crio-2e4e3503bff44185f9fe9386849c1e7182d779b2ff57253edc30da0e947ee278 WatchSource:0}: Error finding container 2e4e3503bff44185f9fe9386849c1e7182d779b2ff57253edc30da0e947ee278: Status 404 returned error can't find the container with id 2e4e3503bff44185f9fe9386849c1e7182d779b2ff57253edc30da0e947ee278 May 21 17:55:11.404347 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:11.404331 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:55:12.029471 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:12.029431 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" event={"ID":"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d","Type":"ContainerStarted","Data":"2e4e3503bff44185f9fe9386849c1e7182d779b2ff57253edc30da0e947ee278"} May 21 17:55:17.047829 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:17.047797 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" event={"ID":"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d","Type":"ContainerStarted","Data":"e22e0c3e3a6026a08a5db3632a04d42e6277d085bb8a7c8614b2842301741dc2"} May 21 17:55:25.077117 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:25.077086 2565 generic.go:358] "Generic (PLEG): container finished" podID="40632eec-5166-4ea2-8a3d-8f70dcd4ec7d" containerID="e22e0c3e3a6026a08a5db3632a04d42e6277d085bb8a7c8614b2842301741dc2" exitCode=0 May 21 17:55:25.077516 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:25.077169 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" event={"ID":"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d","Type":"ContainerDied","Data":"e22e0c3e3a6026a08a5db3632a04d42e6277d085bb8a7c8614b2842301741dc2"} May 21 17:55:27.086775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:27.086742 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" event={"ID":"40632eec-5166-4ea2-8a3d-8f70dcd4ec7d","Type":"ContainerStarted","Data":"839d92a76358dadf3bc12ea1498abfc89f87f0d91eb8640e79cc9388995cd0e7"} May 21 17:55:27.087129 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:27.086932 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:27.102467 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:27.102427 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" podStartSLOduration=2.232410392 podStartE2EDuration="17.102415524s" podCreationTimestamp="2026-05-21 17:55:10 +0000 UTC" firstStartedPulling="2026-05-21 17:55:11.404456028 +0000 UTC m=+726.167751593" lastFinishedPulling="2026-05-21 17:55:26.274461156 +0000 UTC m=+741.037756725" observedRunningTime="2026-05-21 17:55:27.101479488 +0000 UTC m=+741.864775077" watchObservedRunningTime="2026-05-21 17:55:27.102415524 +0000 UTC m=+741.865711111" May 21 17:55:31.958032 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:31.957993 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb"] May 21 17:55:32.001754 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.001719 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb"] May 21 17:55:32.001894 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.001831 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.004087 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.004068 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 17:55:32.086841 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.086812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vfq\" (UniqueName: \"kubernetes.io/projected/9335d292-b3fa-442d-814f-94265bb71da0-kube-api-access-x9vfq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.086972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.086852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.086972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.086872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.086972 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.086895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9335d292-b3fa-442d-814f-94265bb71da0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.087097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.086993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.087097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.087025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187623 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187595 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vfq\" (UniqueName: \"kubernetes.io/projected/9335d292-b3fa-442d-814f-94265bb71da0-kube-api-access-x9vfq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187678 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187711 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9335d292-b3fa-442d-814f-94265bb71da0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187775 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187769 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.187977 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.187799 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.188031 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.188015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.188110 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.188092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.188182 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.188162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.189778 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.189752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9335d292-b3fa-442d-814f-94265bb71da0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.190098 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.190079 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9335d292-b3fa-442d-814f-94265bb71da0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.194765 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.194739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vfq\" (UniqueName: \"kubernetes.io/projected/9335d292-b3fa-442d-814f-94265bb71da0-kube-api-access-x9vfq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb\" (UID: \"9335d292-b3fa-442d-814f-94265bb71da0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.312025 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.311999 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:32.433641 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:32.433616 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb"] May 21 17:55:32.436098 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:55:32.436070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9335d292_b3fa_442d_814f_94265bb71da0.slice/crio-9f09e6d3f8dd902879091bcf82f99707f5259b3376c120a823f4b89ad71ed29f WatchSource:0}: Error finding container 9f09e6d3f8dd902879091bcf82f99707f5259b3376c120a823f4b89ad71ed29f: Status 404 returned error can't find the container with id 9f09e6d3f8dd902879091bcf82f99707f5259b3376c120a823f4b89ad71ed29f May 21 17:55:33.106689 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:33.106645 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" event={"ID":"9335d292-b3fa-442d-814f-94265bb71da0","Type":"ContainerStarted","Data":"5a50cbd6b893a981f1da34a0527b107c46a21cd4e2b234093419d76aa5a012a1"} May 21 17:55:33.106689 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:33.106693 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" event={"ID":"9335d292-b3fa-442d-814f-94265bb71da0","Type":"ContainerStarted","Data":"9f09e6d3f8dd902879091bcf82f99707f5259b3376c120a823f4b89ad71ed29f"} May 21 17:55:38.102884 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:38.102855 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-grv22" May 21 17:55:38.124409 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:38.124377 2565 generic.go:358] "Generic (PLEG): container finished" podID="9335d292-b3fa-442d-814f-94265bb71da0" containerID="5a50cbd6b893a981f1da34a0527b107c46a21cd4e2b234093419d76aa5a012a1" exitCode=0 May 21 17:55:38.124558 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:38.124450 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" event={"ID":"9335d292-b3fa-442d-814f-94265bb71da0","Type":"ContainerDied","Data":"5a50cbd6b893a981f1da34a0527b107c46a21cd4e2b234093419d76aa5a012a1"} May 21 17:55:39.130741 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:39.130710 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" event={"ID":"9335d292-b3fa-442d-814f-94265bb71da0","Type":"ContainerStarted","Data":"522a6bcb496a42027b93d33c40288e4d2d1238a59e867caedd56130710575aff"} May 21 17:55:39.131109 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:39.130917 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:55:39.147803 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:39.147750 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" podStartSLOduration=7.721310603 podStartE2EDuration="8.147736914s" podCreationTimestamp="2026-05-21 17:55:31 +0000 UTC" firstStartedPulling="2026-05-21 17:55:38.125186553 +0000 UTC m=+752.888482122" lastFinishedPulling="2026-05-21 17:55:38.551612863 +0000 UTC m=+753.314908433" observedRunningTime="2026-05-21 17:55:39.145702343 +0000 UTC m=+753.908997922" watchObservedRunningTime="2026-05-21 17:55:39.147736914 +0000 UTC m=+753.911032554" May 21 17:55:50.147720 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:55:50.147683 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb" May 21 17:56:04.560097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.560061 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg"] May 21 17:56:04.563774 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.563752 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.565967 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.565948 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 17:56:04.574155 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574124 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg"] May 21 17:56:04.574422 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.574548 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.574611 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.574611 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8j9q\" (UniqueName: \"kubernetes.io/projected/dedb6a87-7444-4470-9636-e8fa246ba17e-kube-api-access-k8j9q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.574694 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedb6a87-7444-4470-9636-e8fa246ba17e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.574694 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.574673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675544 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675544 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8j9q\" (UniqueName: \"kubernetes.io/projected/dedb6a87-7444-4470-9636-e8fa246ba17e-kube-api-access-k8j9q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675602 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedb6a87-7444-4470-9636-e8fa246ba17e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675640 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675727 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675715 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.675970 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.675781 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.676088 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.676060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.676209 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.676171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.676209 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.676192 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.678351 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.678327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dedb6a87-7444-4470-9636-e8fa246ba17e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.678527 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.678511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedb6a87-7444-4470-9636-e8fa246ba17e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.682391 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.682364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8j9q\" (UniqueName: \"kubernetes.io/projected/dedb6a87-7444-4470-9636-e8fa246ba17e-kube-api-access-k8j9q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg\" (UID: \"dedb6a87-7444-4470-9636-e8fa246ba17e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:04.875432 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:04.875393 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:05.002479 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:05.002454 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg"] May 21 17:56:05.004853 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:56:05.004827 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedb6a87_7444_4470_9636_e8fa246ba17e.slice/crio-ee16525b838fcb85e73492bf6ee113146df8a7e5c217e848047d7b390e1bdb07 WatchSource:0}: Error finding container ee16525b838fcb85e73492bf6ee113146df8a7e5c217e848047d7b390e1bdb07: Status 404 returned error can't find the container with id ee16525b838fcb85e73492bf6ee113146df8a7e5c217e848047d7b390e1bdb07 May 21 17:56:05.218686 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:05.218596 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" event={"ID":"dedb6a87-7444-4470-9636-e8fa246ba17e","Type":"ContainerStarted","Data":"57a32dc133af9a557fe290b87b30f407ee0ec3f356919a5e2e8966a4e50458ee"} May 21 17:56:05.218686 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:05.218643 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" event={"ID":"dedb6a87-7444-4470-9636-e8fa246ba17e","Type":"ContainerStarted","Data":"ee16525b838fcb85e73492bf6ee113146df8a7e5c217e848047d7b390e1bdb07"} May 21 17:56:11.243653 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:11.243619 2565 generic.go:358] "Generic (PLEG): container finished" podID="dedb6a87-7444-4470-9636-e8fa246ba17e" containerID="57a32dc133af9a557fe290b87b30f407ee0ec3f356919a5e2e8966a4e50458ee" exitCode=0 May 21 17:56:11.244126 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:11.243692 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" event={"ID":"dedb6a87-7444-4470-9636-e8fa246ba17e","Type":"ContainerDied","Data":"57a32dc133af9a557fe290b87b30f407ee0ec3f356919a5e2e8966a4e50458ee"} May 21 17:56:12.248348 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:12.248315 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" event={"ID":"dedb6a87-7444-4470-9636-e8fa246ba17e","Type":"ContainerStarted","Data":"7f8b5eeae90f24f033d3ca49e7b31ae9855999f488beacaa3cb37f03ab872058"} May 21 17:56:12.248719 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:12.248533 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:12.265694 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:12.265650 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" podStartSLOduration=7.967951315 podStartE2EDuration="8.265638984s" podCreationTimestamp="2026-05-21 17:56:04 +0000 UTC" firstStartedPulling="2026-05-21 17:56:11.244309382 +0000 UTC m=+786.007604947" lastFinishedPulling="2026-05-21 17:56:11.541997051 +0000 UTC m=+786.305292616" observedRunningTime="2026-05-21 17:56:12.264316811 +0000 UTC m=+787.027612436" watchObservedRunningTime="2026-05-21 17:56:12.265638984 +0000 UTC m=+787.028934571" May 21 17:56:23.265033 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:23.264941 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg" May 21 17:56:40.325580 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.325542 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f4c5b44cd-f2x5v"] May 21 17:56:40.329097 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.329080 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.336394 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.336371 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f4c5b44cd-f2x5v"] May 21 17:56:40.498117 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.498083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k64xs\" (UniqueName: \"kubernetes.io/projected/3e6dd6e4-563a-4e07-a28c-809722815404-kube-api-access-k64xs\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.498281 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.498217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e6dd6e4-563a-4e07-a28c-809722815404-tls-cert\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.598822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.598753 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e6dd6e4-563a-4e07-a28c-809722815404-tls-cert\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.598822 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.598796 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k64xs\" (UniqueName: \"kubernetes.io/projected/3e6dd6e4-563a-4e07-a28c-809722815404-kube-api-access-k64xs\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.601129 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.601104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e6dd6e4-563a-4e07-a28c-809722815404-tls-cert\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.606188 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.606170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k64xs\" (UniqueName: \"kubernetes.io/projected/3e6dd6e4-563a-4e07-a28c-809722815404-kube-api-access-k64xs\") pod \"authorino-6f4c5b44cd-f2x5v\" (UID: \"3e6dd6e4-563a-4e07-a28c-809722815404\") " pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.638987 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.638962 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" May 21 17:56:40.765214 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:40.765187 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f4c5b44cd-f2x5v"] May 21 17:56:40.767106 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:56:40.767075 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e6dd6e4_563a_4e07_a28c_809722815404.slice/crio-54e8a2d66d8ba0e6c4b04d1ec9f327704fbfd873a42c57ead39ad6b232cc430b WatchSource:0}: Error finding container 54e8a2d66d8ba0e6c4b04d1ec9f327704fbfd873a42c57ead39ad6b232cc430b: Status 404 returned error can't find the container with id 54e8a2d66d8ba0e6c4b04d1ec9f327704fbfd873a42c57ead39ad6b232cc430b May 21 17:56:41.346539 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.346485 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" event={"ID":"3e6dd6e4-563a-4e07-a28c-809722815404","Type":"ContainerStarted","Data":"685f63a7435ed151aca9c45bfd363e4d71593ddfa6599dae5ace3d9e63986fe5"} May 21 17:56:41.346539 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.346540 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" event={"ID":"3e6dd6e4-563a-4e07-a28c-809722815404","Type":"ContainerStarted","Data":"54e8a2d66d8ba0e6c4b04d1ec9f327704fbfd873a42c57ead39ad6b232cc430b"} May 21 17:56:41.359812 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.359767 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6f4c5b44cd-f2x5v" podStartSLOduration=0.950658784 podStartE2EDuration="1.359754363s" podCreationTimestamp="2026-05-21 17:56:40 +0000 UTC" firstStartedPulling="2026-05-21 17:56:40.768415305 +0000 UTC m=+815.531710871" lastFinishedPulling="2026-05-21 17:56:41.177510875 +0000 UTC m=+815.940806450" observedRunningTime="2026-05-21 17:56:41.359207534 +0000 UTC m=+816.122503123" watchObservedRunningTime="2026-05-21 17:56:41.359754363 +0000 UTC m=+816.123049951" May 21 17:56:41.385347 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.385317 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:56:41.385630 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.385596 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" podUID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" containerName="authorino" containerID="cri-o://8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa" gracePeriod=30 May 21 17:56:41.639666 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.639644 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:56:41.710878 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.710848 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kd5m\" (UniqueName: \"kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m\") pod \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " May 21 17:56:41.711057 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.710939 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert\") pod \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\" (UID: \"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4\") " May 21 17:56:41.712950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.712915 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m" (OuterVolumeSpecName: "kube-api-access-6kd5m") pod "b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" (UID: "b9c5a279-4bd1-4c93-b2f1-13a48ee131e4"). InnerVolumeSpecName "kube-api-access-6kd5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:56:41.720453 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.720430 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" (UID: "b9c5a279-4bd1-4c93-b2f1-13a48ee131e4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:56:41.811875 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.811852 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kd5m\" (UniqueName: \"kubernetes.io/projected/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-kube-api-access-6kd5m\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:56:41.811875 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:41.811875 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4-tls-cert\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:56:42.350774 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.350732 2565 generic.go:358] "Generic (PLEG): container finished" podID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" containerID="8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa" exitCode=0 May 21 17:56:42.351195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.350806 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" May 21 17:56:42.351195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.350814 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" event={"ID":"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4","Type":"ContainerDied","Data":"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa"} May 21 17:56:42.351195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.350860 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc49475ff-6vdvl" event={"ID":"b9c5a279-4bd1-4c93-b2f1-13a48ee131e4","Type":"ContainerDied","Data":"0948111915a733611b58c06f584f9df28a7d545007b0ea7393a5e9a217e1e603"} May 21 17:56:42.351195 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.350875 2565 scope.go:117] "RemoveContainer" containerID="8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa" May 21 17:56:42.360199 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.360179 2565 scope.go:117] "RemoveContainer" containerID="8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa" May 21 17:56:42.360566 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:56:42.360480 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa\": container with ID starting with 8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa not found: ID does not exist" containerID="8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa" May 21 17:56:42.360650 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.360580 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa"} err="failed to get container status \"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa\": rpc error: code = NotFound desc = could not find container \"8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa\": container with ID starting with 8812e7f82bbcf2e2187ac1b2d5e55ffb6a746a1651665225d31e7120631a81fa not found: ID does not exist" May 21 17:56:42.368130 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.368100 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:56:42.371597 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:42.371578 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dc49475ff-6vdvl"] May 21 17:56:43.759753 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:56:43.759723 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" path="/var/lib/kubelet/pods/b9c5a279-4bd1-4c93-b2f1-13a48ee131e4/volumes" May 21 17:58:05.727351 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:05.727317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:58:05.728033 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:05.728012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 17:58:05.730199 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:05.730167 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:58:05.730757 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:05.730734 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 17:58:09.794722 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:09.794690 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:58:09.795171 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:09.794865 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-56c8bf79d5-488lp" podUID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" containerName="manager" containerID="cri-o://2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a" gracePeriod=30 May 21 17:58:10.038909 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.038887 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:58:10.106094 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.106063 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhvs5\" (UniqueName: \"kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5\") pod \"c72f1bb9-cd28-4f05-b8bb-c967fd302289\" (UID: \"c72f1bb9-cd28-4f05-b8bb-c967fd302289\") " May 21 17:58:10.108025 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.108003 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5" (OuterVolumeSpecName: "kube-api-access-vhvs5") pod "c72f1bb9-cd28-4f05-b8bb-c967fd302289" (UID: "c72f1bb9-cd28-4f05-b8bb-c967fd302289"). InnerVolumeSpecName "kube-api-access-vhvs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:58:10.206596 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.206570 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhvs5\" (UniqueName: \"kubernetes.io/projected/c72f1bb9-cd28-4f05-b8bb-c967fd302289-kube-api-access-vhvs5\") on node \"ip-10-0-141-214.ec2.internal\" DevicePath \"\"" May 21 17:58:10.648293 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.648257 2565 generic.go:358] "Generic (PLEG): container finished" podID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" containerID="2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a" exitCode=0 May 21 17:58:10.648456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.648327 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-488lp" May 21 17:58:10.648456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.648345 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-488lp" event={"ID":"c72f1bb9-cd28-4f05-b8bb-c967fd302289","Type":"ContainerDied","Data":"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a"} May 21 17:58:10.648456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.648387 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-488lp" event={"ID":"c72f1bb9-cd28-4f05-b8bb-c967fd302289","Type":"ContainerDied","Data":"408ac3deb911f27f1384688c6de56bc9ab5f371fa086d69f8503de5649098087"} May 21 17:58:10.648456 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.648404 2565 scope.go:117] "RemoveContainer" containerID="2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a" May 21 17:58:10.656993 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.656973 2565 scope.go:117] "RemoveContainer" containerID="2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a" May 21 17:58:10.657247 ip-10-0-141-214 kubenswrapper[2565]: E0521 17:58:10.657228 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a\": container with ID starting with 2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a not found: ID does not exist" containerID="2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a" May 21 17:58:10.657335 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.657259 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a"} err="failed to get container status \"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a\": rpc error: code = NotFound desc = could not find container \"2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a\": container with ID starting with 2a0b4fe2dd606aa57136dd1834bcb04f12c8de1b2b164219ae3671bdfa5a2e5a not found: ID does not exist" May 21 17:58:10.670784 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.670754 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:58:10.674107 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:10.674083 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-488lp"] May 21 17:58:11.443003 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.442971 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-c42sm"] May 21 17:58:11.443475 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443454 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" containerName="authorino" May 21 17:58:11.443570 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443479 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" containerName="authorino" May 21 17:58:11.443570 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443520 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" containerName="manager" May 21 17:58:11.443570 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443529 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" containerName="manager" May 21 17:58:11.443719 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443631 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9c5a279-4bd1-4c93-b2f1-13a48ee131e4" containerName="authorino" May 21 17:58:11.443719 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.443649 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" containerName="manager" May 21 17:58:11.448041 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.448017 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:11.450160 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.450140 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 17:58:11.450269 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.450146 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h6z9t\"" May 21 17:58:11.453391 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.453371 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-c42sm"] May 21 17:58:11.518449 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.518423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btn7h\" (UniqueName: \"kubernetes.io/projected/d2bd1b6d-e217-4f53-9e4f-82206b38fa58-kube-api-access-btn7h\") pod \"maas-controller-56c8bf79d5-c42sm\" (UID: \"d2bd1b6d-e217-4f53-9e4f-82206b38fa58\") " pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:11.619399 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.619378 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btn7h\" (UniqueName: \"kubernetes.io/projected/d2bd1b6d-e217-4f53-9e4f-82206b38fa58-kube-api-access-btn7h\") pod \"maas-controller-56c8bf79d5-c42sm\" (UID: \"d2bd1b6d-e217-4f53-9e4f-82206b38fa58\") " pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:11.626731 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.626703 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btn7h\" (UniqueName: \"kubernetes.io/projected/d2bd1b6d-e217-4f53-9e4f-82206b38fa58-kube-api-access-btn7h\") pod \"maas-controller-56c8bf79d5-c42sm\" (UID: \"d2bd1b6d-e217-4f53-9e4f-82206b38fa58\") " pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:11.759133 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.759073 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72f1bb9-cd28-4f05-b8bb-c967fd302289" path="/var/lib/kubelet/pods/c72f1bb9-cd28-4f05-b8bb-c967fd302289/volumes" May 21 17:58:11.760596 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.760574 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:11.883286 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:11.883257 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bf79d5-c42sm"] May 21 17:58:11.888951 ip-10-0-141-214 kubenswrapper[2565]: W0521 17:58:11.888922 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bd1b6d_e217_4f53_9e4f_82206b38fa58.slice/crio-e33cbea0eb711549d370f705b37f6b46d9e6dc77b178e268f4764e689e236ec1 WatchSource:0}: Error finding container e33cbea0eb711549d370f705b37f6b46d9e6dc77b178e268f4764e689e236ec1: Status 404 returned error can't find the container with id e33cbea0eb711549d370f705b37f6b46d9e6dc77b178e268f4764e689e236ec1 May 21 17:58:12.657550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:12.657509 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" event={"ID":"d2bd1b6d-e217-4f53-9e4f-82206b38fa58","Type":"ContainerStarted","Data":"493c4204032d8db9be3d9fa4ccc47c591b458250f07a6e94e1f3238bb65494f6"} May 21 17:58:12.657550 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:12.657546 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" event={"ID":"d2bd1b6d-e217-4f53-9e4f-82206b38fa58","Type":"ContainerStarted","Data":"e33cbea0eb711549d370f705b37f6b46d9e6dc77b178e268f4764e689e236ec1"} May 21 17:58:12.658022 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:12.657573 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 17:58:12.673566 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:12.673511 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" podStartSLOduration=1.253245512 podStartE2EDuration="1.673480811s" podCreationTimestamp="2026-05-21 17:58:11 +0000 UTC" firstStartedPulling="2026-05-21 17:58:11.889789411 +0000 UTC m=+906.653084977" lastFinishedPulling="2026-05-21 17:58:12.310024707 +0000 UTC m=+907.073320276" observedRunningTime="2026-05-21 17:58:12.671958832 +0000 UTC m=+907.435254419" watchObservedRunningTime="2026-05-21 17:58:12.673480811 +0000 UTC m=+907.436776408" May 21 17:58:23.666950 ip-10-0-141-214 kubenswrapper[2565]: I0521 17:58:23.666916 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c8bf79d5-c42sm" May 21 18:03:05.750564 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:03:05.750534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:03:05.753686 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:03:05.753662 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:03:05.753898 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:03:05.753881 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:03:05.757348 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:03:05.757324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:08:05.775104 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:08:05.775070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:08:05.777986 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:08:05.777964 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:08:05.780143 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:08:05.780112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:08:05.782973 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:08:05.782958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:13:05.797507 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:13:05.797458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:13:05.800404 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:13:05.800383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:13:05.804600 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:13:05.804576 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:13:05.807197 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:13:05.807181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:18:05.821072 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:18:05.821041 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:18:05.823796 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:18:05.823775 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:18:05.828197 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:18:05.828179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:18:05.830823 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:18:05.830806 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:19:24.062468 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:24.062432 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5b44cd-f2x5v_3e6dd6e4-563a-4e07-a28c-809722815404/authorino/0.log" May 21 18:19:29.384825 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:29.384791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c8bf79d5-c42sm_d2bd1b6d-e217-4f53-9e4f-82206b38fa58/manager/0.log" May 21 18:19:29.637805 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:29.637711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b676496df-dqpvv_b8b65cf1-3fff-4190-ace4-caf41904619e/manager/0.log" May 21 18:19:31.363130 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:31.363092 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5b44cd-f2x5v_3e6dd6e4-563a-4e07-a28c-809722815404/authorino/0.log" May 21 18:19:31.726656 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:31.726476 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-cwz9f_486c033c-4d41-4ca5-a591-1c5a4beabcdb/kuadrant-console-plugin/0.log" May 21 18:19:32.829305 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:32.829282 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f55555d9-h8jxn_3c6f180e-47cf-49eb-b304-de0364a049f9/kube-auth-proxy/0.log" May 21 18:19:33.190666 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:33.190577 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-frd95_39b3df8b-5c59-4800-b243-7ea281e2c4c6/payload-processing/0.log" May 21 18:19:34.089316 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.089277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg_dedb6a87-7444-4470-9636-e8fa246ba17e/storage-initializer/0.log" May 21 18:19:34.096688 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.096664 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccs4wcg_dedb6a87-7444-4470-9636-e8fa246ba17e/main/0.log" May 21 18:19:34.214607 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.214574 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb_9335d292-b3fa-442d-814f-94265bb71da0/storage-initializer/0.log" May 21 18:19:34.231210 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.231189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2qsgb_9335d292-b3fa-442d-814f-94265bb71da0/main/0.log" May 21 18:19:34.350897 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.350840 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-grv22_40632eec-5166-4ea2-8a3d-8f70dcd4ec7d/storage-initializer/0.log" May 21 18:19:34.358277 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:34.358252 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-grv22_40632eec-5166-4ea2-8a3d-8f70dcd4ec7d/main/0.log" May 21 18:19:41.757950 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:41.757887 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qr5gz_c1cc59a9-f3ea-49db-bb46-66193ecdcbb3/global-pull-secret-syncer/0.log" May 21 18:19:41.884275 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:41.884243 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f7m5r_6e101cb6-425f-4c3c-87fb-eadc117d93bc/konnectivity-agent/0.log" May 21 18:19:42.013195 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:42.013101 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-214.ec2.internal_611eecdfcb1ec0a5b7063b2d0d811571/haproxy/0.log" May 21 18:19:46.759810 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:46.759776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5b44cd-f2x5v_3e6dd6e4-563a-4e07-a28c-809722815404/authorino/0.log" May 21 18:19:46.846007 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:46.845971 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-cwz9f_486c033c-4d41-4ca5-a591-1c5a4beabcdb/kuadrant-console-plugin/0.log" May 21 18:19:48.600241 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.600144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s8kkc_1f9b341b-1dfd-4f4e-aa31-381e10d381c7/kube-state-metrics/0.log" May 21 18:19:48.640012 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.639991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s8kkc_1f9b341b-1dfd-4f4e-aa31-381e10d381c7/kube-rbac-proxy-main/0.log" May 21 18:19:48.661824 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.661804 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-s8kkc_1f9b341b-1dfd-4f4e-aa31-381e10d381c7/kube-rbac-proxy-self/0.log" May 21 18:19:48.686722 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.686700 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-669666dcbb-mslgk_376bfffb-02ec-4012-aadb-393497af0970/metrics-server/0.log" May 21 18:19:48.715098 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.715076 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-pbl46_021f4e49-6538-435d-80aa-acdce8aea7c9/monitoring-plugin/0.log" May 21 18:19:48.851859 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.851790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgl8m_7700683a-368a-4a1e-b41d-b4d1a68a4d13/node-exporter/0.log" May 21 18:19:48.874048 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.874026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgl8m_7700683a-368a-4a1e-b41d-b4d1a68a4d13/kube-rbac-proxy/0.log" May 21 18:19:48.895418 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:48.895401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgl8m_7700683a-368a-4a1e-b41d-b4d1a68a4d13/init-textfile/0.log" May 21 18:19:49.080542 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.080519 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/prometheus/0.log" May 21 18:19:49.103055 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.102998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/config-reloader/0.log" May 21 18:19:49.132232 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.132214 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/thanos-sidecar/0.log" May 21 18:19:49.165301 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.165282 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/kube-rbac-proxy-web/0.log" May 21 18:19:49.195105 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.195076 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/kube-rbac-proxy/0.log" May 21 18:19:49.221727 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.221707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/kube-rbac-proxy-thanos/0.log" May 21 18:19:49.249352 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:49.249330 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b25989bb-8e6a-42f7-87d4-1cd628dc5cd9/init-config-reloader/0.log" May 21 18:19:50.256551 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.256518 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74"] May 21 18:19:50.260226 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.260204 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.263909 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.263883 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b2w9r\"/\"default-dockercfg-s5bsx\"" May 21 18:19:50.264009 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.263912 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2w9r\"/\"openshift-service-ca.crt\"" May 21 18:19:50.264009 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.263915 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2w9r\"/\"kube-root-ca.crt\"" May 21 18:19:50.269470 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.269450 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74"] May 21 18:19:50.425114 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.425082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-lib-modules\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.425280 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.425123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-proc\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.425280 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.425141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-sys\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.425280 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.425192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-podres\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.425280 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.425213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm8rh\" (UniqueName: \"kubernetes.io/projected/726b3d50-c23a-4fce-a09d-adab430d27e6-kube-api-access-xm8rh\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526248 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526154 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-lib-modules\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526248 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526213 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-proc\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526248 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526234 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-sys\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526248 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-podres\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526601 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526279 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm8rh\" (UniqueName: \"kubernetes.io/projected/726b3d50-c23a-4fce-a09d-adab430d27e6-kube-api-access-xm8rh\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526601 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-lib-modules\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526601 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-proc\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526601 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-sys\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.526601 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.526415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/726b3d50-c23a-4fce-a09d-adab430d27e6-podres\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.534108 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.534087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm8rh\" (UniqueName: \"kubernetes.io/projected/726b3d50-c23a-4fce-a09d-adab430d27e6-kube-api-access-xm8rh\") pod \"perf-node-gather-daemonset-hqt74\" (UID: \"726b3d50-c23a-4fce-a09d-adab430d27e6\") " pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.571402 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.571381 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:50.699356 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.699330 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74"] May 21 18:19:50.701255 ip-10-0-141-214 kubenswrapper[2565]: W0521 18:19:50.701225 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod726b3d50_c23a_4fce_a09d_adab430d27e6.slice/crio-1da19eab174913c6740b095372c2a966ba7ae726232b6e836fd57842746f0c21 WatchSource:0}: Error finding container 1da19eab174913c6740b095372c2a966ba7ae726232b6e836fd57842746f0c21: Status 404 returned error can't find the container with id 1da19eab174913c6740b095372c2a966ba7ae726232b6e836fd57842746f0c21 May 21 18:19:50.702821 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:50.702805 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:19:51.043935 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.043898 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" event={"ID":"726b3d50-c23a-4fce-a09d-adab430d27e6","Type":"ContainerStarted","Data":"7fcb9fcc2df1c2c5fe2a2087bd1b7505612aad92694e347ce06749220607f0d0"} May 21 18:19:51.043935 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.043939 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" event={"ID":"726b3d50-c23a-4fce-a09d-adab430d27e6","Type":"ContainerStarted","Data":"1da19eab174913c6740b095372c2a966ba7ae726232b6e836fd57842746f0c21"} May 21 18:19:51.044138 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.043979 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:51.060333 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.060284 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" podStartSLOduration=1.06026978 podStartE2EDuration="1.06026978s" podCreationTimestamp="2026-05-21 18:19:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:19:51.059339425 +0000 UTC m=+2205.822635005" watchObservedRunningTime="2026-05-21 18:19:51.06026978 +0000 UTC m=+2205.823565409" May 21 18:19:51.084873 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.084848 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/2.log" May 21 18:19:51.088962 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.088933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qh4k2_a1e5afee-bcfd-4881-9b50-e7ec2801a9ae/console-operator/3.log" May 21 18:19:51.597865 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:51.597826 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-ttsbl_e16c1885-64de-4860-befd-3ecfa7db3408/download-server/0.log" May 21 18:19:52.067063 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:52.067033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-fvdkw_cd25a913-3b51-44ed-aaaf-a75c6e37238d/volume-data-source-validator/0.log" May 21 18:19:52.906206 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:52.906179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5d42_51cd8e22-15ef-4872-b966-d7a7ca24707f/dns/0.log" May 21 18:19:52.928449 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:52.928421 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5d42_51cd8e22-15ef-4872-b966-d7a7ca24707f/kube-rbac-proxy/0.log" May 21 18:19:53.034040 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:53.034013 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftfbj_553c3828-58db-4a38-947d-ef38652969fe/dns-node-resolver/0.log" May 21 18:19:53.560459 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:53.560428 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5959fdf665-dq6kd_e1c695de-cc28-4bb9-b8ca-08a36e2eb00d/registry/0.log" May 21 18:19:53.611467 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:53.611437 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48wgk_13932eed-1d3d-46d1-9bfc-4f9c54d62f5d/node-ca/0.log" May 21 18:19:54.727530 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:54.727485 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f55555d9-h8jxn_3c6f180e-47cf-49eb-b304-de0364a049f9/kube-auth-proxy/0.log" May 21 18:19:54.868841 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:54.868799 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-frd95_39b3df8b-5c59-4800-b243-7ea281e2c4c6/payload-processing/0.log" May 21 18:19:55.412848 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:55.412820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nrr4_19c33939-51c8-4ab9-9c8a-110c98d1d6fc/serve-healthcheck-canary/0.log" May 21 18:19:55.968333 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:55.968310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bzkb_015c829a-bc7c-424c-8ba6-c912284f8bb8/kube-rbac-proxy/0.log" May 21 18:19:55.989704 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:55.989682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bzkb_015c829a-bc7c-424c-8ba6-c912284f8bb8/exporter/0.log" May 21 18:19:56.011399 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:56.011369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bzkb_015c829a-bc7c-424c-8ba6-c912284f8bb8/extractor/0.log" May 21 18:19:57.057648 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:57.057616 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b2w9r/perf-node-gather-daemonset-hqt74" May 21 18:19:58.253288 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:58.253259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c8bf79d5-c42sm_d2bd1b6d-e217-4f53-9e4f-82206b38fa58/manager/0.log" May 21 18:19:58.325799 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:58.325757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b676496df-dqpvv_b8b65cf1-3fff-4190-ace4-caf41904619e/manager/0.log" May 21 18:19:59.716850 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:59.716807 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-786cf8fdc-4dskr_dbacdf70-7e01-4657-8976-a2b86d2ab7cd/manager/0.log" May 21 18:19:59.772877 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:19:59.772841 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-mhcwt_0eee86ae-dea8-4680-8ec5-d622fd345523/openshift-lws-operator/0.log" May 21 18:20:03.958658 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:03.958625 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qnnjq_6833f75c-ec93-47c4-9391-431c75fc4a1a/migrator/0.log" May 21 18:20:03.979211 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:03.979187 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qnnjq_6833f75c-ec93-47c4-9391-431c75fc4a1a/graceful-termination/0.log" May 21 18:20:05.589719 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.589692 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/kube-multus-additional-cni-plugins/0.log" May 21 18:20:05.609726 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.609697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/egress-router-binary-copy/0.log" May 21 18:20:05.629901 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.629876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/cni-plugins/0.log" May 21 18:20:05.649937 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.649917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/bond-cni-plugin/0.log" May 21 18:20:05.669293 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.669271 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/routeoverride-cni/0.log" May 21 18:20:05.688785 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.688765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/whereabouts-cni-bincopy/0.log" May 21 18:20:05.709677 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.709652 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl52h_9940eb66-5590-4034-81f8-bf733769bb41/whereabouts-cni/0.log" May 21 18:20:05.946258 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.946195 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-plxxb_0ec5cd19-8573-49bd-85c0-69504d92dc74/kube-multus/0.log" May 21 18:20:05.964521 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.964478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nf2kh_7d1f90c2-c4a5-4731-a31b-b3c9b5330e49/network-metrics-daemon/0.log" May 21 18:20:05.983413 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:05.983390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nf2kh_7d1f90c2-c4a5-4731-a31b-b3c9b5330e49/kube-rbac-proxy/0.log" May 21 18:20:07.129222 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.129186 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-controller/0.log" May 21 18:20:07.147913 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.147891 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/0.log" May 21 18:20:07.157047 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.157026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovn-acl-logging/1.log" May 21 18:20:07.176071 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.176046 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/kube-rbac-proxy-node/0.log" May 21 18:20:07.196517 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.196500 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/kube-rbac-proxy-ovn-metrics/0.log" May 21 18:20:07.214293 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.214277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/northd/0.log" May 21 18:20:07.237903 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.237886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/nbdb/0.log" May 21 18:20:07.257922 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.257900 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/sbdb/0.log" May 21 18:20:07.359711 ip-10-0-141-214 kubenswrapper[2565]: I0521 18:20:07.359682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92r2p_71a34b9a-570b-46cd-94da-2d423ac89e74/ovnkube-controller/0.log"