May 21 14:39:16.204653 ip-10-0-132-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 14:39:16.204667 ip-10-0-132-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 14:39:16.204678 ip-10-0-132-243 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 14:39:16.205007 ip-10-0-132-243 systemd[1]: Failed to start Kubernetes Kubelet. May 21 14:39:26.276031 ip-10-0-132-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 14:39:26.276048 ip-10-0-132-243 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fcedaa7ffd0a4a319783da82c28a63b3 -- May 21 14:42:04.610671 ip-10-0-132-243 systemd[1]: Starting Kubernetes Kubelet... May 21 14:42:05.131973 ip-10-0-132-243 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:42:05.131973 ip-10-0-132-243 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:42:05.131973 ip-10-0-132-243 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:42:05.131973 ip-10-0-132-243 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:42:05.131973 ip-10-0-132-243 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:42:05.135067 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.134975 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:42:05.141119 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141104 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:42:05.141119 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141119 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141123 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141126 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141130 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141132 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141136 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141139 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141142 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141145 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141148 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141151 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141153 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141155 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141159 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141162 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141165 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141167 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141170 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141172 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141175 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:42:05.141182 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141178 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141180 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141186 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141189 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141191 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141194 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141197 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141199 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141202 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141204 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141207 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141209 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141212 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141214 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141217 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141220 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141223 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141225 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:42:05.141667 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141228 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141230 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141233 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141235 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141238 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141240 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141243 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141246 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141248 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141251 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141253 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141256 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141258 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141261 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141263 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141268 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141271 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141273 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141276 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141278 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:42:05.142193 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141281 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141283 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141286 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141288 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141291 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141293 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141296 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141298 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141301 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141303 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141305 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141308 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141310 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141313 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141315 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141318 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141320 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141325 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141342 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:42:05.143071 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141346 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141349 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141352 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141355 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141358 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141362 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141365 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141763 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141768 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141771 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141774 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141777 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141779 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141782 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141785 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141787 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141790 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141792 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141795 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141798 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:42:05.143558 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141800 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141803 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141805 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141807 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141810 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141813 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141817 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141820 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141823 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141825 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141828 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141831 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141833 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141836 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141839 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141842 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141845 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141847 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141850 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141852 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:42:05.144200 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141855 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141857 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141860 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141862 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141864 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141867 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141869 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141872 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141874 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141876 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141879 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141966 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141975 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141980 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141984 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141989 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141993 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.141998 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142002 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:42:05.144714 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142006 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142014 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142020 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142026 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142038 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142042 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142047 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142063 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142067 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142072 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142133 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142627 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142636 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142642 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142647 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142652 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142656 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142661 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142666 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:42:05.145168 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142671 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142676 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142681 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142686 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142697 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142701 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142705 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142716 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142721 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142726 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142730 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142735 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142740 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142744 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.142748 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143773 2563 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143809 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143824 2563 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143833 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143841 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143847 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:42:05.145656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143855 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143868 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143874 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143891 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143898 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143904 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.143918 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144067 2563 flags.go:64] FLAG: --cgroup-root="" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144073 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144079 2563 flags.go:64] FLAG: --client-ca-file="" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144082 2563 flags.go:64] FLAG: --cloud-config="" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144085 2563 flags.go:64] FLAG: --cloud-provider="external" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144088 2563 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144094 2563 flags.go:64] FLAG: --cluster-domain="" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144097 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144101 2563 flags.go:64] FLAG: --config-dir="" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144104 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144108 2563 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144112 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144115 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144118 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144122 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144125 2563 flags.go:64] FLAG: --contention-profiling="false" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144128 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:42:05.146169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144131 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144134 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144137 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144150 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144153 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144156 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144159 2563 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144162 2563 flags.go:64] FLAG: --enable-server="true" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144165 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144171 2563 flags.go:64] FLAG: --event-burst="100" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144174 2563 flags.go:64] FLAG: --event-qps="50" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144177 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144181 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144184 2563 flags.go:64] FLAG: --eviction-hard="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144188 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144191 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144194 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144197 2563 flags.go:64] FLAG: --eviction-soft="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144200 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144203 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144206 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144209 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144213 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144216 2563 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144219 2563 flags.go:64] FLAG: --feature-gates="" May 21 14:42:05.146780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144223 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144227 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144230 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144233 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144236 2563 flags.go:64] FLAG: --healthz-port="10248" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144239 2563 flags.go:64] FLAG: --help="false" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144242 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-132-243.ec2.internal" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144245 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144249 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144251 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144257 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144261 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144263 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144267 2563 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144269 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144272 2563 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144275 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144278 2563 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144281 2563 flags.go:64] FLAG: --kube-reserved="" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144284 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144286 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144289 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144292 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144295 2563 flags.go:64] FLAG: --lock-file="" May 21 14:42:05.147386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144298 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144301 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144304 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144309 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144313 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144316 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144318 2563 flags.go:64] FLAG: --logging-format="text" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144321 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144324 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144343 2563 flags.go:64] FLAG: --manifest-url="" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144348 2563 flags.go:64] FLAG: --manifest-url-header="" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144354 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144358 2563 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144362 2563 flags.go:64] FLAG: --max-pods="110" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144365 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144368 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144371 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144374 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144377 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144380 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144383 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144392 2563 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144395 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144398 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:42:05.147994 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144401 2563 flags.go:64] FLAG: --pod-cidr="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144404 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144409 2563 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144412 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144415 2563 flags.go:64] FLAG: --pods-per-core="0" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144418 2563 flags.go:64] FLAG: --port="10250" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144421 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144424 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069c143c811fa456e" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144427 2563 flags.go:64] FLAG: --qos-reserved="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144430 2563 flags.go:64] FLAG: --read-only-port="10255" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144433 2563 flags.go:64] FLAG: --register-node="true" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144437 2563 flags.go:64] FLAG: --register-schedulable="true" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144440 2563 flags.go:64] FLAG: --register-with-taints="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144444 2563 flags.go:64] FLAG: --registry-burst="10" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144447 2563 flags.go:64] FLAG: --registry-qps="5" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144450 2563 flags.go:64] FLAG: --reserved-cpus="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144453 2563 flags.go:64] FLAG: --reserved-memory="" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144457 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144460 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144463 2563 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144466 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144468 2563 flags.go:64] FLAG: --runonce="false" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144471 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144474 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144477 2563 flags.go:64] FLAG: --seccomp-default="false" May 21 14:42:05.148576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144480 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144483 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144486 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144489 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144492 2563 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144495 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144497 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144501 2563 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144504 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144507 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144510 2563 flags.go:64] FLAG: --system-cgroups="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144513 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144520 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144523 2563 flags.go:64] FLAG: --tls-cert-file="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144526 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144530 2563 flags.go:64] FLAG: --tls-min-version="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144533 2563 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144536 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144538 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144542 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144545 2563 flags.go:64] FLAG: --v="2" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144550 2563 flags.go:64] FLAG: --version="false" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144554 2563 flags.go:64] FLAG: --vmodule="" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144558 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.144562 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:42:05.149174 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144684 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144688 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144691 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144695 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144697 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144700 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144702 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144705 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144708 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144710 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144713 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144715 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144719 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144721 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144724 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144728 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144730 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144733 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144735 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144738 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:42:05.149782 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144740 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144743 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144745 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144748 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144750 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144753 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144755 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144757 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144760 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144762 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144765 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144767 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144770 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144774 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144778 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144782 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144785 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144787 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144790 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144792 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:42:05.150282 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144795 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144798 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144800 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144803 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144805 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144808 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144810 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144813 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144817 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144820 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144822 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144827 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144830 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144835 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144837 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144840 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144845 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144847 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:42:05.150813 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144850 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144852 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144854 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144857 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144860 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144864 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144866 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144869 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144871 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144874 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144876 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144881 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144884 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144887 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144890 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144893 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144895 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144898 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144901 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:42:05.151350 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144903 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144906 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144909 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144911 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144914 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144916 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.144919 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:42:05.151807 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.145858 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:42:05.154489 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.154471 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:42:05.154534 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.154490 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:42:05.154570 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154561 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:42:05.154570 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154570 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154573 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154577 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154580 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154583 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154586 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154589 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154592 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154595 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154598 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154601 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154603 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154606 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154608 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154611 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154614 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154616 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154619 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154621 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154624 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:42:05.154626 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154626 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154629 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154632 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154635 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154638 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154642 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154646 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154649 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154652 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154655 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154659 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154662 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154665 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154668 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154671 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154673 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154676 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154678 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154680 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:42:05.155104 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154683 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154685 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154689 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154692 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154695 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154697 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154700 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154702 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154705 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154707 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154710 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154713 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154715 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154718 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154720 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154724 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154727 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154729 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154732 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154735 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:42:05.155581 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154738 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154740 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154743 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154745 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154749 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154751 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154754 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154757 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154759 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154761 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154764 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154767 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154769 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154771 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154774 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154776 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154779 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154781 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154784 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:42:05.156061 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154786 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154789 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154791 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154794 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154796 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154799 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154801 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.154806 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154901 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154907 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154910 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154913 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154916 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154919 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154922 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:42:05.156544 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154927 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154930 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154933 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154936 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154939 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154942 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154944 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154947 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154949 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154951 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154954 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154957 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154959 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154962 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154964 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154967 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154969 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154972 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154974 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154976 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:42:05.156907 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154979 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154982 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154984 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154986 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154989 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154992 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154995 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.154997 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155000 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155002 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155005 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155008 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155010 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155013 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155016 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155018 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155021 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155023 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155026 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:42:05.157387 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155028 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155031 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155033 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155037 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155040 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155043 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155045 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155048 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155051 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155054 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155056 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155058 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155061 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155064 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155066 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155069 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155071 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155074 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155077 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:42:05.157838 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155079 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155082 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155084 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155087 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155089 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155092 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155095 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155097 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155100 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155102 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155105 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155108 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155110 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155113 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155116 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155119 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155121 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155124 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155126 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155129 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:42:05.158293 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:05.155131 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:42:05.158797 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.155136 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:42:05.158797 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.155944 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:42:05.158797 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.158126 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:42:05.159314 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.159302 2563 server.go:1019] "Starting client certificate rotation" May 21 14:42:05.159445 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.159428 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:42:05.159485 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.159476 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:42:05.190710 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.190688 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:42:05.194973 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.194950 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:42:05.213528 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.213372 2563 log.go:25] "Validated CRI v1 runtime API" May 21 14:42:05.219435 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.219414 2563 log.go:25] "Validated CRI v1 image API" May 21 14:42:05.220923 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.220906 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:42:05.221516 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.221500 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:42:05.229162 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.229142 2563 fs.go:135] Filesystem UUIDs: map[07e5df63-8ea5-469b-b9ea-5c8916230017:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a0745e89-fea2-4c51-989b-64197f921e17:/dev/nvme0n1p4] May 21 14:42:05.229232 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.229161 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:42:05.233472 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.233360 2563 manager.go:217] Machine: {Timestamp:2026-05-21 14:42:05.232845854 +0000 UTC m=+0.485133574 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099774 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a65bd3f44b9815621726d75d2e731 SystemUUID:ec2a65bd-3f44-b981-5621-726d75d2e731 BootID:fcedaa7f-fd0a-4a31-9783-da82c28a63b3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:b5:dc:9a:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:b5:dc:9a:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:23:32:a8:c3:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:42:05.234071 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.234061 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:42:05.234161 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.234150 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:42:05.236983 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.236959 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:42:05.237126 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.236987 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:42:05.237168 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.237136 2563 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:42:05.237168 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.237144 2563 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:42:05.237168 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.237153 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:42:05.237168 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.237166 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:42:05.238885 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.238874 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 14:42:05.239003 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.238994 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:42:05.239356 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.239325 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5w59r" May 21 14:42:05.241408 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.241398 2563 kubelet.go:491] "Attempting to sync node with API server" May 21 14:42:05.241449 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.241413 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:42:05.241449 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.241428 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:42:05.241449 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.241437 2563 kubelet.go:397] "Adding apiserver pod source" May 21 14:42:05.241449 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.241446 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:42:05.243011 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.242997 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:42:05.243057 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.243018 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:42:05.246364 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.246325 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5w59r" May 21 14:42:05.246798 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.246781 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:42:05.248989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.248975 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:42:05.251210 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251198 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251215 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251222 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251228 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251236 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251242 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251248 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251253 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251261 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:42:05.251267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251267 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:42:05.251519 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251275 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:42:05.251519 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.251281 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:42:05.252285 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.252273 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:42:05.252322 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.252288 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:42:05.253845 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.253829 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:05.256294 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.256260 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:42:05.256402 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.256320 2563 server.go:1295] "Started kubelet" May 21 14:42:05.256452 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.256389 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:42:05.256550 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.256499 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:42:05.256593 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.256573 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:42:05.257078 ip-10-0-132-243 systemd[1]: Started Kubernetes Kubelet. May 21 14:42:05.257641 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.257525 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:05.258020 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.257885 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:42:05.258627 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.258611 2563 server.go:317] "Adding debug handlers to kubelet server" May 21 14:42:05.260062 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.260036 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-243.ec2.internal" not found May 21 14:42:05.264127 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.264110 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:42:05.265504 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265487 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:42:05.265769 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265749 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:42:05.265838 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265788 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:42:05.265942 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265882 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:42:05.265995 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265952 2563 reconstruct.go:97] "Volume reconstruction finished" May 21 14:42:05.265995 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.265961 2563 reconciler.go:26] "Reconciler: start to sync state" May 21 14:42:05.266614 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.266593 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found" May 21 14:42:05.266788 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.266768 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:42:05.266890 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.266878 2563 factory.go:55] Registering systemd factory May 21 14:42:05.266927 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.266892 2563 factory.go:223] Registration of the systemd container factory successfully May 21 14:42:05.267106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267092 2563 factory.go:153] Registering CRI-O factory May 21 14:42:05.267164 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267110 2563 factory.go:223] Registration of the crio container factory successfully May 21 14:42:05.267164 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267153 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:42:05.267236 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267169 2563 factory.go:103] Registering Raw factory May 21 14:42:05.267236 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267183 2563 manager.go:1196] Started watching for new ooms in manager May 21 14:42:05.267509 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.267499 2563 manager.go:319] Starting recovery of all containers May 21 14:42:05.269553 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.269533 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:05.270773 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.270742 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-243.ec2.internal\" not found" node="ip-10-0-132-243.ec2.internal" May 21 14:42:05.274440 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.274422 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-243.ec2.internal" not found May 21 14:42:05.277694 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.277679 2563 manager.go:324] Recovery completed May 21 14:42:05.282177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.282161 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:42:05.284517 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.284430 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory" May 21 14:42:05.284517 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.284457 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:42:05.284517 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.284469 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID" May 21 14:42:05.285051 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.285039 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:42:05.285051 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.285050 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:42:05.285127 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.285067 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 14:42:05.287615 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.287603 2563 policy_none.go:49] "None policy: Start" May 21 14:42:05.287652 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.287622 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:42:05.287652 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.287633 2563 state_mem.go:35] "Initializing new in-memory state store" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.325572 2563 manager.go:341] "Starting Device Plugin manager" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.325653 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.325665 2563 server.go:85] "Starting device plugin registration server" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.325898 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.325908 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.326009 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.326080 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.326089 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.326563 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.326603 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-243.ec2.internal\" not found" May 21 14:42:05.338265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.332150 2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-243.ec2.internal" not found May 21 14:42:05.396566 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.396489 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:42:05.397939 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.397919 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:42:05.397939 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.397944 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:42:05.398136 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.397962 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:42:05.398136 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.397969 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:42:05.398136 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.398014 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:42:05.400993 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.400976 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:05.426594 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.426556 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:42:05.427929 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.427907 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory" May 21 14:42:05.428050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.427940 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:42:05.428050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.427959 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID" May 21 14:42:05.428050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.427991 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-243.ec2.internal" May 21 14:42:05.436828 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.436805 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-243.ec2.internal" May 21 14:42:05.436896 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:05.436832 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-243.ec2.internal\": node \"ip-10-0-132-243.ec2.internal\" not found" May 21 14:42:05.498939 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.498903 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"] May 21 14:42:05.501286 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.501262 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.501416 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.501266 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:05.528216 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.528183 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.532743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.532728 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:05.539976 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.539957 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:42:05.542571 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.542554 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:42:05.668677 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.668584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.668677 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.668623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.668677 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.668648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d84741ee3eadebab7b094365b966a90-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"8d84741ee3eadebab7b094365b966a90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:05.768807 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768777 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.768807 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768806 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.769006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768823 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d84741ee3eadebab7b094365b966a90-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"8d84741ee3eadebab7b094365b966a90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:05.769006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d84741ee3eadebab7b094365b966a90-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"8d84741ee3eadebab7b094365b966a90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:05.769006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.769006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.768886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/987bb94935589401bb501b47e4fcd9b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"987bb94935589401bb501b47e4fcd9b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.842968 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.842924 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" May 21 14:42:05.846634 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:05.846615 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" May 21 14:42:06.158787 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.158684 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:42:06.159507 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.158920 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:42:06.159507 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.158923 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:42:06.159507 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.158946 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:42:06.241634 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.241602 2563 apiserver.go:52] "Watching apiserver" May 21 14:42:06.248522 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.248390 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:37:05 +0000 UTC" deadline="2027-12-09 14:10:22.748908456 +0000 UTC" May 21 14:42:06.248522 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.248503 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13607h28m16.500413352s" May 21 14:42:06.253509 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.253488 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:42:06.253860 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.253838 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-r8psm","openshift-dns/node-resolver-mh292","openshift-image-registry/node-ca-tdnw9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal","openshift-multus/multus-bgssk","openshift-multus/network-metrics-daemon-nlsht","openshift-network-diagnostics/network-check-target-pszw4","openshift-network-operator/iptables-alerter-hmshz","kube-system/konnectivity-agent-qnlv5","kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w","openshift-multus/multus-additional-cni-plugins-brdn9","openshift-ovn-kubernetes/ovnkube-node-hb8kt"] May 21 14:42:06.256573 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.256547 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.257551 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.257533 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.258670 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.258654 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.259100 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259084 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:42:06.259280 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259267 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2jxgb\"" May 21 14:42:06.259426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259409 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:42:06.259649 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259636 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bgssk" May 21 14:42:06.259920 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259892 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:42:06.260000 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.259982 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xdg7s\"" May 21 14:42:06.260237 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.260224 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:42:06.260743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.260727 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:42:06.260817 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.260800 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.260937 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.260914 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:06.260996 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.260984 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:42:06.261048 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.260989 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vrsn6\"" May 21 14:42:06.261274 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.261262 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:42:06.261597 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.261584 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:42:06.261813 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.261800 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:42:06.261873 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.261803 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:42:06.261943 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.261849 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:06.262014 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.261986 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:06.262149 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.262136 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:42:06.262200 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.262147 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wk22h\"" May 21 14:42:06.262928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.262912 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.264029 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264013 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.264123 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264111 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.264277 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264183 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:42:06.264940 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264926 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:42:06.265000 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264975 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:42:06.265000 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.264977 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:42:06.265197 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.265184 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8vltv\"" May 21 14:42:06.265236 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.265207 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.266712 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.266691 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.268541 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.267690 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:42:06.268541 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.267907 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lz2z6\"" May 21 14:42:06.268541 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268019 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:42:06.268541 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268355 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:42:06.268835 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268628 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:42:06.268911 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268862 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jc2b2\"" May 21 14:42:06.268974 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268956 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:42:06.269027 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.268979 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:42:06.269079 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.269054 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:42:06.269079 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.269074 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:42:06.269743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.269233 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:42:06.269743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.269307 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v87jz\"" May 21 14:42:06.269743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.269416 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:42:06.270826 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.270794 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:42:06.270935 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.270794 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:42:06.270935 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.270903 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:42:06.270935 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.270906 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9n8mg\"" May 21 14:42:06.271455 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833ae58b-c7a7-4099-8423-7e17d5a312fa-serviceca\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.271499 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-etc-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.271499 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-ovn\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.271499 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.271586 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-config\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.271586 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-conf\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.271586 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzzs\" (UniqueName: \"kubernetes.io/projected/47efaf47-90f9-4fd9-a3ba-1312f99933cf-kube-api-access-7pzzs\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.271693 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-cni-binary-copy\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.271693 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c09078b-b130-49e3-8a4e-84cfa4a0e237-tmp-dir\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.271693 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-lib-modules\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.271693 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-host\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.271846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-multus\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.271846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.271846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2g5j\" (UniqueName: \"kubernetes.io/projected/d080bedb-39b4-456e-ab98-c731bf783e8a-kube-api-access-j2g5j\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.271846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-tmp\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.271846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-socket-dir-parent\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659lr\" (UniqueName: \"kubernetes.io/projected/833ae58b-c7a7-4099-8423-7e17d5a312fa-kube-api-access-659lr\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-var-lib-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.271999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-iptables-alerter-script\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c09078b-b130-49e3-8a4e-84cfa4a0e237-hosts-file\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-slash\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-systemd\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-conf-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:06.272106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bw4\" (UniqueName: \"kubernetes.io/projected/939d2722-3419-4b4b-8397-ae904899918d-kube-api-access-n9bw4\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-sys-fs\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-log-socket\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-script-lib\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysconfig\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-os-release\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-bin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-multus-certs\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-host-slash\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrfjx\" (UniqueName: \"kubernetes.io/projected/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-kube-api-access-wrfjx\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vng8b\" (UniqueName: \"kubernetes.io/projected/7c09078b-b130-49e3-8a4e-84cfa4a0e237-kube-api-access-vng8b\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.272552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-systemd-units\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-modprobe-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-kubelet\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52c496e7-e22f-42df-b946-676910070be7-agent-certs\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2ww\" (UniqueName: \"kubernetes.io/projected/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kube-api-access-ng2ww\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-kubelet\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-netns\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-env-overrides\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-run\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-netns\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpk7n\" (UniqueName: \"kubernetes.io/projected/f0db5469-3445-4472-9256-c07dc80f8a57-kube-api-access-jpk7n\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-device-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-cnibin\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.273134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-systemd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-tuned\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-kubernetes\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-system-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.272981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-cnibin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-multus-daemon-config\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833ae58b-c7a7-4099-8423-7e17d5a312fa-host\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-socket-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-netd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cs9g\" (UniqueName: \"kubernetes.io/projected/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-kube-api-access-5cs9g\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-registration-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-bin\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-os-release\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-node-log\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-sys\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-k8s-cni-cncf-io\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-hostroot\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.273623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/939d2722-3419-4b4b-8397-ae904899918d-ovn-node-metrics-cert\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.274178 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-var-lib-kubelet\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.274178 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-etc-kubernetes\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.274178 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.273346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52c496e7-e22f-42df-b946-676910070be7-konnectivity-ca\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.276560 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.276544 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:42:06.293068 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.293043 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwjtl" May 21 14:42:06.300866 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.300848 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwjtl" May 21 14:42:06.366591 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.366571 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:42:06.373491 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373469 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.373600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373505 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.373600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373532 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-var-lib-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373555 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373577 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-iptables-alerter-script\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373601 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c09078b-b130-49e3-8a4e-84cfa4a0e237-hosts-file\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373622 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-slash\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373643 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-systemd\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-conf-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373677 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373697 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bw4\" (UniqueName: \"kubernetes.io/projected/939d2722-3419-4b4b-8397-ae904899918d-kube-api-access-n9bw4\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-var-lib-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373713 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-systemd\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373731 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-sys-fs\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-sys-fs\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373779 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-log-socket\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-slash\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.373788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-conf-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373814 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-script-lib\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373845 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysconfig\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373878 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373907 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373933 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373964 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-os-release\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373993 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-bin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374024 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-multus-certs\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374072 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374097 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-host-slash\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-os-release\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374132 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrfjx\" (UniqueName: \"kubernetes.io/projected/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-kube-api-access-wrfjx\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374168 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vng8b\" (UniqueName: \"kubernetes.io/projected/7c09078b-b130-49e3-8a4e-84cfa4a0e237-kube-api-access-vng8b\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374198 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374224 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-systemd-units\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c09078b-b130-49e3-8a4e-84cfa4a0e237-hosts-file\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374247 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-modprobe-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374270 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374293 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-kubelet\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52c496e7-e22f-42df-b946-676910070be7-agent-certs\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374368 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2ww\" (UniqueName: \"kubernetes.io/projected/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kube-api-access-ng2ww\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374384 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-kubelet\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374402 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-netns\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374426 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374440 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-env-overrides\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374455 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-run\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374470 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-netns\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374485 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpk7n\" (UniqueName: \"kubernetes.io/projected/f0db5469-3445-4472-9256-c07dc80f8a57-kube-api-access-jpk7n\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374502 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374538 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-device-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374553 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-cnibin\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374568 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-systemd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.374848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374586 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-tuned\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374604 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-kubernetes\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-bin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-system-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-multus-certs\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374638 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-cnibin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374654 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-multus-daemon-config\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374669 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833ae58b-c7a7-4099-8423-7e17d5a312fa-host\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-socket-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374700 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-netd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374716 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cs9g\" (UniqueName: \"kubernetes.io/projected/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-kube-api-access-5cs9g\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-registration-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374748 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-bin\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374762 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-os-release\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374788 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-node-log\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374803 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-sys\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374824 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-k8s-cni-cncf-io\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.375391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374841 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-hostroot\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374859 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/939d2722-3419-4b4b-8397-ae904899918d-ovn-node-metrics-cert\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-modprobe-d\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374874 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-var-lib-kubelet\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374891 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-etc-kubernetes\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374901 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-kubelet\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374906 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52c496e7-e22f-42df-b946-676910070be7-konnectivity-ca\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374922 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833ae58b-c7a7-4099-8423-7e17d5a312fa-serviceca\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374937 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-etc-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374953 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-ovn\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374972 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374988 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-config\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375012 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-conf\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375029 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzzs\" (UniqueName: \"kubernetes.io/projected/47efaf47-90f9-4fd9-a3ba-1312f99933cf-kube-api-access-7pzzs\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375044 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-cni-binary-copy\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375059 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c09078b-b130-49e3-8a4e-84cfa4a0e237-tmp-dir\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375073 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-lib-modules\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375088 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-host\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.376265 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375103 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-multus\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375119 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375135 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2g5j\" (UniqueName: \"kubernetes.io/projected/d080bedb-39b4-456e-ab98-c731bf783e8a-kube-api-access-j2g5j\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375151 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-tmp\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-socket-dir-parent\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-ovn\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375526 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-sys\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.374807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-systemd-units\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-k8s-cni-cncf-io\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-hostroot\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-etc-kubernetes\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-node-log\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-kubelet\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-script-lib\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-run-netns\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.377271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376426 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52c496e7-e22f-42df-b946-676910070be7-konnectivity-ca\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376743 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-env-overrides\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833ae58b-c7a7-4099-8423-7e17d5a312fa-serviceca\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-run\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-run-netns\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.376956 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.376978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-host-slash\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-cnibin\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377266 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-netd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-registration-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-host-cni-bin\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-device-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d080bedb-39b4-456e-ab98-c731bf783e8a-os-release\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833ae58b-c7a7-4099-8423-7e17d5a312fa-host\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-kubernetes\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.378128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-socket-dir\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-etc-openvswitch\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-system-cni-dir\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.377829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-cnibin\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-multus-daemon-config\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysctl-conf\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378508 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-lib-modules\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-iptables-alerter-script\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/939d2722-3419-4b4b-8397-ae904899918d-ovn-node-metrics-cert\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52c496e7-e22f-42df-b946-676910070be7-agent-certs\") pod \"konnectivity-agent-qnlv5\" (UID: \"52c496e7-e22f-42df-b946-676910070be7\") " pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-var-lib-kubelet\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.378924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.375191 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659lr\" (UniqueName: \"kubernetes.io/projected/833ae58b-c7a7-4099-8423-7e17d5a312fa-kube-api-access-659lr\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-sysconfig\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.378956 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.379022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47efaf47-90f9-4fd9-a3ba-1312f99933cf-host\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.379044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c09078b-b130-49e3-8a4e-84cfa4a0e237-tmp-dir\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.379073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-host-var-lib-cni-multus\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.379178 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:06.879132075 +0000 UTC m=+2.131419810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.379231 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.379258 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.379274 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:06.379483 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.379407 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:06.879386631 +0000 UTC m=+2.131674356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:06.380145 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.379543 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/939d2722-3419-4b4b-8397-ae904899918d-ovnkube-config\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.380145 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.379632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-run-systemd\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.380243 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.380142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-etc-tuned\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.380421 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.380400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0db5469-3445-4472-9256-c07dc80f8a57-multus-socket-dir-parent\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.380595 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.373845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/939d2722-3419-4b4b-8397-ae904899918d-log-socket\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.382312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.381442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.382312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.381622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47efaf47-90f9-4fd9-a3ba-1312f99933cf-tmp\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.382312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.381672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d080bedb-39b4-456e-ab98-c731bf783e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.382312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.382000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrfjx\" (UniqueName: \"kubernetes.io/projected/6b3dc4d1-5e3a-40a0-871e-47f3bbecb468-kube-api-access-wrfjx\") pod \"iptables-alerter-hmshz\" (UID: \"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468\") " pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.382312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.382219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bw4\" (UniqueName: \"kubernetes.io/projected/939d2722-3419-4b4b-8397-ae904899918d-kube-api-access-n9bw4\") pod \"ovnkube-node-hb8kt\" (UID: \"939d2722-3419-4b4b-8397-ae904899918d\") " pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.383421 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.383404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659lr\" (UniqueName: \"kubernetes.io/projected/833ae58b-c7a7-4099-8423-7e17d5a312fa-kube-api-access-659lr\") pod \"node-ca-tdnw9\" (UID: \"833ae58b-c7a7-4099-8423-7e17d5a312fa\") " pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.388722 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.388701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0db5469-3445-4472-9256-c07dc80f8a57-cni-binary-copy\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.389758 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.389736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzzs\" (UniqueName: \"kubernetes.io/projected/47efaf47-90f9-4fd9-a3ba-1312f99933cf-kube-api-access-7pzzs\") pod \"tuned-r8psm\" (UID: \"47efaf47-90f9-4fd9-a3ba-1312f99933cf\") " pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.389928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.389908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vng8b\" (UniqueName: \"kubernetes.io/projected/7c09078b-b130-49e3-8a4e-84cfa4a0e237-kube-api-access-vng8b\") pod \"node-resolver-mh292\" (UID: \"7c09078b-b130-49e3-8a4e-84cfa4a0e237\") " pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.390075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.390052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2ww\" (UniqueName: \"kubernetes.io/projected/82f1dee0-af66-467e-a6d6-b2f2ea603ab3-kube-api-access-ng2ww\") pod \"aws-ebs-csi-driver-node-rh95w\" (UID: \"82f1dee0-af66-467e-a6d6-b2f2ea603ab3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.390224 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.390208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2g5j\" (UniqueName: \"kubernetes.io/projected/d080bedb-39b4-456e-ab98-c731bf783e8a-kube-api-access-j2g5j\") pod \"multus-additional-cni-plugins-brdn9\" (UID: \"d080bedb-39b4-456e-ab98-c731bf783e8a\") " pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.390967 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.390949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpk7n\" (UniqueName: \"kubernetes.io/projected/f0db5469-3445-4472-9256-c07dc80f8a57-kube-api-access-jpk7n\") pod \"multus-bgssk\" (UID: \"f0db5469-3445-4472-9256-c07dc80f8a57\") " pod="openshift-multus/multus-bgssk" May 21 14:42:06.390967 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.390957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cs9g\" (UniqueName: \"kubernetes.io/projected/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-kube-api-access-5cs9g\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.397989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.397972 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:06.415046 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.414994 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" May 21 14:42:06.419707 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.419689 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-brdn9" May 21 14:42:06.432170 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.432154 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:06.595280 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.595249 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8psm" May 21 14:42:06.609177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.608968 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mh292" May 21 14:42:06.614080 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.614041 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987bb94935589401bb501b47e4fcd9b2.slice/crio-fd3277ba0674dfd9f82d75056b163eef271ed62de182451de4f3b567727e5248 WatchSource:0}: Error finding container fd3277ba0674dfd9f82d75056b163eef271ed62de182451de4f3b567727e5248: Status 404 returned error can't find the container with id fd3277ba0674dfd9f82d75056b163eef271ed62de182451de4f3b567727e5248 May 21 14:42:06.614381 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.614362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47efaf47_90f9_4fd9_a3ba_1312f99933cf.slice/crio-b0acb0d607ce4c562ae30a252e9bda5ca929d6eeed787726bff6fb54521a4022 WatchSource:0}: Error finding container b0acb0d607ce4c562ae30a252e9bda5ca929d6eeed787726bff6fb54521a4022: Status 404 returned error can't find the container with id b0acb0d607ce4c562ae30a252e9bda5ca929d6eeed787726bff6fb54521a4022 May 21 14:42:06.614564 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.614547 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d84741ee3eadebab7b094365b966a90.slice/crio-3a0fc756cb65aef64a0ae07593268c8716f3a3230b9d405aaed1d420c7f1b88f WatchSource:0}: Error finding container 3a0fc756cb65aef64a0ae07593268c8716f3a3230b9d405aaed1d420c7f1b88f: Status 404 returned error can't find the container with id 3a0fc756cb65aef64a0ae07593268c8716f3a3230b9d405aaed1d420c7f1b88f May 21 14:42:06.618420 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.618390 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:42:06.619630 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.619610 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c09078b_b130_49e3_8a4e_84cfa4a0e237.slice/crio-7d9d914dcc517905628777f356b38d6f7ad4af449793364af5837f01744d7db7 WatchSource:0}: Error finding container 7d9d914dcc517905628777f356b38d6f7ad4af449793364af5837f01744d7db7: Status 404 returned error can't find the container with id 7d9d914dcc517905628777f356b38d6f7ad4af449793364af5837f01744d7db7 May 21 14:42:06.626154 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.626133 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdnw9" May 21 14:42:06.633010 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.632988 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833ae58b_c7a7_4099_8423_7e17d5a312fa.slice/crio-52d2610226899ea7968de0d00c85095a357ce652c11911961beb201fe5ff1427 WatchSource:0}: Error finding container 52d2610226899ea7968de0d00c85095a357ce652c11911961beb201fe5ff1427: Status 404 returned error can't find the container with id 52d2610226899ea7968de0d00c85095a357ce652c11911961beb201fe5ff1427 May 21 14:42:06.637650 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.637634 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bgssk" May 21 14:42:06.643799 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.643778 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0db5469_3445_4472_9256_c07dc80f8a57.slice/crio-41ae979d8b1d78f4de157ee4e7357c69676e7c4a539d1447cbe76e4de8b6df8a WatchSource:0}: Error finding container 41ae979d8b1d78f4de157ee4e7357c69676e7c4a539d1447cbe76e4de8b6df8a: Status 404 returned error can't find the container with id 41ae979d8b1d78f4de157ee4e7357c69676e7c4a539d1447cbe76e4de8b6df8a May 21 14:42:06.660788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.660769 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmshz" May 21 14:42:06.667845 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.667819 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3dc4d1_5e3a_40a0_871e_47f3bbecb468.slice/crio-68cc7c44a89ee6cf20e2ecda8b88c93f07c361d9b23604ae63be476bebaf7a0a WatchSource:0}: Error finding container 68cc7c44a89ee6cf20e2ecda8b88c93f07c361d9b23604ae63be476bebaf7a0a: Status 404 returned error can't find the container with id 68cc7c44a89ee6cf20e2ecda8b88c93f07c361d9b23604ae63be476bebaf7a0a May 21 14:42:06.800954 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.800928 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c496e7_e22f_42df_b946_676910070be7.slice/crio-47b311165c66fbd97765143dc430ce07b717633cabce4dddc8bbc72e8087b53d WatchSource:0}: Error finding container 47b311165c66fbd97765143dc430ce07b717633cabce4dddc8bbc72e8087b53d: Status 404 returned error can't find the container with id 47b311165c66fbd97765143dc430ce07b717633cabce4dddc8bbc72e8087b53d May 21 14:42:06.883606 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.883576 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:06.883618 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883708 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883732 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883751 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883763 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883784 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:07.883769464 +0000 UTC m=+3.136057171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:06.883817 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:06.883808 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:07.883793432 +0000 UTC m=+3.136081141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:06.891468 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.891436 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939d2722_3419_4b4b_8397_ae904899918d.slice/crio-9cdd470e13fc9cfb5dd96e3d51c499b653cdcf33d662e9c25efe73378057358a WatchSource:0}: Error finding container 9cdd470e13fc9cfb5dd96e3d51c499b653cdcf33d662e9c25efe73378057358a: Status 404 returned error can't find the container with id 9cdd470e13fc9cfb5dd96e3d51c499b653cdcf33d662e9c25efe73378057358a May 21 14:42:06.891918 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.891906 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f1dee0_af66_467e_a6d6_b2f2ea603ab3.slice/crio-0e8b3746431e495792373f87240472497238da6a0328c3a2e8fb047f4e8eaa99 WatchSource:0}: Error finding container 0e8b3746431e495792373f87240472497238da6a0328c3a2e8fb047f4e8eaa99: Status 404 returned error can't find the container with id 0e8b3746431e495792373f87240472497238da6a0328c3a2e8fb047f4e8eaa99 May 21 14:42:06.959440 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:42:06.959410 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd080bedb_39b4_456e_ab98_c731bf783e8a.slice/crio-de6f4480cba9c8f5eab7df1a762e4c91dd9377469602e558d9ed00c76432b555 WatchSource:0}: Error finding container de6f4480cba9c8f5eab7df1a762e4c91dd9377469602e558d9ed00c76432b555: Status 404 returned error can't find the container with id de6f4480cba9c8f5eab7df1a762e4c91dd9377469602e558d9ed00c76432b555 May 21 14:42:07.181939 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.181907 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:07.303890 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.303800 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:37:06 +0000 UTC" deadline="2027-10-19 13:19:32.942453057 +0000 UTC" May 21 14:42:07.303890 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.303840 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12382h37m25.638616689s" May 21 14:42:07.401223 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.401190 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:07.401392 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.401317 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:07.424993 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.424911 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" event={"ID":"82f1dee0-af66-467e-a6d6-b2f2ea603ab3","Type":"ContainerStarted","Data":"0e8b3746431e495792373f87240472497238da6a0328c3a2e8fb047f4e8eaa99"} May 21 14:42:07.433158 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.433047 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"9cdd470e13fc9cfb5dd96e3d51c499b653cdcf33d662e9c25efe73378057358a"} May 21 14:42:07.435544 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.435487 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qnlv5" event={"ID":"52c496e7-e22f-42df-b946-676910070be7","Type":"ContainerStarted","Data":"47b311165c66fbd97765143dc430ce07b717633cabce4dddc8bbc72e8087b53d"} May 21 14:42:07.444681 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.444605 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bgssk" event={"ID":"f0db5469-3445-4472-9256-c07dc80f8a57","Type":"ContainerStarted","Data":"41ae979d8b1d78f4de157ee4e7357c69676e7c4a539d1447cbe76e4de8b6df8a"} May 21 14:42:07.461772 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.461658 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mh292" event={"ID":"7c09078b-b130-49e3-8a4e-84cfa4a0e237","Type":"ContainerStarted","Data":"7d9d914dcc517905628777f356b38d6f7ad4af449793364af5837f01744d7db7"} May 21 14:42:07.470182 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.470145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" event={"ID":"8d84741ee3eadebab7b094365b966a90","Type":"ContainerStarted","Data":"3a0fc756cb65aef64a0ae07593268c8716f3a3230b9d405aaed1d420c7f1b88f"} May 21 14:42:07.476176 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.476144 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerStarted","Data":"de6f4480cba9c8f5eab7df1a762e4c91dd9377469602e558d9ed00c76432b555"} May 21 14:42:07.492105 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.492070 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmshz" event={"ID":"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468","Type":"ContainerStarted","Data":"68cc7c44a89ee6cf20e2ecda8b88c93f07c361d9b23604ae63be476bebaf7a0a"} May 21 14:42:07.504584 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.504547 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdnw9" event={"ID":"833ae58b-c7a7-4099-8423-7e17d5a312fa","Type":"ContainerStarted","Data":"52d2610226899ea7968de0d00c85095a357ce652c11911961beb201fe5ff1427"} May 21 14:42:07.508070 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.508038 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8psm" event={"ID":"47efaf47-90f9-4fd9-a3ba-1312f99933cf","Type":"ContainerStarted","Data":"b0acb0d607ce4c562ae30a252e9bda5ca929d6eeed787726bff6fb54521a4022"} May 21 14:42:07.516572 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.516546 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:07.527767 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.527711 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"987bb94935589401bb501b47e4fcd9b2","Type":"ContainerStarted","Data":"fd3277ba0674dfd9f82d75056b163eef271ed62de182451de4f3b567727e5248"} May 21 14:42:07.725681 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.725603 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:42:07.894712 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.894672 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:07.894895 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:07.894738 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:07.894895 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.894842 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:07.894895 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.894890 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:09.894877294 +0000 UTC m=+5.147165002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:07.895220 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.895201 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:07.895294 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.895225 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:07.895294 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.895238 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:07.895294 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:07.895280 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:09.89526651 +0000 UTC m=+5.147554223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:08.304136 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:08.304090 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:37:06 +0000 UTC" deadline="2027-11-10 01:18:14.366595107 +0000 UTC" May 21 14:42:08.304136 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:08.304134 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12898h36m6.062466762s" May 21 14:42:08.401768 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:08.401560 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:08.401768 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:08.401733 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:09.399251 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:09.399215 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:09.399725 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.399363 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:09.916570 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:09.916531 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:09.916751 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:09.916602 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:09.916751 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916741 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:09.916858 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:13.916782822 +0000 UTC m=+9.169070536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:09.916929 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916892 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:09.916929 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916906 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:09.916929 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916918 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:09.917064 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:09.916952 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:13.916941322 +0000 UTC m=+9.169229033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:10.398784 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:10.398703 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:10.398958 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:10.398850 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:11.400908 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:11.400868 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:11.401377 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:11.400996 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:12.398898 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:12.398850 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:12.399101 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:12.399001 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:13.399567 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:13.399532 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:13.399989 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.399676 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:13.949761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:13.949724 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:13.949776 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949880 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949894 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949902 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949906 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:21.94993168 +0000 UTC m=+17.202219391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:13.950036 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:13.949972 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:21.949953061 +0000 UTC m=+17.202240791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:14.398223 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:14.398187 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:14.398478 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:14.398323 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:15.400114 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:15.399606 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:15.400114 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:15.399743 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:16.399200 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:16.399164 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:16.399419 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:16.399300 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:17.398417 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:17.398363 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:17.398859 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:17.398498 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:18.399106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:18.399072 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:18.399534 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:18.399186 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:19.399219 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:19.399188 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:19.399661 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:19.399313 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:20.398791 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:20.398715 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:20.398954 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:20.398831 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:21.398765 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:21.398732 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:21.399163 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:21.398862 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:22.009615 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:22.009691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009796 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009799 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009821 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009831 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009856 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:42:38.00983831 +0000 UTC m=+33.262126030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:22.010166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.009874 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:38.009862795 +0000 UTC m=+33.262150502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:22.398546 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:22.398509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:22.398726 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:22.398652 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:23.398547 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:23.398472 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:23.399027 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:23.398643 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:24.398630 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:24.398590 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:24.399080 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:24.398732 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:25.399280 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:25.399238 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:25.399714 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:25.399375 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:26.399207 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.399054 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:26.399323 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:26.399285 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:26.582179 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.582151 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:42:26.584199 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.584163 2563 generic.go:358] "Generic (PLEG): container finished" podID="939d2722-3419-4b4b-8397-ae904899918d" containerID="022883c58191534087cf97aa98ef13eb688174e9bebf05cc35972fff38768ef1" exitCode=1 May 21 14:42:26.584359 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.584253 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerDied","Data":"022883c58191534087cf97aa98ef13eb688174e9bebf05cc35972fff38768ef1"} May 21 14:42:26.584359 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.584285 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"bdfad12bf9d45ded5587b3e3d8d74a8db905e521eb62dc9cb9d820792ba0f679"} May 21 14:42:26.588391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.588364 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bgssk" event={"ID":"f0db5469-3445-4472-9256-c07dc80f8a57","Type":"ContainerStarted","Data":"e40f2668c5e2eb8cfa67aa30b59ca2ac3ece20bcc887644ded7788c2b635dad0"} May 21 14:42:26.591764 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.591739 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" event={"ID":"8d84741ee3eadebab7b094365b966a90","Type":"ContainerStarted","Data":"b4597b53811c9ad255f406be3a7b27dd790d0915a98ee25ed9ca007bcbc004e5"} May 21 14:42:26.596784 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.596390 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8psm" event={"ID":"47efaf47-90f9-4fd9-a3ba-1312f99933cf","Type":"ContainerStarted","Data":"ea4ccf859e776b629298ce5859f6076748d7cccbe470db26f3150c287211df26"} May 21 14:42:26.609649 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.609591 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bgssk" podStartSLOduration=1.831409248 podStartE2EDuration="21.609573725s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.645193113 +0000 UTC m=+1.897480821" lastFinishedPulling="2026-05-21 14:42:26.423357589 +0000 UTC m=+21.675645298" observedRunningTime="2026-05-21 14:42:26.609099689 +0000 UTC m=+21.861387419" watchObservedRunningTime="2026-05-21 14:42:26.609573725 +0000 UTC m=+21.861861457" May 21 14:42:26.624368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.623873 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" podStartSLOduration=21.623852594 podStartE2EDuration="21.623852594s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:42:26.623742578 +0000 UTC m=+21.876030308" watchObservedRunningTime="2026-05-21 14:42:26.623852594 +0000 UTC m=+21.876140324" May 21 14:42:26.642847 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:26.642729 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8psm" podStartSLOduration=2.180572031 podStartE2EDuration="21.642710527s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.61874002 +0000 UTC m=+1.871027727" lastFinishedPulling="2026-05-21 14:42:26.080878504 +0000 UTC m=+21.333166223" observedRunningTime="2026-05-21 14:42:26.642701291 +0000 UTC m=+21.894989022" watchObservedRunningTime="2026-05-21 14:42:26.642710527 +0000 UTC m=+21.894998258" May 21 14:42:27.398575 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.398501 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:27.398748 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:27.398641 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:27.600322 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.600283 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qnlv5" event={"ID":"52c496e7-e22f-42df-b946-676910070be7","Type":"ContainerStarted","Data":"42a3a77de19d6b3337c1f559f593e3ab2cefcc62ed79cbbafd0ffe361ebb3c87"} May 21 14:42:27.601804 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.601762 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mh292" event={"ID":"7c09078b-b130-49e3-8a4e-84cfa4a0e237","Type":"ContainerStarted","Data":"bbbab8fdcea5650949da0c1e7034c7f43820975ac6e691b73741f4543c818bf3"} May 21 14:42:27.603209 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.603185 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="ae47454556d88ab33e35b412760d7aeb919fbd47fbb96b9908976c057dc35bba" exitCode=0 May 21 14:42:27.603305 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.603260 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"ae47454556d88ab33e35b412760d7aeb919fbd47fbb96b9908976c057dc35bba"} May 21 14:42:27.606061 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.605984 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdnw9" event={"ID":"833ae58b-c7a7-4099-8423-7e17d5a312fa","Type":"ContainerStarted","Data":"2914d5d02063eabbe4fc17c50dff2257809d6be27e3ce1e0d7c24f1a0ed95d48"} May 21 14:42:27.607429 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.607406 2563 generic.go:358] "Generic (PLEG): container finished" podID="987bb94935589401bb501b47e4fcd9b2" containerID="11dfc802698348c1b4d9eb0e67a01d3cccce34d2f3d508b6a1caa9d4e96b52eb" exitCode=0 May 21 14:42:27.607525 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.607487 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"987bb94935589401bb501b47e4fcd9b2","Type":"ContainerDied","Data":"11dfc802698348c1b4d9eb0e67a01d3cccce34d2f3d508b6a1caa9d4e96b52eb"} May 21 14:42:27.609024 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.609001 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" event={"ID":"82f1dee0-af66-467e-a6d6-b2f2ea603ab3","Type":"ContainerStarted","Data":"7ca74f583f9201e687fda68ed2078f17cfb4ec8e1d1fc7a9b22525ee28d371bb"} May 21 14:42:27.611637 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.611623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:42:27.611920 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.611899 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"e23567dba271f7462d6176578187b6ff71f8a97467e4d925a1700cb4afe95976"} May 21 14:42:27.611992 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.611927 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"dfc9f68279f8b2a943f6b53249600cbb1afd6c1d330578339dda1a4783c05717"} May 21 14:42:27.611992 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.611941 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"032ecbbcf980fff3b6001cb75128b65d6243e2c629d2f98875460480f1b7d459"} May 21 14:42:27.611992 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.611953 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"294c03e16cd13df9394337b9f6ded41413556570662cf14ede855ee9b420fcb4"} May 21 14:42:27.616256 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.616222 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qnlv5" podStartSLOduration=3.3505274800000002 podStartE2EDuration="22.616212266s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.802525149 +0000 UTC m=+2.054812856" lastFinishedPulling="2026-05-21 14:42:26.068209935 +0000 UTC m=+21.320497642" observedRunningTime="2026-05-21 14:42:27.615989111 +0000 UTC m=+22.868276839" watchObservedRunningTime="2026-05-21 14:42:27.616212266 +0000 UTC m=+22.868499986" May 21 14:42:27.630624 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.630568 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-mh292" podStartSLOduration=3.172685583 podStartE2EDuration="22.630554331s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.621792022 +0000 UTC m=+1.874079729" lastFinishedPulling="2026-05-21 14:42:26.079660765 +0000 UTC m=+21.331948477" observedRunningTime="2026-05-21 14:42:27.629981647 +0000 UTC m=+22.882269376" watchObservedRunningTime="2026-05-21 14:42:27.630554331 +0000 UTC m=+22.882842060" May 21 14:42:27.676311 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.676204 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tdnw9" podStartSLOduration=3.242764491 podStartE2EDuration="22.676186476s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.63466631 +0000 UTC m=+1.886954017" lastFinishedPulling="2026-05-21 14:42:26.068088294 +0000 UTC m=+21.320376002" observedRunningTime="2026-05-21 14:42:27.663152828 +0000 UTC m=+22.915440558" watchObservedRunningTime="2026-05-21 14:42:27.676186476 +0000 UTC m=+22.928474207" May 21 14:42:27.928270 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:27.928178 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:42:28.337690 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.337571 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:42:27.9281991Z","UUID":"dd831e48-6124-44ee-9266-edd1d4d68f11","Handler":null,"Name":"","Endpoint":""} May 21 14:42:28.339378 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.339355 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:42:28.339528 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.339388 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:42:28.399131 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.399095 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:28.399297 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:28.399223 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:28.617268 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.617182 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmshz" event={"ID":"6b3dc4d1-5e3a-40a0-871e-47f3bbecb468","Type":"ContainerStarted","Data":"55fb057f03d6bee661bc910acc71408361c06ed54d2b7594dac68428085880cc"} May 21 14:42:28.619734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.619690 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"987bb94935589401bb501b47e4fcd9b2","Type":"ContainerStarted","Data":"fd658370effde5770bb841703e737093938acf15161b95bb5405cb2134d38b2f"} May 21 14:42:28.621554 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.621534 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" event={"ID":"82f1dee0-af66-467e-a6d6-b2f2ea603ab3","Type":"ContainerStarted","Data":"7aa412878c9568f6fd2dd5206508eb9a5c26409931dfee030e76a36a98778405"} May 21 14:42:28.634610 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.634546 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hmshz" podStartSLOduration=4.227040399 podStartE2EDuration="23.634522938s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.669294681 +0000 UTC m=+1.921582388" lastFinishedPulling="2026-05-21 14:42:26.076777212 +0000 UTC m=+21.329064927" observedRunningTime="2026-05-21 14:42:28.631421039 +0000 UTC m=+23.883708771" watchObservedRunningTime="2026-05-21 14:42:28.634522938 +0000 UTC m=+23.886810668" May 21 14:42:28.645606 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:28.645555 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" podStartSLOduration=23.645539846 podStartE2EDuration="23.645539846s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:42:28.64539328 +0000 UTC m=+23.897681009" watchObservedRunningTime="2026-05-21 14:42:28.645539846 +0000 UTC m=+23.897827574" May 21 14:42:29.399404 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:29.399149 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:29.399578 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:29.399512 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:29.625919 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:29.625878 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" event={"ID":"82f1dee0-af66-467e-a6d6-b2f2ea603ab3","Type":"ContainerStarted","Data":"ba2b0ea0a6fa53aad6ecb2049690322fa2aefd04fa29d4d7899bd17ab92ad361"} May 21 14:42:29.628934 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:29.628912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:42:29.629303 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:29.629266 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"5d6257d0b77e0915a68f80fa4110842fadebb4f43b5b2bcea2558882b7b40fe6"} May 21 14:42:29.645115 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:29.645065 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh95w" podStartSLOduration=2.434808504 podStartE2EDuration="24.645049338s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.893964469 +0000 UTC m=+2.146252191" lastFinishedPulling="2026-05-21 14:42:29.104205301 +0000 UTC m=+24.356493025" observedRunningTime="2026-05-21 14:42:29.644597964 +0000 UTC m=+24.896885714" watchObservedRunningTime="2026-05-21 14:42:29.645049338 +0000 UTC m=+24.897337067" May 21 14:42:30.398372 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:30.398315 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:30.398644 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:30.398477 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:31.399272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:31.399186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:31.399847 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:31.399298 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:31.817443 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:31.817199 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:31.818511 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:31.818223 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:32.398591 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.398559 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:32.398734 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:32.398667 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:32.637599 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.637569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:42:32.638312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.637918 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"15bfefde1c2820058d9149d4a429cd52b3ef9c2f8cb6ba522eb4de15e8a2ffc2"} May 21 14:42:32.638312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.638263 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:32.638525 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.638507 2563 scope.go:117] "RemoveContainer" containerID="022883c58191534087cf97aa98ef13eb688174e9bebf05cc35972fff38768ef1" May 21 14:42:32.639600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.639587 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="0673fc9c662b06324644311c861f07fb5531049791f08129442801fbd272afd3" exitCode=0 May 21 14:42:32.639702 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.639675 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"0673fc9c662b06324644311c861f07fb5531049791f08129442801fbd272afd3"} May 21 14:42:32.639895 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.639861 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:32.640441 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.640422 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qnlv5" May 21 14:42:32.658127 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:32.658104 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:33.305935 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.305902 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:33.398224 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.398196 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:33.398372 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:33.398350 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:33.643123 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.643031 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="1373b9ef29d6a72d41aebd284bcdc1f8231ab81d8934ec97e83fca795c4bfcef" exitCode=0 May 21 14:42:33.643123 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.643093 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"1373b9ef29d6a72d41aebd284bcdc1f8231ab81d8934ec97e83fca795c4bfcef"} May 21 14:42:33.649827 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.649807 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:42:33.650712 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.650687 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" event={"ID":"939d2722-3419-4b4b-8397-ae904899918d","Type":"ContainerStarted","Data":"238cc99857972be79ec79f0a104c56cb6dbe88477bd1399736270ea988f865bc"} May 21 14:42:33.650859 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.650837 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:33.667993 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.667957 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:42:33.688480 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.688432 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" podStartSLOduration=9.243502519 podStartE2EDuration="28.688417732s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.893098827 +0000 UTC m=+2.145386534" lastFinishedPulling="2026-05-21 14:42:26.338014038 +0000 UTC m=+21.590301747" observedRunningTime="2026-05-21 14:42:33.686856286 +0000 UTC m=+28.939144015" watchObservedRunningTime="2026-05-21 14:42:33.688417732 +0000 UTC m=+28.940705462" May 21 14:42:33.933135 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.932900 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pszw4"] May 21 14:42:33.933286 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.933186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:33.933378 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:33.933277 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:33.935882 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.935857 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nlsht"] May 21 14:42:33.935984 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:33.935964 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:33.936060 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:33.936043 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:34.654568 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:34.654534 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="aa00d6d6141230107271419d538f82040014266891797c2e656b004910fcd292" exitCode=0 May 21 14:42:34.654986 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:34.654619 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"aa00d6d6141230107271419d538f82040014266891797c2e656b004910fcd292"} May 21 14:42:35.401584 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:35.401554 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:35.401754 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:35.401555 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:35.401754 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:35.401662 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:35.401754 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:35.401721 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:37.398483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:37.398449 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:37.399224 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:37.398502 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:37.399224 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:37.398574 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pszw4" podUID="70ac9cf7-e7b9-4672-9925-729053b83815" May 21 14:42:37.399224 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:37.398697 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nlsht" podUID="13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef" May 21 14:42:38.023254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:38.023214 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:38.023442 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:38.023275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:38.023442 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023401 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:38.023442 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023402 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:42:38.023442 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023429 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:42:38.023442 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023440 2563 projected.go:194] Error preparing data for projected volume kube-api-access-fc7fj for pod openshift-network-diagnostics/network-check-target-pszw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:38.023598 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023464 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:43:10.023449928 +0000 UTC m=+65.275737636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:42:38.023598 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:38.023489 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj podName:70ac9cf7-e7b9-4672-9925-729053b83815 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:10.023476648 +0000 UTC m=+65.275764355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc7fj" (UniqueName: "kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj") pod "network-check-target-pszw4" (UID: "70ac9cf7-e7b9-4672-9925-729053b83815") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:42:39.053399 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.053369 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeReady" May 21 14:42:39.053963 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.053564 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:42:39.095787 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.095696 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jbphl"] May 21 14:42:39.125752 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.125712 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xst9j"] May 21 14:42:39.125912 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.125877 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.128546 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.128523 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:42:39.128671 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.128524 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:42:39.128671 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.128616 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2mh\"" May 21 14:42:39.139673 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.139648 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jbphl"] May 21 14:42:39.139784 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.139678 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xst9j"] May 21 14:42:39.139871 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.139788 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.142171 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.142152 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t9nbd\"" May 21 14:42:39.142503 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.142482 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:42:39.142616 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.142571 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:42:39.142616 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.142571 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:42:39.232876 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.232837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5p5l\" (UniqueName: \"kubernetes.io/projected/d1735115-cc89-40bb-add6-5ea39ebe1f72-kube-api-access-t5p5l\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.233075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.232887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1735115-cc89-40bb-add6-5ea39ebe1f72-config-volume\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.233075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.232913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tpv\" (UniqueName: \"kubernetes.io/projected/86fd6b66-c53d-4f89-b12b-1d314909a952-kube-api-access-s4tpv\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.233075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.232939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.233075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.232988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1735115-cc89-40bb-add6-5ea39ebe1f72-tmp-dir\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.233075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.233038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.333482 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333440 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5p5l\" (UniqueName: \"kubernetes.io/projected/d1735115-cc89-40bb-add6-5ea39ebe1f72-kube-api-access-t5p5l\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.333658 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333507 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1735115-cc89-40bb-add6-5ea39ebe1f72-config-volume\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.333722 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333684 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tpv\" (UniqueName: \"kubernetes.io/projected/86fd6b66-c53d-4f89-b12b-1d314909a952-kube-api-access-s4tpv\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.333775 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333733 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.333825 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1735115-cc89-40bb-add6-5ea39ebe1f72-tmp-dir\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.333881 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.333834 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.333968 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.333949 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:39.334039 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.334026 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:39.834005028 +0000 UTC m=+35.086292743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:39.334205 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.334181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1735115-cc89-40bb-add6-5ea39ebe1f72-config-volume\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.334205 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.333958 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:39.334425 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.334265 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:39.8342485 +0000 UTC m=+35.086536212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:42:39.344312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.344158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5p5l\" (UniqueName: \"kubernetes.io/projected/d1735115-cc89-40bb-add6-5ea39ebe1f72-kube-api-access-t5p5l\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.344465 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.344344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tpv\" (UniqueName: \"kubernetes.io/projected/86fd6b66-c53d-4f89-b12b-1d314909a952-kube-api-access-s4tpv\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.346055 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.346002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1735115-cc89-40bb-add6-5ea39ebe1f72-tmp-dir\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.398267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.398232 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:42:39.398481 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.398240 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:42:39.401419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.401146 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:42:39.401419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.401213 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:42:39.401419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.401214 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n8k7m\"" May 21 14:42:39.401419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.401239 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brsnp\"" May 21 14:42:39.401419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.401220 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:42:39.838559 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.838523 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:39.838725 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:39.838585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:39.838725 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.838692 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:39.838725 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.838707 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:39.838860 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.838759 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:40.838742644 +0000 UTC m=+36.091030350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:42:39.838860 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:39.838782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:40.838770763 +0000 UTC m=+36.091058469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:40.671041 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:40.671004 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerStarted","Data":"26203b099c7a9883ceb0e8436d1b430a7cdf2753dbd3bdf18de8915bab9e3fb1"} May 21 14:42:40.845625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:40.845584 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:40.845810 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:40.845670 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:40.845810 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:40.845736 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:40.845810 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:40.845783 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:40.845810 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:40.845801 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:42.845786427 +0000 UTC m=+38.098074134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:42:40.845969 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:40.845831 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:42.845816667 +0000 UTC m=+38.098104378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:41.678579 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:41.678545 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="26203b099c7a9883ceb0e8436d1b430a7cdf2753dbd3bdf18de8915bab9e3fb1" exitCode=0 May 21 14:42:41.678934 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:41.678611 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"26203b099c7a9883ceb0e8436d1b430a7cdf2753dbd3bdf18de8915bab9e3fb1"} May 21 14:42:42.683665 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:42.683633 2563 generic.go:358] "Generic (PLEG): container finished" podID="d080bedb-39b4-456e-ab98-c731bf783e8a" containerID="55e40955575ff901924ec6c6fe896a03b30bef5fa901c9d38403a2576fd095e9" exitCode=0 May 21 14:42:42.684024 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:42.683696 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerDied","Data":"55e40955575ff901924ec6c6fe896a03b30bef5fa901c9d38403a2576fd095e9"} May 21 14:42:42.859521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:42.859481 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:42.859676 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:42.859538 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:42.859676 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:42.859637 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:42.859676 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:42.859633 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:42.859770 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:42.859700 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:46.859686161 +0000 UTC m=+42.111973868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:42:42.859770 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:42.859713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:46.859707454 +0000 UTC m=+42.111995160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:43.688580 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:43.688503 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-brdn9" event={"ID":"d080bedb-39b4-456e-ab98-c731bf783e8a","Type":"ContainerStarted","Data":"56f132c22577d00b983f52365a4bbc4c01ff2b44e5dd342816825df31eef948b"} May 21 14:42:43.711201 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:43.710687 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-brdn9" podStartSLOduration=5.167876938 podStartE2EDuration="38.710669414s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:42:06.960897504 +0000 UTC m=+2.213185212" lastFinishedPulling="2026-05-21 14:42:40.503689966 +0000 UTC m=+35.755977688" observedRunningTime="2026-05-21 14:42:43.709035965 +0000 UTC m=+38.961323695" watchObservedRunningTime="2026-05-21 14:42:43.710669414 +0000 UTC m=+38.962957144" May 21 14:42:46.888097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:46.888054 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:46.888584 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:46.888122 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:46.888584 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:46.888200 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:46.888584 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:46.888213 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:46.888584 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:46.888260 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:54.888246549 +0000 UTC m=+50.140534269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:46.888584 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:46.888272 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:42:54.888265878 +0000 UTC m=+50.140553585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:42:54.940874 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:54.940828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:42:54.941363 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:42:54.940894 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:42:54.941363 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:54.940983 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:42:54.941363 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:54.940988 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:42:54.941363 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:54.941037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:10.941022745 +0000 UTC m=+66.193310453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:42:54.941363 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:42:54.941050 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:10.94104467 +0000 UTC m=+66.193332377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:43:05.668696 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:05.668669 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hb8kt" May 21 14:43:10.043454 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.043410 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:43:10.043843 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.043467 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:43:10.046262 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.046246 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:43:10.046322 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.046260 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:43:10.053623 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.053605 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:43:10.053689 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.053665 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs podName:13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef nodeName:}" failed. No retries permitted until 2026-05-21 14:44:14.053647894 +0000 UTC m=+129.305935601 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs") pod "network-metrics-daemon-nlsht" (UID: "13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef") : secret "metrics-daemon-secret" not found May 21 14:43:10.055929 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.055908 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:43:10.068323 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.068303 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7fj\" (UniqueName: \"kubernetes.io/projected/70ac9cf7-e7b9-4672-9925-729053b83815-kube-api-access-fc7fj\") pod \"network-check-target-pszw4\" (UID: \"70ac9cf7-e7b9-4672-9925-729053b83815\") " pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:43:10.312688 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.312591 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n8k7m\"" May 21 14:43:10.320804 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.320777 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:43:10.476190 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.476159 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pszw4"] May 21 14:43:10.479363 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:10.479315 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ac9cf7_e7b9_4672_9925_729053b83815.slice/crio-eab66b24d6409f3b3fe19991ac2b36a7d8564d13f263acdb7af2cc9cf1b4cb23 WatchSource:0}: Error finding container eab66b24d6409f3b3fe19991ac2b36a7d8564d13f263acdb7af2cc9cf1b4cb23: Status 404 returned error can't find the container with id eab66b24d6409f3b3fe19991ac2b36a7d8564d13f263acdb7af2cc9cf1b4cb23 May 21 14:43:10.736301 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.736209 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pszw4" event={"ID":"70ac9cf7-e7b9-4672-9925-729053b83815","Type":"ContainerStarted","Data":"eab66b24d6409f3b3fe19991ac2b36a7d8564d13f263acdb7af2cc9cf1b4cb23"} May 21 14:43:10.951396 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.951363 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:43:10.951600 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:10.951414 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:43:10.951600 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.951472 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:43:10.951600 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.951503 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:43:10.951600 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.951537 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:42.951521518 +0000 UTC m=+98.203809225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:43:10.951600 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:10.951555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:42.9515435 +0000 UTC m=+98.203831207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:43:13.743320 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:13.743282 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pszw4" event={"ID":"70ac9cf7-e7b9-4672-9925-729053b83815","Type":"ContainerStarted","Data":"718d67383724b8c16922a475e8ccf3567b0bfdb6663adf8dc5f1c7b5d993650e"} May 21 14:43:13.743742 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:13.743431 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:43:13.758619 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:13.758570 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pszw4" podStartSLOduration=65.958072425 podStartE2EDuration="1m8.758556612s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:43:10.481155057 +0000 UTC m=+65.733442766" lastFinishedPulling="2026-05-21 14:43:13.281639244 +0000 UTC m=+68.533926953" observedRunningTime="2026-05-21 14:43:13.757633406 +0000 UTC m=+69.009921138" watchObservedRunningTime="2026-05-21 14:43:13.758556612 +0000 UTC m=+69.010844410" May 21 14:43:25.668414 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.668378 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv"] May 21 14:43:25.670390 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.670360 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.675622 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.675520 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 14:43:25.675622 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.675523 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jv75v\"" May 21 14:43:25.675622 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.675580 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 14:43:25.675622 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.675601 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:43:25.675967 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.675605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:43:25.678901 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.678880 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv"] May 21 14:43:25.746267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.746227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.746489 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.746275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2f4\" (UniqueName: \"kubernetes.io/projected/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-kube-api-access-xf2f4\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.746489 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.746373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.766509 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.766468 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zgjn8"] May 21 14:43:25.768117 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.768101 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.770528 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.770509 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 14:43:25.770667 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.770647 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:43:25.770829 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.770809 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 14:43:25.770897 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.770830 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c5nlr\"" May 21 14:43:25.771620 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.771492 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:43:25.777532 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.777510 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zgjn8"] May 21 14:43:25.778662 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.778645 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 14:43:25.846737 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846704 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.846914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.846914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846799 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.846914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-snapshots\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.846914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2f4\" (UniqueName: \"kubernetes.io/projected/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-kube-api-access-xf2f4\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.846914 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:25.846896 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:25.847134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.847134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.846958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-tmp\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.847134 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:25.846981 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:26.346958406 +0000 UTC m=+81.599246126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:25.847134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.847057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzm6l\" (UniqueName: \"kubernetes.io/projected/d059a681-c970-464e-8581-8cb82a02b74a-kube-api-access-gzm6l\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.847305 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.847157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d059a681-c970-464e-8581-8cb82a02b74a-serving-cert\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.847469 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.847453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.858702 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.858675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2f4\" (UniqueName: \"kubernetes.io/projected/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-kube-api-access-xf2f4\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:25.948187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948093 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948143 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-snapshots\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948165 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948186 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-tmp\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948508 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948201 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzm6l\" (UniqueName: \"kubernetes.io/projected/d059a681-c970-464e-8581-8cb82a02b74a-kube-api-access-gzm6l\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948508 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948230 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d059a681-c970-464e-8581-8cb82a02b74a-serving-cert\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948832 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-tmp\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948905 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948827 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.948905 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.948839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d059a681-c970-464e-8581-8cb82a02b74a-snapshots\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.949026 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.949011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d059a681-c970-464e-8581-8cb82a02b74a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.950690 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.950671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d059a681-c970-464e-8581-8cb82a02b74a-serving-cert\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:25.956208 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:25.956187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzm6l\" (UniqueName: \"kubernetes.io/projected/d059a681-c970-464e-8581-8cb82a02b74a-kube-api-access-gzm6l\") pod \"insights-operator-78bdfb888c-zgjn8\" (UID: \"d059a681-c970-464e-8581-8cb82a02b74a\") " pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:26.078573 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:26.078519 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" May 21 14:43:26.200109 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:26.200031 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zgjn8"] May 21 14:43:26.203701 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:26.203674 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd059a681_c970_464e_8581_8cb82a02b74a.slice/crio-f0da0138bb2808fd575763282854b5073f0373f2763944a2d9acae4587344521 WatchSource:0}: Error finding container f0da0138bb2808fd575763282854b5073f0373f2763944a2d9acae4587344521: Status 404 returned error can't find the container with id f0da0138bb2808fd575763282854b5073f0373f2763944a2d9acae4587344521 May 21 14:43:26.352744 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:26.352705 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:26.352909 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:26.352813 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:26.352909 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:26.352879 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:27.352864842 +0000 UTC m=+82.605152548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:26.769848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:26.769807 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" event={"ID":"d059a681-c970-464e-8581-8cb82a02b74a","Type":"ContainerStarted","Data":"f0da0138bb2808fd575763282854b5073f0373f2763944a2d9acae4587344521"} May 21 14:43:27.360091 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:27.360040 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:27.360271 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:27.360192 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:27.360271 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:27.360269 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:29.360251867 +0000 UTC m=+84.612539574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:28.774367 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:28.774269 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" event={"ID":"d059a681-c970-464e-8581-8cb82a02b74a","Type":"ContainerStarted","Data":"cd67bb3c06db6086f7d748a87532c2ddc4b959da194f5a5956965b8d51a2de25"} May 21 14:43:28.791222 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:28.791164 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" podStartSLOduration=1.615478226 podStartE2EDuration="3.791150241s" podCreationTimestamp="2026-05-21 14:43:25 +0000 UTC" firstStartedPulling="2026-05-21 14:43:26.205351562 +0000 UTC m=+81.457639272" lastFinishedPulling="2026-05-21 14:43:28.381023579 +0000 UTC m=+83.633311287" observedRunningTime="2026-05-21 14:43:28.789110036 +0000 UTC m=+84.041397765" watchObservedRunningTime="2026-05-21 14:43:28.791150241 +0000 UTC m=+84.043437970" May 21 14:43:29.375299 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:29.375255 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:29.375491 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:29.375422 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:29.375529 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:29.375505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:33.375484192 +0000 UTC m=+88.627771899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:31.922673 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:31.922643 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mh292_7c09078b-b130-49e3-8a4e-84cfa4a0e237/dns-node-resolver/0.log" May 21 14:43:32.723277 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:32.723247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdnw9_833ae58b-c7a7-4099-8423-7e17d5a312fa/node-ca/0.log" May 21 14:43:33.400654 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.400623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:33.401065 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:33.400765 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:33.401065 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:33.400843 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:41.400824811 +0000 UTC m=+96.653112518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:33.585413 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.585373 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8"] May 21 14:43:33.589527 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.589501 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:33.591951 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.591923 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 14:43:33.591951 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.591935 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 14:43:33.593088 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.593073 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fr9f5\"" May 21 14:43:33.593088 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.593081 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 14:43:33.597416 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.597391 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8"] May 21 14:43:33.602266 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.602246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:33.602386 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.602276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqnf\" (UniqueName: \"kubernetes.io/projected/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-kube-api-access-qsqnf\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:33.703254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.703157 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:33.703254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.703246 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqnf\" (UniqueName: \"kubernetes.io/projected/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-kube-api-access-qsqnf\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:33.703516 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:33.703298 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:43:33.703516 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:33.703391 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls podName:3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d nodeName:}" failed. No retries permitted until 2026-05-21 14:43:34.203376129 +0000 UTC m=+89.455663835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls") pod "cluster-samples-operator-697587599-srkq8" (UID: "3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d") : secret "samples-operator-tls" not found May 21 14:43:33.712219 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:33.712184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqnf\" (UniqueName: \"kubernetes.io/projected/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-kube-api-access-qsqnf\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:34.206606 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:34.206557 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:34.206783 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:34.206682 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:43:34.206783 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:34.206748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls podName:3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d nodeName:}" failed. No retries permitted until 2026-05-21 14:43:35.206732823 +0000 UTC m=+90.459020530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls") pod "cluster-samples-operator-697587599-srkq8" (UID: "3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d") : secret "samples-operator-tls" not found May 21 14:43:35.214304 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.214242 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:35.214729 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:35.214440 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:43:35.214729 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:35.214532 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls podName:3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d nodeName:}" failed. No retries permitted until 2026-05-21 14:43:37.214507564 +0000 UTC m=+92.466795272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls") pod "cluster-samples-operator-697587599-srkq8" (UID: "3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d") : secret "samples-operator-tls" not found May 21 14:43:35.688882 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.688845 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74"] May 21 14:43:35.691599 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.691581 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.694242 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.694214 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 14:43:35.694242 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.694229 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 14:43:35.694242 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.694238 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6qz9q\"" May 21 14:43:35.694478 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.694214 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 14:43:35.695419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.695401 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 14:43:35.699040 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.698776 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74"] May 21 14:43:35.718850 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.718810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjqb\" (UniqueName: \"kubernetes.io/projected/7fde25a0-9f67-4a31-9753-0141d547989c-kube-api-access-4kjqb\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.718850 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.718855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fde25a0-9f67-4a31-9753-0141d547989c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.719081 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.718885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fde25a0-9f67-4a31-9753-0141d547989c-config\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.819861 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.819815 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjqb\" (UniqueName: \"kubernetes.io/projected/7fde25a0-9f67-4a31-9753-0141d547989c-kube-api-access-4kjqb\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.820058 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.819870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fde25a0-9f67-4a31-9753-0141d547989c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.820058 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.819901 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fde25a0-9f67-4a31-9753-0141d547989c-config\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.820492 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.820468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fde25a0-9f67-4a31-9753-0141d547989c-config\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.822344 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.822317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fde25a0-9f67-4a31-9753-0141d547989c-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:35.828317 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:35.828292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjqb\" (UniqueName: \"kubernetes.io/projected/7fde25a0-9f67-4a31-9753-0141d547989c-kube-api-access-4kjqb\") pod \"kube-storage-version-migrator-operator-565644f49-wkr74\" (UID: \"7fde25a0-9f67-4a31-9753-0141d547989c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:36.001283 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:36.001178 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" May 21 14:43:36.122607 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:36.122574 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74"] May 21 14:43:36.125725 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:36.125695 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fde25a0_9f67_4a31_9753_0141d547989c.slice/crio-c6fee51cc8ec12bf918af1c43c51e1dbafcb61ed213f5df34cf4b7d09ff89d71 WatchSource:0}: Error finding container c6fee51cc8ec12bf918af1c43c51e1dbafcb61ed213f5df34cf4b7d09ff89d71: Status 404 returned error can't find the container with id c6fee51cc8ec12bf918af1c43c51e1dbafcb61ed213f5df34cf4b7d09ff89d71 May 21 14:43:36.792179 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:36.792143 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" event={"ID":"7fde25a0-9f67-4a31-9753-0141d547989c","Type":"ContainerStarted","Data":"c6fee51cc8ec12bf918af1c43c51e1dbafcb61ed213f5df34cf4b7d09ff89d71"} May 21 14:43:37.232626 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:37.232588 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:37.232818 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:37.232780 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:43:37.232883 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:37.232852 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls podName:3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d nodeName:}" failed. No retries permitted until 2026-05-21 14:43:41.232831329 +0000 UTC m=+96.485119053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls") pod "cluster-samples-operator-697587599-srkq8" (UID: "3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d") : secret "samples-operator-tls" not found May 21 14:43:38.085358 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.085294 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:43:38.089703 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.089675 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.094124 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.094099 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:43:38.094283 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.094209 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:43:38.094368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.094354 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nhhn2\"" May 21 14:43:38.094566 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.094546 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:43:38.099822 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.099801 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:43:38.101574 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.101554 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:43:38.144291 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144291 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144564 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fs8\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144564 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144564 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144564 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144753 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.144753 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.144637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245056 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245024 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245071 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245102 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245169 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245127 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42fs8\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245360 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245360 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245247 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245360 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245278 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245360 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245300 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245564 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.245447 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:38.245564 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.245468 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4: secret "image-registry-tls" not found May 21 14:43:38.245564 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.245544 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls podName:362e7f07-ba61-4b18-b903-51fb02bb5c65 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:38.745519745 +0000 UTC m=+93.997807469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls") pod "image-registry-5cb8f8f6d4-n6dc4" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65") : secret "image-registry-tls" not found May 21 14:43:38.245842 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.245920 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.245853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.246063 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.246043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.248306 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.248274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.248409 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.248307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.253535 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.253511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fs8\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.253736 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.253716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.749129 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.749083 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:38.749366 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.749243 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:38.749366 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.749265 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4: secret "image-registry-tls" not found May 21 14:43:38.749366 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:38.749326 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls podName:362e7f07-ba61-4b18-b903-51fb02bb5c65 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:39.749310566 +0000 UTC m=+95.001598278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls") pod "image-registry-5cb8f8f6d4-n6dc4" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65") : secret "image-registry-tls" not found May 21 14:43:38.798143 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.798109 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" event={"ID":"7fde25a0-9f67-4a31-9753-0141d547989c","Type":"ContainerStarted","Data":"aa1ed018ad9f529ea644ce26b63628c3ba78ec2a884916f337a4960ec5988fa7"} May 21 14:43:38.812243 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:38.812192 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" podStartSLOduration=1.724173166 podStartE2EDuration="3.812176337s" podCreationTimestamp="2026-05-21 14:43:35 +0000 UTC" firstStartedPulling="2026-05-21 14:43:36.127559873 +0000 UTC m=+91.379847580" lastFinishedPulling="2026-05-21 14:43:38.215563045 +0000 UTC m=+93.467850751" observedRunningTime="2026-05-21 14:43:38.811645562 +0000 UTC m=+94.063933305" watchObservedRunningTime="2026-05-21 14:43:38.812176337 +0000 UTC m=+94.064464066" May 21 14:43:39.757089 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.757052 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:39.757476 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:39.757159 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:39.757476 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:39.757172 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4: secret "image-registry-tls" not found May 21 14:43:39.757476 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:39.757219 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls podName:362e7f07-ba61-4b18-b903-51fb02bb5c65 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:41.757204587 +0000 UTC m=+97.009492293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls") pod "image-registry-5cb8f8f6d4-n6dc4" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65") : secret "image-registry-tls" not found May 21 14:43:39.990878 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.990836 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc"] May 21 14:43:39.994715 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.994695 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" May 21 14:43:39.997318 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.997283 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 14:43:39.997318 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.997297 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 14:43:39.998543 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:39.998512 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ct472\"" May 21 14:43:40.005007 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.004982 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc"] May 21 14:43:40.059515 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.059468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tj9r\" (UniqueName: \"kubernetes.io/projected/21cd1ed4-8100-40df-9a73-b64b1cd59156-kube-api-access-8tj9r\") pod \"migrator-b985f5d89-wjcmc\" (UID: \"21cd1ed4-8100-40df-9a73-b64b1cd59156\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" May 21 14:43:40.159989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.159939 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tj9r\" (UniqueName: \"kubernetes.io/projected/21cd1ed4-8100-40df-9a73-b64b1cd59156-kube-api-access-8tj9r\") pod \"migrator-b985f5d89-wjcmc\" (UID: \"21cd1ed4-8100-40df-9a73-b64b1cd59156\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" May 21 14:43:40.168674 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.168648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tj9r\" (UniqueName: \"kubernetes.io/projected/21cd1ed4-8100-40df-9a73-b64b1cd59156-kube-api-access-8tj9r\") pod \"migrator-b985f5d89-wjcmc\" (UID: \"21cd1ed4-8100-40df-9a73-b64b1cd59156\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" May 21 14:43:40.303862 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.303819 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" May 21 14:43:40.432810 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.432777 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc"] May 21 14:43:40.435775 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:40.435748 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cd1ed4_8100_40df_9a73_b64b1cd59156.slice/crio-757223520f92212a2cb63cc13a2f09b2c3b0e365e61fb2c01a4fd064d97c5e88 WatchSource:0}: Error finding container 757223520f92212a2cb63cc13a2f09b2c3b0e365e61fb2c01a4fd064d97c5e88: Status 404 returned error can't find the container with id 757223520f92212a2cb63cc13a2f09b2c3b0e365e61fb2c01a4fd064d97c5e88 May 21 14:43:40.803179 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:40.803134 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" event={"ID":"21cd1ed4-8100-40df-9a73-b64b1cd59156","Type":"ContainerStarted","Data":"757223520f92212a2cb63cc13a2f09b2c3b0e365e61fb2c01a4fd064d97c5e88"} May 21 14:43:41.270936 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:41.270844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:41.271092 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.271031 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:43:41.271144 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.271117 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls podName:3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d nodeName:}" failed. No retries permitted until 2026-05-21 14:43:49.271099989 +0000 UTC m=+104.523387700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls") pod "cluster-samples-operator-697587599-srkq8" (UID: "3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d") : secret "samples-operator-tls" not found May 21 14:43:41.473223 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:41.473175 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:41.473433 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.473390 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:43:41.473490 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.473475 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls podName:7ec6cc99-0af7-44e8-81dd-2f8204d6a73f nodeName:}" failed. No retries permitted until 2026-05-21 14:43:57.473455052 +0000 UTC m=+112.725742764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-czzsv" (UID: "7ec6cc99-0af7-44e8-81dd-2f8204d6a73f") : secret "cluster-monitoring-operator-tls" not found May 21 14:43:41.775990 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:41.775945 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:41.776172 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.776042 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:41.776172 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.776063 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4: secret "image-registry-tls" not found May 21 14:43:41.776172 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:41.776125 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls podName:362e7f07-ba61-4b18-b903-51fb02bb5c65 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:45.77610604 +0000 UTC m=+101.028393766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls") pod "image-registry-5cb8f8f6d4-n6dc4" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65") : secret "image-registry-tls" not found May 21 14:43:42.809230 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:42.809193 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" event={"ID":"21cd1ed4-8100-40df-9a73-b64b1cd59156","Type":"ContainerStarted","Data":"7f745fdc10a39df00b854b9f6dbd1923a4021cd41f1db498f44a558d1d787508"} May 21 14:43:42.809230 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:42.809231 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" event={"ID":"21cd1ed4-8100-40df-9a73-b64b1cd59156","Type":"ContainerStarted","Data":"d4bc3136f5394a6ae3ce73a82149a0a65ed778b0ead967953cefd3b1cbe47451"} May 21 14:43:42.826394 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:42.826323 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wjcmc" podStartSLOduration=2.33858595 podStartE2EDuration="3.826308101s" podCreationTimestamp="2026-05-21 14:43:39 +0000 UTC" firstStartedPulling="2026-05-21 14:43:40.437691215 +0000 UTC m=+95.689978921" lastFinishedPulling="2026-05-21 14:43:41.925413357 +0000 UTC m=+97.177701072" observedRunningTime="2026-05-21 14:43:42.82513787 +0000 UTC m=+98.077425613" watchObservedRunningTime="2026-05-21 14:43:42.826308101 +0000 UTC m=+98.078595829" May 21 14:43:42.985294 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:42.985241 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:43:42.985510 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:42.985364 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:43:42.985510 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:42.985442 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:43:42.985510 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:42.985456 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:43:42.985510 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:42.985512 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert podName:86fd6b66-c53d-4f89-b12b-1d314909a952 nodeName:}" failed. No retries permitted until 2026-05-21 14:44:46.98549738 +0000 UTC m=+162.237785086 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert") pod "ingress-canary-xst9j" (UID: "86fd6b66-c53d-4f89-b12b-1d314909a952") : secret "canary-serving-cert" not found May 21 14:43:42.985717 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:42.985524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls podName:d1735115-cc89-40bb-add6-5ea39ebe1f72 nodeName:}" failed. No retries permitted until 2026-05-21 14:44:46.985518161 +0000 UTC m=+162.237805868 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls") pod "dns-default-jbphl" (UID: "d1735115-cc89-40bb-add6-5ea39ebe1f72") : secret "dns-default-metrics-tls" not found May 21 14:43:44.747468 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:44.747438 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pszw4" May 21 14:43:45.810122 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:45.810056 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:45.810566 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:45.810216 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:43:45.810566 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:45.810234 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4: secret "image-registry-tls" not found May 21 14:43:45.810566 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:43:45.810290 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls podName:362e7f07-ba61-4b18-b903-51fb02bb5c65 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:53.810273934 +0000 UTC m=+109.062561646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls") pod "image-registry-5cb8f8f6d4-n6dc4" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65") : secret "image-registry-tls" not found May 21 14:43:49.337682 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:49.337636 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:49.340187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:49.340164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d-samples-operator-tls\") pod \"cluster-samples-operator-697587599-srkq8\" (UID: \"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:49.498371 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:49.498288 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" May 21 14:43:49.622584 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:49.622491 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8"] May 21 14:43:49.826061 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:49.826014 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" event={"ID":"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d","Type":"ContainerStarted","Data":"63759a5eb65109ed00db40cf8c9e6a6346a7639a298c02d8e56c1a7fd53b1be0"} May 21 14:43:51.832507 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:51.832469 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" event={"ID":"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d","Type":"ContainerStarted","Data":"34fba0c4a8ff0384369cc111f62ee46565f15b8b588caf50c81553c32b91f04e"} May 21 14:43:51.832507 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:51.832504 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" event={"ID":"3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d","Type":"ContainerStarted","Data":"6fee30131eab948bf1201204a86348e65b8f71fa73a34e27dadfa7606f449ac5"} May 21 14:43:51.851990 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:51.851941 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-srkq8" podStartSLOduration=17.142735054 podStartE2EDuration="18.851926094s" podCreationTimestamp="2026-05-21 14:43:33 +0000 UTC" firstStartedPulling="2026-05-21 14:43:49.667369839 +0000 UTC m=+104.919657545" lastFinishedPulling="2026-05-21 14:43:51.376560857 +0000 UTC m=+106.628848585" observedRunningTime="2026-05-21 14:43:51.850655959 +0000 UTC m=+107.102943690" watchObservedRunningTime="2026-05-21 14:43:51.851926094 +0000 UTC m=+107.104213822" May 21 14:43:53.874698 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:53.874659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:53.877161 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:53.877139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"image-registry-5cb8f8f6d4-n6dc4\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:54.002552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.002492 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:54.131998 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.131926 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:43:54.134557 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:54.134522 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362e7f07_ba61_4b18_b903_51fb02bb5c65.slice/crio-b3015fa839f68aa71fc3da59d471405ac098acf73e4ce8d5f23c6d5ef2612eff WatchSource:0}: Error finding container b3015fa839f68aa71fc3da59d471405ac098acf73e4ce8d5f23c6d5ef2612eff: Status 404 returned error can't find the container with id b3015fa839f68aa71fc3da59d471405ac098acf73e4ce8d5f23c6d5ef2612eff May 21 14:43:54.840161 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.840112 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" event={"ID":"362e7f07-ba61-4b18-b903-51fb02bb5c65","Type":"ContainerStarted","Data":"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703"} May 21 14:43:54.840161 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.840156 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" event={"ID":"362e7f07-ba61-4b18-b903-51fb02bb5c65","Type":"ContainerStarted","Data":"b3015fa839f68aa71fc3da59d471405ac098acf73e4ce8d5f23c6d5ef2612eff"} May 21 14:43:54.840417 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.840257 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:43:54.863806 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:54.863748 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" podStartSLOduration=16.863732436 podStartE2EDuration="16.863732436s" podCreationTimestamp="2026-05-21 14:43:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:43:54.863636205 +0000 UTC m=+110.115923934" watchObservedRunningTime="2026-05-21 14:43:54.863732436 +0000 UTC m=+110.116020164" May 21 14:43:57.505863 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:57.505822 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:57.508393 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:57.508367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec6cc99-0af7-44e8-81dd-2f8204d6a73f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-czzsv\" (UID: \"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:57.779168 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:57.779088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" May 21 14:43:57.903488 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:57.903450 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv"] May 21 14:43:57.906184 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:43:57.906154 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec6cc99_0af7_44e8_81dd_2f8204d6a73f.slice/crio-42baedff70a48549abb246c7aa09cd315f7e29cf78796c4125469f0f0f87769e WatchSource:0}: Error finding container 42baedff70a48549abb246c7aa09cd315f7e29cf78796c4125469f0f0f87769e: Status 404 returned error can't find the container with id 42baedff70a48549abb246c7aa09cd315f7e29cf78796c4125469f0f0f87769e May 21 14:43:58.853558 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:43:58.853524 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" event={"ID":"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f","Type":"ContainerStarted","Data":"42baedff70a48549abb246c7aa09cd315f7e29cf78796c4125469f0f0f87769e"} May 21 14:44:00.210022 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.209946 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:44:00.266181 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.266149 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zzmjv"] May 21 14:44:00.271540 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.271506 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.274510 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.274484 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:44:00.274510 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.274499 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:44:00.274717 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.274567 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z8tpz\"" May 21 14:44:00.282267 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.282242 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzmjv"] May 21 14:44:00.433457 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.433417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlvzq\" (UniqueName: \"kubernetes.io/projected/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-api-access-tlvzq\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.433457 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.433454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0285a5f0-a8ed-496a-8729-d8b30f2da432-data-volume\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.433678 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.433476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0285a5f0-a8ed-496a-8729-d8b30f2da432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.433678 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.433505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.433678 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.433571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0285a5f0-a8ed-496a-8729-d8b30f2da432-crio-socket\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.450466 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.450434 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr"] May 21 14:44:00.453495 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.453479 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:00.455945 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.455912 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 14:44:00.456075 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.456044 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-trgw6\"" May 21 14:44:00.464321 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.464257 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr"] May 21 14:44:00.534897 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.534850 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlvzq\" (UniqueName: \"kubernetes.io/projected/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-api-access-tlvzq\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.534910 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0285a5f0-a8ed-496a-8729-d8b30f2da432-data-volume\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.534940 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0285a5f0-a8ed-496a-8729-d8b30f2da432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.534995 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.535020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0285a5f0-a8ed-496a-8729-d8b30f2da432-crio-socket\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.535062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96eb23f6-9333-48a7-b7ea-e237904bca17-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr\" (UID: \"96eb23f6-9333-48a7-b7ea-e237904bca17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:00.535397 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.535139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0285a5f0-a8ed-496a-8729-d8b30f2da432-crio-socket\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535397 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.535308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0285a5f0-a8ed-496a-8729-d8b30f2da432-data-volume\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.535764 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.535744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.537508 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.537483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0285a5f0-a8ed-496a-8729-d8b30f2da432-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.543381 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.543363 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlvzq\" (UniqueName: \"kubernetes.io/projected/0285a5f0-a8ed-496a-8729-d8b30f2da432-kube-api-access-tlvzq\") pod \"insights-runtime-extractor-zzmjv\" (UID: \"0285a5f0-a8ed-496a-8729-d8b30f2da432\") " pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.580089 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.580049 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzmjv" May 21 14:44:00.636083 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.636052 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96eb23f6-9333-48a7-b7ea-e237904bca17-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr\" (UID: \"96eb23f6-9333-48a7-b7ea-e237904bca17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:00.638922 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.638897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96eb23f6-9333-48a7-b7ea-e237904bca17-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr\" (UID: \"96eb23f6-9333-48a7-b7ea-e237904bca17\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:00.737780 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.737669 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzmjv"] May 21 14:44:00.740145 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:00.740113 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0285a5f0_a8ed_496a_8729_d8b30f2da432.slice/crio-871be8300131fe79e5e40f46f75dc10ebb06fad70e474972b63d57cf8768e97c WatchSource:0}: Error finding container 871be8300131fe79e5e40f46f75dc10ebb06fad70e474972b63d57cf8768e97c: Status 404 returned error can't find the container with id 871be8300131fe79e5e40f46f75dc10ebb06fad70e474972b63d57cf8768e97c May 21 14:44:00.762000 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.761975 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:00.860707 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.860665 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" event={"ID":"7ec6cc99-0af7-44e8-81dd-2f8204d6a73f","Type":"ContainerStarted","Data":"89452d71ad8efeb63db5dd4d6b0c22934e4757f6983bdac081680d003190e784"} May 21 14:44:00.862123 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.862095 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzmjv" event={"ID":"0285a5f0-a8ed-496a-8729-d8b30f2da432","Type":"ContainerStarted","Data":"925fc0bef2682d59d94029901a3df63134aff5148878ae82593f0b35767aece0"} May 21 14:44:00.862123 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.862129 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzmjv" event={"ID":"0285a5f0-a8ed-496a-8729-d8b30f2da432","Type":"ContainerStarted","Data":"871be8300131fe79e5e40f46f75dc10ebb06fad70e474972b63d57cf8768e97c"} May 21 14:44:00.881664 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.881617 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-czzsv" podStartSLOduration=33.912521299 podStartE2EDuration="35.881601905s" podCreationTimestamp="2026-05-21 14:43:25 +0000 UTC" firstStartedPulling="2026-05-21 14:43:57.908525596 +0000 UTC m=+113.160813302" lastFinishedPulling="2026-05-21 14:43:59.877606193 +0000 UTC m=+115.129893908" observedRunningTime="2026-05-21 14:44:00.880545488 +0000 UTC m=+116.132833218" watchObservedRunningTime="2026-05-21 14:44:00.881601905 +0000 UTC m=+116.133889633" May 21 14:44:00.893098 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:00.893071 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr"] May 21 14:44:00.896668 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:00.896640 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96eb23f6_9333_48a7_b7ea_e237904bca17.slice/crio-a4cd15d6838ecc3018de5dd3e942f345ceb7723f94400677950f84697a032265 WatchSource:0}: Error finding container a4cd15d6838ecc3018de5dd3e942f345ceb7723f94400677950f84697a032265: Status 404 returned error can't find the container with id a4cd15d6838ecc3018de5dd3e942f345ceb7723f94400677950f84697a032265 May 21 14:44:01.866764 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:01.866670 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzmjv" event={"ID":"0285a5f0-a8ed-496a-8729-d8b30f2da432","Type":"ContainerStarted","Data":"9bdf837e67951da66d9ab9f4485aa84572ce9824a42fa5f05724a37dcc33610b"} May 21 14:44:01.867830 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:01.867795 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" event={"ID":"96eb23f6-9333-48a7-b7ea-e237904bca17","Type":"ContainerStarted","Data":"a4cd15d6838ecc3018de5dd3e942f345ceb7723f94400677950f84697a032265"} May 21 14:44:02.871442 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:02.871401 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" event={"ID":"96eb23f6-9333-48a7-b7ea-e237904bca17","Type":"ContainerStarted","Data":"e9dd7e2b27e35ec8731a97e00dd4d8bdb02469c05f0243d5c398725d2f032246"} May 21 14:44:02.871888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:02.871627 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:02.877791 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:02.877770 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" May 21 14:44:02.886385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:02.886314 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr" podStartSLOduration=1.491763939 podStartE2EDuration="2.886299703s" podCreationTimestamp="2026-05-21 14:44:00 +0000 UTC" firstStartedPulling="2026-05-21 14:44:00.898924244 +0000 UTC m=+116.151211966" lastFinishedPulling="2026-05-21 14:44:02.293460023 +0000 UTC m=+117.545747730" observedRunningTime="2026-05-21 14:44:02.885809588 +0000 UTC m=+118.138097322" watchObservedRunningTime="2026-05-21 14:44:02.886299703 +0000 UTC m=+118.138587432" May 21 14:44:03.518423 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.518340 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-957fq"] May 21 14:44:03.521381 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.521365 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.524618 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.524594 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 14:44:03.525568 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.525553 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 14:44:03.525636 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.525570 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wzr4x\"" May 21 14:44:03.525782 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.525770 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:44:03.533882 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.533856 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-957fq"] May 21 14:44:03.660962 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.660930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.661109 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.660967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.661109 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.661070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwtk\" (UniqueName: \"kubernetes.io/projected/11280cfe-c5c6-409f-a814-f472063376e8-kube-api-access-7wwtk\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.661191 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.661117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11280cfe-c5c6-409f-a814-f472063376e8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.761690 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.761654 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11280cfe-c5c6-409f-a814-f472063376e8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.761883 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.761725 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.761883 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.761745 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.761883 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.761785 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwtk\" (UniqueName: \"kubernetes.io/projected/11280cfe-c5c6-409f-a814-f472063376e8-kube-api-access-7wwtk\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.762410 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.762382 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11280cfe-c5c6-409f-a814-f472063376e8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.764573 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.764546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.764672 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.764575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11280cfe-c5c6-409f-a814-f472063376e8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.769830 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.769777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwtk\" (UniqueName: \"kubernetes.io/projected/11280cfe-c5c6-409f-a814-f472063376e8-kube-api-access-7wwtk\") pod \"prometheus-operator-7779bbdd78-957fq\" (UID: \"11280cfe-c5c6-409f-a814-f472063376e8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.830788 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.830746 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" May 21 14:44:03.883958 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.883476 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzmjv" event={"ID":"0285a5f0-a8ed-496a-8729-d8b30f2da432","Type":"ContainerStarted","Data":"c17e81908104a0011b0e75d52199b666336ee01e45923dafcccbe761efc4a102"} May 21 14:44:03.916053 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.916004 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zzmjv" podStartSLOduration=1.552652856 podStartE2EDuration="3.915985625s" podCreationTimestamp="2026-05-21 14:44:00 +0000 UTC" firstStartedPulling="2026-05-21 14:44:00.800061369 +0000 UTC m=+116.052349077" lastFinishedPulling="2026-05-21 14:44:03.163394139 +0000 UTC m=+118.415681846" observedRunningTime="2026-05-21 14:44:03.915487542 +0000 UTC m=+119.167775274" watchObservedRunningTime="2026-05-21 14:44:03.915985625 +0000 UTC m=+119.168273354" May 21 14:44:03.957367 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:03.957311 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-957fq"] May 21 14:44:03.960325 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:03.960297 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11280cfe_c5c6_409f_a814_f472063376e8.slice/crio-01cd63c6051450b0b3a3abf11af4d3d3451d51c9d3ff54e88b1f99b4067d0ec4 WatchSource:0}: Error finding container 01cd63c6051450b0b3a3abf11af4d3d3451d51c9d3ff54e88b1f99b4067d0ec4: Status 404 returned error can't find the container with id 01cd63c6051450b0b3a3abf11af4d3d3451d51c9d3ff54e88b1f99b4067d0ec4 May 21 14:44:04.844641 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.844611 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-mtfqt"] May 21 14:44:04.847840 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.847817 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:04.850914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.850747 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bwkpm\"" May 21 14:44:04.850914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.850747 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 14:44:04.850914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.850811 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 14:44:04.857256 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.857235 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-mtfqt"] May 21 14:44:04.887323 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.887273 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" event={"ID":"11280cfe-c5c6-409f-a814-f472063376e8","Type":"ContainerStarted","Data":"01cd63c6051450b0b3a3abf11af4d3d3451d51c9d3ff54e88b1f99b4067d0ec4"} May 21 14:44:04.972185 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:04.972136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsgt\" (UniqueName: \"kubernetes.io/projected/63553f03-4875-4140-b6ba-0d52233a9b10-kube-api-access-tgsgt\") pod \"downloads-57bd96b888-mtfqt\" (UID: \"63553f03-4875-4140-b6ba-0d52233a9b10\") " pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:05.073508 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.073457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsgt\" (UniqueName: \"kubernetes.io/projected/63553f03-4875-4140-b6ba-0d52233a9b10-kube-api-access-tgsgt\") pod \"downloads-57bd96b888-mtfqt\" (UID: \"63553f03-4875-4140-b6ba-0d52233a9b10\") " pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:05.082489 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.082457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsgt\" (UniqueName: \"kubernetes.io/projected/63553f03-4875-4140-b6ba-0d52233a9b10-kube-api-access-tgsgt\") pod \"downloads-57bd96b888-mtfqt\" (UID: \"63553f03-4875-4140-b6ba-0d52233a9b10\") " pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:05.159502 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.159423 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:05.327175 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.327152 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-mtfqt"] May 21 14:44:05.330264 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:05.330240 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63553f03_4875_4140_b6ba_0d52233a9b10.slice/crio-f2ae4ee42e994973b34ab17cadb12bb8eacd9b7ba39163328810ddb2a31ed5b9 WatchSource:0}: Error finding container f2ae4ee42e994973b34ab17cadb12bb8eacd9b7ba39163328810ddb2a31ed5b9: Status 404 returned error can't find the container with id f2ae4ee42e994973b34ab17cadb12bb8eacd9b7ba39163328810ddb2a31ed5b9 May 21 14:44:05.891903 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.891860 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" event={"ID":"11280cfe-c5c6-409f-a814-f472063376e8","Type":"ContainerStarted","Data":"4ce1cfa68ed8188f8473cd1f28bc49fe3fe454045316cc9e434629d2b665e585"} May 21 14:44:05.892382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.891914 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" event={"ID":"11280cfe-c5c6-409f-a814-f472063376e8","Type":"ContainerStarted","Data":"e35c1f797ffae84ff9cd25fdc6e8365ad9c0a9aaca82bc6dbf0d78113e0c0b68"} May 21 14:44:05.893185 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.893159 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-mtfqt" event={"ID":"63553f03-4875-4140-b6ba-0d52233a9b10","Type":"ContainerStarted","Data":"f2ae4ee42e994973b34ab17cadb12bb8eacd9b7ba39163328810ddb2a31ed5b9"} May 21 14:44:05.911521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:05.911462 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-957fq" podStartSLOduration=1.697851993 podStartE2EDuration="2.911443707s" podCreationTimestamp="2026-05-21 14:44:03 +0000 UTC" firstStartedPulling="2026-05-21 14:44:03.962723031 +0000 UTC m=+119.215010741" lastFinishedPulling="2026-05-21 14:44:05.176314743 +0000 UTC m=+120.428602455" observedRunningTime="2026-05-21 14:44:05.91048138 +0000 UTC m=+121.162769110" watchObservedRunningTime="2026-05-21 14:44:05.911443707 +0000 UTC m=+121.163731440" May 21 14:44:07.899965 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.899916 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6wf42"] May 21 14:44:07.903493 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.903467 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8"] May 21 14:44:07.903669 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.903651 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:07.906145 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.906120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:44:07.906295 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.906282 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:44:07.906397 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.906305 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwh7b\"" May 21 14:44:07.906397 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.906315 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:44:07.907249 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.907226 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:07.909499 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.909476 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 14:44:07.909706 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.909545 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 14:44:07.909868 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.909841 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vf69s\"" May 21 14:44:07.909989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.909971 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 14:44:07.914234 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:07.914187 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8"] May 21 14:44:08.000301 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000475 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.000475 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-tls\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000475 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000613 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.000613 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-textfile\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000717 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2jv\" (UniqueName: \"kubernetes.io/projected/c2377963-72da-47b5-9604-6da568fb51ed-kube-api-access-kd2jv\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000717 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.000810 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b87451f9-9b96-452e-86c1-7ed8cd364639-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.000810 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-wtmp\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000912 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.000912 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-sys\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.000912 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwjx\" (UniqueName: \"kubernetes.io/projected/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-api-access-htwjx\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.001060 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-root\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.001060 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.000991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-metrics-client-ca\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102487 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102451 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-root\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102487 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102499 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-metrics-client-ca\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-root\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102630 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102665 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102687 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-tls\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102704 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.102734 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102728 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102755 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-textfile\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102774 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2jv\" (UniqueName: \"kubernetes.io/projected/c2377963-72da-47b5-9604-6da568fb51ed-kube-api-access-kd2jv\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102792 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102811 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b87451f9-9b96-452e-86c1-7ed8cd364639-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102856 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-wtmp\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102889 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-sys\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.102941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htwjx\" (UniqueName: \"kubernetes.io/projected/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-api-access-htwjx\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.103121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-metrics-client-ca\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.103377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-textfile\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103852 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.103828 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.103932 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:44:08.103924 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 14:44:08.103985 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.103942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.103985 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:44:08.103981 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls podName:b87451f9-9b96-452e-86c1-7ed8cd364639 nodeName:}" failed. No retries permitted until 2026-05-21 14:44:08.603961902 +0000 UTC m=+123.856249610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-pq5x8" (UID: "b87451f9-9b96-452e-86c1-7ed8cd364639") : secret "kube-state-metrics-tls" not found May 21 14:44:08.104154 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.104131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b87451f9-9b96-452e-86c1-7ed8cd364639-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.104368 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.104219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-wtmp\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.104773 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.104746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2377963-72da-47b5-9604-6da568fb51ed-sys\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.104941 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.104917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.106922 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.106900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-tls\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.107219 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.107194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2377963-72da-47b5-9604-6da568fb51ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.107924 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.107904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.114981 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.114944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwjx\" (UniqueName: \"kubernetes.io/projected/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-api-access-htwjx\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.115171 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.115152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2jv\" (UniqueName: \"kubernetes.io/projected/c2377963-72da-47b5-9604-6da568fb51ed-kube-api-access-kd2jv\") pod \"node-exporter-6wf42\" (UID: \"c2377963-72da-47b5-9604-6da568fb51ed\") " pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.216352 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.216196 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wf42" May 21 14:44:08.225504 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:08.225451 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2377963_72da_47b5_9604_6da568fb51ed.slice/crio-2e4cc0e1def46f8e32903bd645aba6bed44438e26dcada05dca4d99f19f13025 WatchSource:0}: Error finding container 2e4cc0e1def46f8e32903bd645aba6bed44438e26dcada05dca4d99f19f13025: Status 404 returned error can't find the container with id 2e4cc0e1def46f8e32903bd645aba6bed44438e26dcada05dca4d99f19f13025 May 21 14:44:08.608027 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.607993 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.611083 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.611053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b87451f9-9b96-452e-86c1-7ed8cd364639-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pq5x8\" (UID: \"b87451f9-9b96-452e-86c1-7ed8cd364639\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.823484 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.823445 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" May 21 14:44:08.903898 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.902835 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wf42" event={"ID":"c2377963-72da-47b5-9604-6da568fb51ed","Type":"ContainerStarted","Data":"2e4cc0e1def46f8e32903bd645aba6bed44438e26dcada05dca4d99f19f13025"} May 21 14:44:08.995396 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:08.995346 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8"] May 21 14:44:08.999573 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:08.999541 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87451f9_9b96_452e_86c1_7ed8cd364639.slice/crio-078a5ab855190c8b2cf5b9fbbb2af2381681e8daa5e60b114832ff4527625081 WatchSource:0}: Error finding container 078a5ab855190c8b2cf5b9fbbb2af2381681e8daa5e60b114832ff4527625081: Status 404 returned error can't find the container with id 078a5ab855190c8b2cf5b9fbbb2af2381681e8daa5e60b114832ff4527625081 May 21 14:44:09.907843 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:09.907805 2563 generic.go:358] "Generic (PLEG): container finished" podID="c2377963-72da-47b5-9604-6da568fb51ed" containerID="276f756d030a41c4fa620eb8462dc23a54aa3d75283b2b50624c4ed5c7eb2967" exitCode=0 May 21 14:44:09.908296 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:09.907890 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wf42" event={"ID":"c2377963-72da-47b5-9604-6da568fb51ed","Type":"ContainerDied","Data":"276f756d030a41c4fa620eb8462dc23a54aa3d75283b2b50624c4ed5c7eb2967"} May 21 14:44:09.909533 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:09.909503 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" event={"ID":"b87451f9-9b96-452e-86c1-7ed8cd364639","Type":"ContainerStarted","Data":"078a5ab855190c8b2cf5b9fbbb2af2381681e8daa5e60b114832ff4527625081"} May 21 14:44:10.216576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.216484 2563 patch_prober.go:28] interesting pod/image-registry-5cb8f8f6d4-n6dc4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 14:44:10.216576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.216556 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:44:10.914700 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.914657 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wf42" event={"ID":"c2377963-72da-47b5-9604-6da568fb51ed","Type":"ContainerStarted","Data":"970e03353f84848e39cb1292ac101ec124534a1d70241b1ff45140e3921ae12e"} May 21 14:44:10.914700 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.914707 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wf42" event={"ID":"c2377963-72da-47b5-9604-6da568fb51ed","Type":"ContainerStarted","Data":"6bb87bb8cafe40daf0a95d8cdf6f836ea154ac468432eb739293466dc134a4ec"} May 21 14:44:10.917761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.917722 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" event={"ID":"b87451f9-9b96-452e-86c1-7ed8cd364639","Type":"ContainerStarted","Data":"9987dccbc3b171c42087d81e055502d5e44fc3fef8fb3da3d2a5a34d962116dc"} May 21 14:44:10.917761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.917761 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" event={"ID":"b87451f9-9b96-452e-86c1-7ed8cd364639","Type":"ContainerStarted","Data":"bf42e3b56346b26b99564ff1e79af4ffe7043efb8b856cdacb5a5e75f30c4002"} May 21 14:44:10.917981 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.917773 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" event={"ID":"b87451f9-9b96-452e-86c1-7ed8cd364639","Type":"ContainerStarted","Data":"f80c6ae88303c8fe927b9304329bae2897f1a06c2e4b441d0b6ca35635a6c64c"} May 21 14:44:10.933197 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.933128 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6wf42" podStartSLOduration=2.824129368 podStartE2EDuration="3.933112957s" podCreationTimestamp="2026-05-21 14:44:07 +0000 UTC" firstStartedPulling="2026-05-21 14:44:08.227488412 +0000 UTC m=+123.479776122" lastFinishedPulling="2026-05-21 14:44:09.336472 +0000 UTC m=+124.588759711" observedRunningTime="2026-05-21 14:44:10.931836007 +0000 UTC m=+126.184123738" watchObservedRunningTime="2026-05-21 14:44:10.933112957 +0000 UTC m=+126.185400685" May 21 14:44:10.954943 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:10.954885 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pq5x8" podStartSLOduration=2.431318588 podStartE2EDuration="3.954870095s" podCreationTimestamp="2026-05-21 14:44:07 +0000 UTC" firstStartedPulling="2026-05-21 14:44:09.002222037 +0000 UTC m=+124.254509743" lastFinishedPulling="2026-05-21 14:44:10.525773543 +0000 UTC m=+125.778061250" observedRunningTime="2026-05-21 14:44:10.954148405 +0000 UTC m=+126.206436133" watchObservedRunningTime="2026-05-21 14:44:10.954870095 +0000 UTC m=+126.207157824" May 21 14:44:12.179266 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.179218 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l"] May 21 14:44:12.184443 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.184415 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.186936 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.186912 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 14:44:12.188272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.188120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 14:44:12.188272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.188140 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 14:44:12.188272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.188146 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:44:12.188272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.188185 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cp0poejq931vi\"" May 21 14:44:12.188272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.188126 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j4vg6\"" May 21 14:44:12.195724 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.195060 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l"] May 21 14:44:12.344912 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.344873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-tls\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345081 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.344918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ea518a-0237-47d6-b3b2-9960a40b7c98-audit-log\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345081 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.345024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-client-certs\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.345090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-metrics-server-audit-profiles\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.345121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbgpd\" (UniqueName: \"kubernetes.io/projected/c4ea518a-0237-47d6-b3b2-9960a40b7c98-kube-api-access-xbgpd\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.345161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.345273 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.345210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-client-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446112 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446022 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-metrics-server-audit-profiles\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446112 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446069 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbgpd\" (UniqueName: \"kubernetes.io/projected/c4ea518a-0237-47d6-b3b2-9960a40b7c98-kube-api-access-xbgpd\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446116 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446146 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-client-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446219 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-tls\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446243 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ea518a-0237-47d6-b3b2-9960a40b7c98-audit-log\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446382 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446287 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-client-certs\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446836 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ea518a-0237-47d6-b3b2-9960a40b7c98-audit-log\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.446993 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.446969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.447224 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.447204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ea518a-0237-47d6-b3b2-9960a40b7c98-metrics-server-audit-profiles\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.449484 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.449457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-client-certs\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.449671 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.449644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-client-ca-bundle\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.449767 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.449723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ea518a-0237-47d6-b3b2-9960a40b7c98-secret-metrics-server-tls\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.454271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.454230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbgpd\" (UniqueName: \"kubernetes.io/projected/c4ea518a-0237-47d6-b3b2-9960a40b7c98-kube-api-access-xbgpd\") pod \"metrics-server-7d7b5ffbcd-n2p2l\" (UID: \"c4ea518a-0237-47d6-b3b2-9960a40b7c98\") " pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.499023 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.498987 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:12.650216 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.650113 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l"] May 21 14:44:12.653043 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:12.653007 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ea518a_0237_47d6_b3b2_9960a40b7c98.slice/crio-ae340eb524a42ce518321aabd6b504cd39ae59199516bd50c6067de28c1861d6 WatchSource:0}: Error finding container ae340eb524a42ce518321aabd6b504cd39ae59199516bd50c6067de28c1861d6: Status 404 returned error can't find the container with id ae340eb524a42ce518321aabd6b504cd39ae59199516bd50c6067de28c1861d6 May 21 14:44:12.925188 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:12.925140 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" event={"ID":"c4ea518a-0237-47d6-b3b2-9960a40b7c98","Type":"ContainerStarted","Data":"ae340eb524a42ce518321aabd6b504cd39ae59199516bd50c6067de28c1861d6"} May 21 14:44:13.083906 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.083808 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67d6d9785b-znxxs"] May 21 14:44:13.090372 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.090323 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.093452 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093423 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 14:44:13.093595 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093436 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 14:44:13.093595 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093437 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 14:44:13.093595 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093518 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 14:44:13.093595 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093488 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m46s9\"" May 21 14:44:13.093815 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.093437 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 14:44:13.099163 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.099114 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d6d9785b-znxxs"] May 21 14:44:13.099458 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.099391 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 14:44:13.251890 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.251796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.251890 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.251850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-metrics-client-ca\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.251920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.251968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-serving-certs-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.252001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.252034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drx8h\" (UniqueName: \"kubernetes.io/projected/7d460844-1ff0-40aa-8a43-688058b3bd38-kube-api-access-drx8h\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.252100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.252316 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.252116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-federate-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.352738 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352698 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drx8h\" (UniqueName: \"kubernetes.io/projected/7d460844-1ff0-40aa-8a43-688058b3bd38-kube-api-access-drx8h\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.352925 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352800 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.352925 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352831 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-federate-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.352925 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352862 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.353097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352907 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-metrics-client-ca\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.353097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.352980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.353097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.353012 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-serving-certs-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.353097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.353049 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.354083 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.354054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-serving-certs-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.354223 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.354058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-metrics-client-ca\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.354908 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.354864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.356126 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.356103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.356403 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.356353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-telemeter-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.356521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.356403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.356521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.356481 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d460844-1ff0-40aa-8a43-688058b3bd38-federate-client-tls\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.361049 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.361029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drx8h\" (UniqueName: \"kubernetes.io/projected/7d460844-1ff0-40aa-8a43-688058b3bd38-kube-api-access-drx8h\") pod \"telemeter-client-67d6d9785b-znxxs\" (UID: \"7d460844-1ff0-40aa-8a43-688058b3bd38\") " pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.404952 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.404845 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" May 21 14:44:13.571010 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.570978 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d6d9785b-znxxs"] May 21 14:44:13.573903 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:13.573870 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d460844_1ff0_40aa_8a43_688058b3bd38.slice/crio-5857c745ce503b770b7b5dfca7bc1b8824ca3b5881a68c4450131e927a9ea4fa WatchSource:0}: Error finding container 5857c745ce503b770b7b5dfca7bc1b8824ca3b5881a68c4450131e927a9ea4fa: Status 404 returned error can't find the container with id 5857c745ce503b770b7b5dfca7bc1b8824ca3b5881a68c4450131e927a9ea4fa May 21 14:44:13.945444 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:13.945388 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" event={"ID":"7d460844-1ff0-40aa-8a43-688058b3bd38","Type":"ContainerStarted","Data":"5857c745ce503b770b7b5dfca7bc1b8824ca3b5881a68c4450131e927a9ea4fa"} May 21 14:44:14.061093 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.060971 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:44:14.064793 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.064765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef-metrics-certs\") pod \"network-metrics-daemon-nlsht\" (UID: \"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef\") " pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:44:14.127244 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.125110 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:44:14.130052 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.130023 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.133027 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.132999 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:44:14.133295 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.133271 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t4bdq\"" May 21 14:44:14.133500 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.133482 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:44:14.133935 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.133910 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:44:14.135609 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.134420 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:44:14.135609 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.134659 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:44:14.135609 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.134846 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:44:14.135817 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.135731 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:44:14.136006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.135987 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:44:14.136585 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.136559 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-edeh7u3s5i4u3\"" May 21 14:44:14.137249 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.137135 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:44:14.139607 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.139078 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:44:14.139607 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.139295 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:44:14.139607 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.139522 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:44:14.141311 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.141285 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:44:14.218157 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.217857 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brsnp\"" May 21 14:44:14.226185 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.226044 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nlsht" May 21 14:44:14.262413 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdpn6\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.262888 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.262982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.263038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.263576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.263069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.363838 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363757 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.363838 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363808 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363846 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363873 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363913 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.363975 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364009 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdpn6\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364038 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364061 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364086 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364184 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364165 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364192 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364222 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364257 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364284 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364312 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.364709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.364374 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.365577 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.365261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.365577 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.365468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.371706 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.366670 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.371706 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.369947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.371706 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.370493 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.372011 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.371750 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.372385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.372357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.372487 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.372367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.372935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.373253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.373719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.373742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.374072 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdpn6\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.374207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.374474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.374635 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.374480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.375121 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.375082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.377681 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.377433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.448831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.448734 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:14.813925 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.813871 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nlsht"] May 21 14:44:14.817428 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:14.817389 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a12ccf_b510_4ba8_a3c6_bb0362e1e6ef.slice/crio-61cd8339515b5ebca879f8eaaa9e2b25380399ec3ac073858368d4063051f11c WatchSource:0}: Error finding container 61cd8339515b5ebca879f8eaaa9e2b25380399ec3ac073858368d4063051f11c: Status 404 returned error can't find the container with id 61cd8339515b5ebca879f8eaaa9e2b25380399ec3ac073858368d4063051f11c May 21 14:44:14.850632 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.850448 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:44:14.856294 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:14.856256 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398aac98_e035_4b72_876c_9f7c1ae642dc.slice/crio-4d42d57146b540c6be5127edac803c869bdbb7c605fc68e64f9b589295138251 WatchSource:0}: Error finding container 4d42d57146b540c6be5127edac803c869bdbb7c605fc68e64f9b589295138251: Status 404 returned error can't find the container with id 4d42d57146b540c6be5127edac803c869bdbb7c605fc68e64f9b589295138251 May 21 14:44:14.950745 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.950659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" event={"ID":"c4ea518a-0237-47d6-b3b2-9960a40b7c98","Type":"ContainerStarted","Data":"975cb0288601b39869bd87c5f802e45abcabfc91d602aa1c5def798976bfe783"} May 21 14:44:14.952739 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.952705 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nlsht" event={"ID":"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef","Type":"ContainerStarted","Data":"61cd8339515b5ebca879f8eaaa9e2b25380399ec3ac073858368d4063051f11c"} May 21 14:44:14.954460 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.954428 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"4d42d57146b540c6be5127edac803c869bdbb7c605fc68e64f9b589295138251"} May 21 14:44:14.970513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:14.968829 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" podStartSLOduration=0.928136647 podStartE2EDuration="2.968810797s" podCreationTimestamp="2026-05-21 14:44:12 +0000 UTC" firstStartedPulling="2026-05-21 14:44:12.655601091 +0000 UTC m=+127.907888802" lastFinishedPulling="2026-05-21 14:44:14.696275228 +0000 UTC m=+129.948562952" observedRunningTime="2026-05-21 14:44:14.967124755 +0000 UTC m=+130.219412497" watchObservedRunningTime="2026-05-21 14:44:14.968810797 +0000 UTC m=+130.221098526" May 21 14:44:20.215522 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:20.215480 2563 patch_prober.go:28] interesting pod/image-registry-5cb8f8f6d4-n6dc4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 14:44:20.215914 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:20.215561 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:44:23.985795 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.985753 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" event={"ID":"7d460844-1ff0-40aa-8a43-688058b3bd38","Type":"ContainerStarted","Data":"4eadd48b20faf72744218d0bdbc2bdc5b2c76eae718cce64f8d5f9a2854a068b"} May 21 14:44:23.986276 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.985802 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" event={"ID":"7d460844-1ff0-40aa-8a43-688058b3bd38","Type":"ContainerStarted","Data":"47ce9c55c6406188a5fd7760424f8db12164c5249ed971836d44731eefd80a9c"} May 21 14:44:23.986276 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.985818 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" event={"ID":"7d460844-1ff0-40aa-8a43-688058b3bd38","Type":"ContainerStarted","Data":"ec85580c278e24d54c5d3a06a3fc75912077b38d2b4f0fa5b1aca31151df5c73"} May 21 14:44:23.987828 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.987795 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nlsht" event={"ID":"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef","Type":"ContainerStarted","Data":"6f0bf3b910cdd5fa69b3409726a2d46690c8d146c086d1903d978f2ad0df2992"} May 21 14:44:23.987936 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.987836 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nlsht" event={"ID":"13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef","Type":"ContainerStarted","Data":"ab343c58a815db72ce9828f159040039a34897875a3e778ea2183b31aefcc1ae"} May 21 14:44:23.989784 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.989672 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" exitCode=0 May 21 14:44:23.989784 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.989713 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} May 21 14:44:23.991307 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.991269 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-mtfqt" event={"ID":"63553f03-4875-4140-b6ba-0d52233a9b10","Type":"ContainerStarted","Data":"8945f5c3b67082f9d5c2cd7113cf7ee28b425a3450e0176d9602336cbbf24c04"} May 21 14:44:23.991581 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:23.991474 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:24.003781 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:24.003759 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-mtfqt" May 21 14:44:24.008641 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:24.008587 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67d6d9785b-znxxs" podStartSLOduration=1.520561668 podStartE2EDuration="11.008570752s" podCreationTimestamp="2026-05-21 14:44:13 +0000 UTC" firstStartedPulling="2026-05-21 14:44:13.575996192 +0000 UTC m=+128.828283899" lastFinishedPulling="2026-05-21 14:44:23.064005262 +0000 UTC m=+138.316292983" observedRunningTime="2026-05-21 14:44:24.007442624 +0000 UTC m=+139.259730347" watchObservedRunningTime="2026-05-21 14:44:24.008570752 +0000 UTC m=+139.260858482" May 21 14:44:24.049944 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:24.049872 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nlsht" podStartSLOduration=130.258556575 podStartE2EDuration="2m19.0498503s" podCreationTimestamp="2026-05-21 14:42:05 +0000 UTC" firstStartedPulling="2026-05-21 14:44:14.823570654 +0000 UTC m=+130.075858361" lastFinishedPulling="2026-05-21 14:44:23.614864362 +0000 UTC m=+138.867152086" observedRunningTime="2026-05-21 14:44:24.047938808 +0000 UTC m=+139.300226537" watchObservedRunningTime="2026-05-21 14:44:24.0498503 +0000 UTC m=+139.302138086" May 21 14:44:24.070834 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:24.070775 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-mtfqt" podStartSLOduration=2.280006353 podStartE2EDuration="20.070756837s" podCreationTimestamp="2026-05-21 14:44:04 +0000 UTC" firstStartedPulling="2026-05-21 14:44:05.332314644 +0000 UTC m=+120.584602352" lastFinishedPulling="2026-05-21 14:44:23.123065116 +0000 UTC m=+138.375352836" observedRunningTime="2026-05-21 14:44:24.069073105 +0000 UTC m=+139.321360834" watchObservedRunningTime="2026-05-21 14:44:24.070756837 +0000 UTC m=+139.323044567" May 21 14:44:25.231023 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.230930 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" containerID="cri-o://b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703" gracePeriod=30 May 21 14:44:25.534859 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.534833 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:44:25.584647 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584608 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.584825 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584663 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.584825 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584695 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.584825 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584731 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.584825 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584764 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.585016 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584828 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.585016 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584910 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.585016 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.584927 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42fs8\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8\") pod \"362e7f07-ba61-4b18-b903-51fb02bb5c65\" (UID: \"362e7f07-ba61-4b18-b903-51fb02bb5c65\") " May 21 14:44:25.586630 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.586154 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:44:25.586630 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.586452 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:44:25.590731 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.590697 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:25.590840 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.590825 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8" (OuterVolumeSpecName: "kube-api-access-42fs8") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "kube-api-access-42fs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:25.592911 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.592863 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:44:25.593868 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.593834 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:44:25.594081 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.594052 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:44:25.597490 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.596919 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "362e7f07-ba61-4b18-b903-51fb02bb5c65" (UID: "362e7f07-ba61-4b18-b903-51fb02bb5c65"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:44:25.685910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685870 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-image-registry-private-configuration\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685919 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-tls\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685938 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/362e7f07-ba61-4b18-b903-51fb02bb5c65-installation-pull-secrets\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685956 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-registry-certificates\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685973 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42fs8\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-kube-api-access-42fs8\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.685986 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/362e7f07-ba61-4b18-b903-51fb02bb5c65-trusted-ca\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.686000 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/362e7f07-ba61-4b18-b903-51fb02bb5c65-bound-sa-token\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:25.686087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:25.686014 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/362e7f07-ba61-4b18-b903-51fb02bb5c65-ca-trust-extracted\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:44:26.002845 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.002805 2563 generic.go:358] "Generic (PLEG): container finished" podID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerID="b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703" exitCode=0 May 21 14:44:26.003038 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.002879 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" May 21 14:44:26.003038 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.002898 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" event={"ID":"362e7f07-ba61-4b18-b903-51fb02bb5c65","Type":"ContainerDied","Data":"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703"} May 21 14:44:26.003038 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.002940 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4" event={"ID":"362e7f07-ba61-4b18-b903-51fb02bb5c65","Type":"ContainerDied","Data":"b3015fa839f68aa71fc3da59d471405ac098acf73e4ce8d5f23c6d5ef2612eff"} May 21 14:44:26.003038 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.002963 2563 scope.go:117] "RemoveContainer" containerID="b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703" May 21 14:44:26.023846 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.023733 2563 scope.go:117] "RemoveContainer" containerID="b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703" May 21 14:44:26.024200 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:44:26.024117 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703\": container with ID starting with b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703 not found: ID does not exist" containerID="b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703" May 21 14:44:26.024200 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.024158 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703"} err="failed to get container status \"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703\": rpc error: code = NotFound desc = could not find container \"b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703\": container with ID starting with b3be16bff482e1f21fa452eacc010c87ac1a0606ecbaefaaf0fe55b6f4383703 not found: ID does not exist" May 21 14:44:26.025413 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.025392 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:44:26.028831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:26.028808 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8f6d4-n6dc4"] May 21 14:44:27.403404 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:27.403371 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" path="/var/lib/kubelet/pods/362e7f07-ba61-4b18-b903-51fb02bb5c65/volumes" May 21 14:44:28.013618 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:28.013527 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} May 21 14:44:28.013618 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:28.013574 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} May 21 14:44:31.026087 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:31.026050 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} May 21 14:44:31.026506 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:31.026095 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} May 21 14:44:32.033130 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:32.033090 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} May 21 14:44:32.033130 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:32.033136 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerStarted","Data":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} May 21 14:44:32.063511 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:32.063447 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.246028575 podStartE2EDuration="18.063426765s" podCreationTimestamp="2026-05-21 14:44:14 +0000 UTC" firstStartedPulling="2026-05-21 14:44:14.858869385 +0000 UTC m=+130.111157104" lastFinishedPulling="2026-05-21 14:44:30.676267575 +0000 UTC m=+145.928555294" observedRunningTime="2026-05-21 14:44:32.061836436 +0000 UTC m=+147.314124297" watchObservedRunningTime="2026-05-21 14:44:32.063426765 +0000 UTC m=+147.315714496" May 21 14:44:32.499456 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:32.499405 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:32.499456 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:32.499468 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:34.449614 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:34.449574 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:44:40.061073 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:40.061035 2563 generic.go:358] "Generic (PLEG): container finished" podID="d059a681-c970-464e-8581-8cb82a02b74a" containerID="cd67bb3c06db6086f7d748a87532c2ddc4b959da194f5a5956965b8d51a2de25" exitCode=0 May 21 14:44:40.061495 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:40.061083 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" event={"ID":"d059a681-c970-464e-8581-8cb82a02b74a","Type":"ContainerDied","Data":"cd67bb3c06db6086f7d748a87532c2ddc4b959da194f5a5956965b8d51a2de25"} May 21 14:44:40.061495 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:40.061429 2563 scope.go:117] "RemoveContainer" containerID="cd67bb3c06db6086f7d748a87532c2ddc4b959da194f5a5956965b8d51a2de25" May 21 14:44:41.066670 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:41.066628 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zgjn8" event={"ID":"d059a681-c970-464e-8581-8cb82a02b74a","Type":"ContainerStarted","Data":"674d571d0bb079d529ecd12c39a746344adcce904d936c056d0b24b1119490eb"} May 21 14:44:42.137849 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:44:42.137804 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jbphl" podUID="d1735115-cc89-40bb-add6-5ea39ebe1f72" May 21 14:44:42.149970 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:44:42.149936 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-xst9j" podUID="86fd6b66-c53d-4f89-b12b-1d314909a952" May 21 14:44:42.888398 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:42.888361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mh292_7c09078b-b130-49e3-8a4e-84cfa4a0e237/dns-node-resolver/0.log" May 21 14:44:43.071885 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:43.071849 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbphl" May 21 14:44:43.892837 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:43.892805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-srkq8_3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d/cluster-samples-operator/0.log" May 21 14:44:44.087779 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:44.087747 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-srkq8_3f08e6bd-1bf6-4fb8-bd99-e946822eaf7d/cluster-samples-operator-watch/0.log" May 21 14:44:46.997415 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:46.997371 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:44:46.997793 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:46.997451 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:44:46.999919 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:46.999886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1735115-cc89-40bb-add6-5ea39ebe1f72-metrics-tls\") pod \"dns-default-jbphl\" (UID: \"d1735115-cc89-40bb-add6-5ea39ebe1f72\") " pod="openshift-dns/dns-default-jbphl" May 21 14:44:47.000044 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:47.000025 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fd6b66-c53d-4f89-b12b-1d314909a952-cert\") pod \"ingress-canary-xst9j\" (UID: \"86fd6b66-c53d-4f89-b12b-1d314909a952\") " pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:44:47.275297 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:47.275210 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2mh\"" May 21 14:44:47.283407 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:47.283376 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jbphl" May 21 14:44:47.429933 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:47.429907 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jbphl"] May 21 14:44:47.433217 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:47.433188 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1735115_cc89_40bb_add6_5ea39ebe1f72.slice/crio-b8bf6681f3f0519bcd3ec0f0775e8cf9d8e9afe56ba78102b38b6ef1ec3205fb WatchSource:0}: Error finding container b8bf6681f3f0519bcd3ec0f0775e8cf9d8e9afe56ba78102b38b6ef1ec3205fb: Status 404 returned error can't find the container with id b8bf6681f3f0519bcd3ec0f0775e8cf9d8e9afe56ba78102b38b6ef1ec3205fb May 21 14:44:48.086213 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:48.086170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbphl" event={"ID":"d1735115-cc89-40bb-add6-5ea39ebe1f72","Type":"ContainerStarted","Data":"b8bf6681f3f0519bcd3ec0f0775e8cf9d8e9afe56ba78102b38b6ef1ec3205fb"} May 21 14:44:49.091275 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:49.091235 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbphl" event={"ID":"d1735115-cc89-40bb-add6-5ea39ebe1f72","Type":"ContainerStarted","Data":"94b87af334365ecf18152673bdaa08e47cc869b5e55173671b285f4de6bb4f9d"} May 21 14:44:49.091275 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:49.091279 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jbphl" event={"ID":"d1735115-cc89-40bb-add6-5ea39ebe1f72","Type":"ContainerStarted","Data":"495eb147dcc2b3885db953fdef4c53998946e4e04def27d88f6b363346730a59"} May 21 14:44:49.091743 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:49.091468 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jbphl" May 21 14:44:49.108138 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:49.108082 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jbphl" podStartSLOduration=128.681801019 podStartE2EDuration="2m10.108061545s" podCreationTimestamp="2026-05-21 14:42:39 +0000 UTC" firstStartedPulling="2026-05-21 14:44:47.435553529 +0000 UTC m=+162.687841251" lastFinishedPulling="2026-05-21 14:44:48.861814066 +0000 UTC m=+164.114101777" observedRunningTime="2026-05-21 14:44:49.106240989 +0000 UTC m=+164.358528741" watchObservedRunningTime="2026-05-21 14:44:49.108061545 +0000 UTC m=+164.360349275" May 21 14:44:52.506269 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:52.506232 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:52.510704 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:52.510679 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7b5ffbcd-n2p2l" May 21 14:44:55.112152 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:55.112115 2563 generic.go:358] "Generic (PLEG): container finished" podID="7fde25a0-9f67-4a31-9753-0141d547989c" containerID="aa1ed018ad9f529ea644ce26b63628c3ba78ec2a884916f337a4960ec5988fa7" exitCode=0 May 21 14:44:55.112833 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:55.112196 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" event={"ID":"7fde25a0-9f67-4a31-9753-0141d547989c","Type":"ContainerDied","Data":"aa1ed018ad9f529ea644ce26b63628c3ba78ec2a884916f337a4960ec5988fa7"} May 21 14:44:55.112833 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:55.112665 2563 scope.go:117] "RemoveContainer" containerID="aa1ed018ad9f529ea644ce26b63628c3ba78ec2a884916f337a4960ec5988fa7" May 21 14:44:56.116271 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:56.116238 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wkr74" event={"ID":"7fde25a0-9f67-4a31-9753-0141d547989c","Type":"ContainerStarted","Data":"60738134d75ea0f9f92fc916ca8976c0149ca9bdfd6504e01c3ba1aead7632b6"} May 21 14:44:56.399023 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:56.398933 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:44:56.401665 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:56.401647 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t9nbd\"" May 21 14:44:56.409641 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:56.409620 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xst9j" May 21 14:44:56.534445 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:56.534420 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xst9j"] May 21 14:44:56.536253 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:44:56.536228 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fd6b66_c53d_4f89_b12b_1d314909a952.slice/crio-ce62e211acad3df58ff3c1bc4427224ab179c5a2d1bf1de825023f4df4f6134c WatchSource:0}: Error finding container ce62e211acad3df58ff3c1bc4427224ab179c5a2d1bf1de825023f4df4f6134c: Status 404 returned error can't find the container with id ce62e211acad3df58ff3c1bc4427224ab179c5a2d1bf1de825023f4df4f6134c May 21 14:44:57.121646 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:57.121581 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xst9j" event={"ID":"86fd6b66-c53d-4f89-b12b-1d314909a952","Type":"ContainerStarted","Data":"ce62e211acad3df58ff3c1bc4427224ab179c5a2d1bf1de825023f4df4f6134c"} May 21 14:44:59.096178 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:59.096146 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jbphl" May 21 14:44:59.129828 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:59.129787 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xst9j" event={"ID":"86fd6b66-c53d-4f89-b12b-1d314909a952","Type":"ContainerStarted","Data":"d4ced75407618685743b2c96b99dd3946caeee29c64194d7777393fda1632a9c"} May 21 14:44:59.144211 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:44:59.144155 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xst9j" podStartSLOduration=138.044731292 podStartE2EDuration="2m20.144137446s" podCreationTimestamp="2026-05-21 14:42:39 +0000 UTC" firstStartedPulling="2026-05-21 14:44:56.538187363 +0000 UTC m=+171.790475071" lastFinishedPulling="2026-05-21 14:44:58.637593519 +0000 UTC m=+173.889881225" observedRunningTime="2026-05-21 14:44:59.143770311 +0000 UTC m=+174.396058047" watchObservedRunningTime="2026-05-21 14:44:59.144137446 +0000 UTC m=+174.396425212" May 21 14:45:14.449351 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:14.449304 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:14.470064 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:14.470035 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:15.192942 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:15.192908 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:32.414762 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.414711 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:32.415988 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.415934 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="prometheus" containerID="cri-o://1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" gracePeriod=600 May 21 14:45:32.416270 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.415950 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="thanos-sidecar" containerID="cri-o://1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" gracePeriod=600 May 21 14:45:32.416419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.415969 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy" containerID="cri-o://97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" gracePeriod=600 May 21 14:45:32.416419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.416017 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="config-reloader" containerID="cri-o://2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" gracePeriod=600 May 21 14:45:32.416419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.416015 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-web" containerID="cri-o://7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" gracePeriod=600 May 21 14:45:32.416419 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.416040 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" gracePeriod=600 May 21 14:45:32.667991 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.667924 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:32.794291 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794250 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794312 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794398 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794425 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794454 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794483 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794513 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794507 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794819 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794559 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.794885 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794847 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:45:32.794885 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794863 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:45:32.794885 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.794852 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:45:32.795177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795110 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795160 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795186 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795177 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795210 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795239 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795269 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795296 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795361 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795403 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795494 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795436 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdpn6\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6\") pod \"398aac98-e035-4b72-876c-9f7c1ae642dc\" (UID: \"398aac98-e035-4b72-876c-9f7c1ae642dc\") " May 21 14:45:32.795796 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795699 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-metrics-client-ca\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.795796 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795718 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.795796 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.795734 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.797395 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.797365 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:45:32.798174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798101 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.798174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798124 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.798174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798152 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.798174 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798170 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6" (OuterVolumeSpecName: "kube-api-access-tdpn6") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "kube-api-access-tdpn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:45:32.798441 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798198 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.798480 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798434 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:45:32.799017 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.798995 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.799481 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.799458 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:45:32.799860 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.799836 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:45:32.801040 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.801013 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.801237 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.801218 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out" (OuterVolumeSpecName: "config-out") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:45:32.801516 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.801498 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.801573 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.801523 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config" (OuterVolumeSpecName: "config") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.809276 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.809251 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config" (OuterVolumeSpecName: "web-config") pod "398aac98-e035-4b72-876c-9f7c1ae642dc" (UID: "398aac98-e035-4b72-876c-9f7c1ae642dc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:45:32.896704 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896667 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896704 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896698 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-tls-assets\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896704 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896708 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-kube-rbac-proxy\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896717 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-metrics-client-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896726 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-config\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896735 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-grpc-tls\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896743 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-config-out\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896751 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896760 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896771 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896782 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896792 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/398aac98-e035-4b72-876c-9f7c1ae642dc-prometheus-k8s-db\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896801 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896809 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdpn6\" (UniqueName: \"kubernetes.io/projected/398aac98-e035-4b72-876c-9f7c1ae642dc-kube-api-access-tdpn6\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:32.896928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:32.896819 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/398aac98-e035-4b72-876c-9f7c1ae642dc-web-config\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:45:33.232050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232012 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" exitCode=0 May 21 14:45:33.232050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232041 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" exitCode=0 May 21 14:45:33.232050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232048 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" exitCode=0 May 21 14:45:33.232050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232054 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" exitCode=0 May 21 14:45:33.232050 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232059 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" exitCode=0 May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232065 2563 generic.go:358] "Generic (PLEG): container finished" podID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" exitCode=0 May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232109 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232126 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232152 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232166 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232176 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232185 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232194 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232206 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"398aac98-e035-4b72-876c-9f7c1ae642dc","Type":"ContainerDied","Data":"4d42d57146b540c6be5127edac803c869bdbb7c605fc68e64f9b589295138251"} May 21 14:45:33.232385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.232221 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.240214 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.240195 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.247385 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.247366 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.254176 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.254152 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.256895 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.256872 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:33.261641 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.261615 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:33.262266 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.262237 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.268851 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.268836 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.275699 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.275685 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.282274 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.282255 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.282574 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.282554 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.282654 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.282581 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.282654 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.282601 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.282893 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.282869 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.282937 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.282908 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.282937 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.282932 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.283166 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.283146 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.283226 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283177 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.283226 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283204 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.283511 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.283487 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.283594 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283516 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.283594 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283538 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.283790 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.283773 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.283833 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283795 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.283833 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.283812 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.284047 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.284032 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.284090 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284052 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.284090 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284066 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.284296 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:45:33.284279 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.284383 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284299 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.284383 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284316 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.284581 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284563 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.284628 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284582 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.284808 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284785 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.284859 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.284814 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.285018 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285003 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.285018 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285018 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.285230 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285207 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.285288 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285232 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.285465 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285447 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.285521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285466 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.285711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285690 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.285782 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.285725 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.286060 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286036 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.286099 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286064 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.286297 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286280 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.286395 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286299 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.286605 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286567 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.286605 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286604 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.286904 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286867 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.286904 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.286893 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.287155 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287131 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.287233 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287156 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.287441 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287420 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.287441 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287443 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.287665 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287648 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.287665 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287664 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.287872 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287854 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.287872 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.287870 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.288070 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288051 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.288126 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288069 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.288283 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288264 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.288357 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288284 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.288545 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288528 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.288545 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288544 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.288733 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288717 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.288733 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288732 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.288910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288894 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.288910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.288909 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.289078 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289064 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.289136 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289078 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.289255 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289229 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.289314 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289254 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.289431 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289415 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.289431 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289430 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.289623 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289605 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.289677 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289623 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.289839 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289824 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.289894 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.289839 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.290062 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290043 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.290117 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290063 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.290308 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290289 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.290411 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290309 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.290571 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290536 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.290571 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290558 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.290737 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290721 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.290830 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290739 2563 scope.go:117] "RemoveContainer" containerID="2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a" May 21 14:45:33.290942 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290927 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a"} err="failed to get container status \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": rpc error: code = NotFound desc = could not find container \"2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a\": container with ID starting with 2ed3fa4f912ee013320ade949a5441d88684b095baca92b2046b9478e572204a not found: ID does not exist" May 21 14:45:33.290942 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.290941 2563 scope.go:117] "RemoveContainer" containerID="97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc" May 21 14:45:33.291141 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291121 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc"} err="failed to get container status \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": rpc error: code = NotFound desc = could not find container \"97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc\": container with ID starting with 97fcd48d62af125a1e3335f20261a504425eb29e1a349bde098522ea069fabdc not found: ID does not exist" May 21 14:45:33.291196 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291142 2563 scope.go:117] "RemoveContainer" containerID="7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188" May 21 14:45:33.291389 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291367 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188"} err="failed to get container status \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": rpc error: code = NotFound desc = could not find container \"7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188\": container with ID starting with 7e1d69a6dfb356feec403cf7b1e9f45289f67e52a37838428a345aa50a696188 not found: ID does not exist" May 21 14:45:33.291471 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291392 2563 scope.go:117] "RemoveContainer" containerID="1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc" May 21 14:45:33.291621 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291602 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc"} err="failed to get container status \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": rpc error: code = NotFound desc = could not find container \"1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc\": container with ID starting with 1498e514a21f4f70726e0dfa42f8e3b5c1d1b10bd47b0b637acb692ab0e2bfdc not found: ID does not exist" May 21 14:45:33.291682 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291622 2563 scope.go:117] "RemoveContainer" containerID="2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1" May 21 14:45:33.291809 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291794 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1"} err="failed to get container status \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": rpc error: code = NotFound desc = could not find container \"2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1\": container with ID starting with 2709a003f8eb3406ba9a214e270240646601abdcad19cdde9ab6518070b0dfb1 not found: ID does not exist" May 21 14:45:33.291864 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.291809 2563 scope.go:117] "RemoveContainer" containerID="1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a" May 21 14:45:33.292034 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.292017 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a"} err="failed to get container status \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": rpc error: code = NotFound desc = could not find container \"1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a\": container with ID starting with 1a1ffd75a90a7736268888605625aa355be98a6c75a58f53c67e1b1f7407c28a not found: ID does not exist" May 21 14:45:33.292094 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.292034 2563 scope.go:117] "RemoveContainer" containerID="6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db" May 21 14:45:33.292247 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.292233 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db"} err="failed to get container status \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": rpc error: code = NotFound desc = could not find container \"6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db\": container with ID starting with 6a89ac0d06238816edc77d53691b4f04a5cf143c4cd587df42017e4047b473db not found: ID does not exist" May 21 14:45:33.297024 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297005 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:33.297310 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297298 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="config-reloader" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297313 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="config-reloader" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297324 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="init-config-reloader" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297348 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="init-config-reloader" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297359 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="thanos-sidecar" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297364 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="thanos-sidecar" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297371 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy" May 21 14:45:33.297376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297378 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297385 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="prometheus" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297390 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="prometheus" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297396 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297401 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297407 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-thanos" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297412 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-thanos" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297423 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-web" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297428 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-web" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297475 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-web" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297481 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="config-reloader" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297487 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy-thanos" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297494 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="prometheus" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297499 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="thanos-sidecar" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297508 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" containerName="kube-rbac-proxy" May 21 14:45:33.297596 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.297515 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="362e7f07-ba61-4b18-b903-51fb02bb5c65" containerName="registry" May 21 14:45:33.303017 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.303001 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.305905 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.305887 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:45:33.305996 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.305981 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:45:33.306067 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306039 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t4bdq\"" May 21 14:45:33.306289 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306268 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:45:33.306289 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306285 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-edeh7u3s5i4u3\"" May 21 14:45:33.306461 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306311 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:45:33.306603 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306586 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:45:33.306644 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.306612 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:45:33.307446 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.307431 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:45:33.307705 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.307686 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:45:33.307705 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.307695 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:45:33.307850 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.307698 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:45:33.311256 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.311236 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:45:33.312691 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.312650 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:45:33.315155 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.315134 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:33.401428 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-config-out\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-web-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqcc\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-kube-api-access-wcqcc\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.401831 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402002 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402002 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402002 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402125 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.401944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402125 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.402050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402125 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.402105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.402159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.402196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.402357 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.402251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.407933 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.407896 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398aac98-e035-4b72-876c-9f7c1ae642dc" path="/var/lib/kubelet/pods/398aac98-e035-4b72-876c-9f7c1ae642dc/volumes" May 21 14:45:33.503390 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503254 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503390 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503306 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503415 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503500 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503551 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503579 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503636 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503660 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503687 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503755 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-config-out\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503797 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503821 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-web-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqcc\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-kube-api-access-wcqcc\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503876 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503913 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.503946 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503939 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.504629 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503967 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.504629 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.503993 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.504629 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.504228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.504629 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.504254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.504999 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.504647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.505539 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.505514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.506871 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.506824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.507160 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.507137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.507506 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.507374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-config-out\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.507956 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.507927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.508040 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.507929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.508277 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.508250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/df147e4e-35e7-405a-ae96-a5f22e324e66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.508424 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.508400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.508956 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.508930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.509391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.509368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.509634 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.509617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.509693 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.509673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.509910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.509895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-web-config\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.510808 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.510792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/df147e4e-35e7-405a-ae96-a5f22e324e66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.517090 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.517065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqcc\" (UniqueName: \"kubernetes.io/projected/df147e4e-35e7-405a-ae96-a5f22e324e66-kube-api-access-wcqcc\") pod \"prometheus-k8s-0\" (UID: \"df147e4e-35e7-405a-ae96-a5f22e324e66\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.612927 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.612880 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:45:33.752462 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:33.752428 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:45:33.755596 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:45:33.755565 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf147e4e_35e7_405a_ae96_a5f22e324e66.slice/crio-d5661310f87c80f8c6bb79c8176a7bec6a04e1fe878abea54e032a90c1813806 WatchSource:0}: Error finding container d5661310f87c80f8c6bb79c8176a7bec6a04e1fe878abea54e032a90c1813806: Status 404 returned error can't find the container with id d5661310f87c80f8c6bb79c8176a7bec6a04e1fe878abea54e032a90c1813806 May 21 14:45:34.236972 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:34.236937 2563 generic.go:358] "Generic (PLEG): container finished" podID="df147e4e-35e7-405a-ae96-a5f22e324e66" containerID="f77d49972aa415230154541a5e52fb2a8e764db644e8da3785f3c6eb49b25fca" exitCode=0 May 21 14:45:34.236972 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:34.236977 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerDied","Data":"f77d49972aa415230154541a5e52fb2a8e764db644e8da3785f3c6eb49b25fca"} May 21 14:45:34.237195 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:34.237000 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"d5661310f87c80f8c6bb79c8176a7bec6a04e1fe878abea54e032a90c1813806"} May 21 14:45:35.242736 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242697 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"1aefbe096507642f9826f37d6f976f4238cfb2af5018a62ec997f11482e94be2"} May 21 14:45:35.242736 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242737 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"37749afab28957c0360c082c9cb91f9a99b9064b9ab3d25d5d5e71c91a9eda16"} May 21 14:45:35.243173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242746 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"cc2efe6fa4b89908d26d0705b8e15fdfebe07d81b03ef5c536fbcdb9bff8be87"} May 21 14:45:35.243173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242755 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"bd08746c632c25f9f521f6e4742af4fb5a3bc33dd05bfb33396fb066ba19ad6a"} May 21 14:45:35.243173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242763 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"46c6ac63701f6666c5c7981f39c5f330c6e0bab65ac0dd601be56378eb04eec4"} May 21 14:45:35.243173 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.242774 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"df147e4e-35e7-405a-ae96-a5f22e324e66","Type":"ContainerStarted","Data":"5132d67b891570440eae03d4e02b56a2f13e96aec4c1535f14a81b01619a0736"} May 21 14:45:35.270135 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:35.270073 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.270052202 podStartE2EDuration="2.270052202s" podCreationTimestamp="2026-05-21 14:45:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:45:35.269068363 +0000 UTC m=+210.521356116" watchObservedRunningTime="2026-05-21 14:45:35.270052202 +0000 UTC m=+210.522339932" May 21 14:45:38.613726 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:45:38.613683 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:46:00.222503 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.222467 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gj56w"] May 21 14:46:00.225895 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.225869 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.228859 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.228836 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:46:00.233771 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.233752 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gj56w"] May 21 14:46:00.242865 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.242832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-dbus\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.242981 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.242911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-original-pull-secret\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.243032 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.243001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-kubelet-config\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.344051 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.344015 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-dbus\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.344227 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.344077 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-original-pull-secret\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.344227 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.344146 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-kubelet-config\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.344227 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.344216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-dbus\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.344376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.344221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-kubelet-config\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.346569 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.346546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b843c3c-db3e-4945-a8cc-2a89cd4d70ce-original-pull-secret\") pod \"global-pull-secret-syncer-gj56w\" (UID: \"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce\") " pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.536305 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.536214 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gj56w" May 21 14:46:00.677519 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:00.677492 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gj56w"] May 21 14:46:00.679915 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:46:00.679883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b843c3c_db3e_4945_a8cc_2a89cd4d70ce.slice/crio-197c3f51a4454d6357533e182b77ad0a7e7d19aa0917f7501dad062fa2829333 WatchSource:0}: Error finding container 197c3f51a4454d6357533e182b77ad0a7e7d19aa0917f7501dad062fa2829333: Status 404 returned error can't find the container with id 197c3f51a4454d6357533e182b77ad0a7e7d19aa0917f7501dad062fa2829333 May 21 14:46:01.320911 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:01.320876 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gj56w" event={"ID":"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce","Type":"ContainerStarted","Data":"197c3f51a4454d6357533e182b77ad0a7e7d19aa0917f7501dad062fa2829333"} May 21 14:46:05.334658 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:05.334618 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gj56w" event={"ID":"5b843c3c-db3e-4945-a8cc-2a89cd4d70ce","Type":"ContainerStarted","Data":"7129184d5bfdc1226edbf8396d46fd863b5b58348270d46b18e53ef6bfbb6c89"} May 21 14:46:05.349106 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:05.349051 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gj56w" podStartSLOduration=1.110048674 podStartE2EDuration="5.349032628s" podCreationTimestamp="2026-05-21 14:46:00 +0000 UTC" firstStartedPulling="2026-05-21 14:46:00.681574145 +0000 UTC m=+235.933861861" lastFinishedPulling="2026-05-21 14:46:04.920558108 +0000 UTC m=+240.172845815" observedRunningTime="2026-05-21 14:46:05.347883813 +0000 UTC m=+240.600171541" watchObservedRunningTime="2026-05-21 14:46:05.349032628 +0000 UTC m=+240.601320388" May 21 14:46:33.613363 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:33.613297 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:46:33.630128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:33.630096 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:46:34.438749 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:34.438723 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:46:45.879566 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.879525 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ckqc5"] May 21 14:46:45.882826 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.882802 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:45.885431 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.885408 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vwchx\"" May 21 14:46:45.885552 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.885408 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 14:46:45.886559 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.886541 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 14:46:45.889630 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.889608 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ckqc5"] May 21 14:46:45.942211 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.942175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:45.942444 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:45.942253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bmz8\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-kube-api-access-9bmz8\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.043315 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.043278 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.043537 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.043359 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bmz8\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-kube-api-access-9bmz8\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.051442 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.051408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.051639 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.051619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bmz8\" (UniqueName: \"kubernetes.io/projected/58c3b28a-456a-4218-ae1d-61efd615bffb-kube-api-access-9bmz8\") pod \"cert-manager-cainjector-68b757865b-ckqc5\" (UID: \"58c3b28a-456a-4218-ae1d-61efd615bffb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.204608 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.204512 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" May 21 14:46:46.338268 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.338239 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ckqc5"] May 21 14:46:46.340959 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:46:46.340926 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58c3b28a_456a_4218_ae1d_61efd615bffb.slice/crio-43df12da881e7a30135c41f8a83a06412d0b3aae594d609eda41364a941b5a7c WatchSource:0}: Error finding container 43df12da881e7a30135c41f8a83a06412d0b3aae594d609eda41364a941b5a7c: Status 404 returned error can't find the container with id 43df12da881e7a30135c41f8a83a06412d0b3aae594d609eda41364a941b5a7c May 21 14:46:46.463665 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:46.463593 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" event={"ID":"58c3b28a-456a-4218-ae1d-61efd615bffb","Type":"ContainerStarted","Data":"43df12da881e7a30135c41f8a83a06412d0b3aae594d609eda41364a941b5a7c"} May 21 14:46:50.476625 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:50.476590 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" event={"ID":"58c3b28a-456a-4218-ae1d-61efd615bffb","Type":"ContainerStarted","Data":"886551c6908e804f6a22f19fd9d32fc05e0def0c3709ab7aa2ebc175a75c6f50"} May 21 14:46:50.494107 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:46:50.494047 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-ckqc5" podStartSLOduration=2.41100125 podStartE2EDuration="5.494032521s" podCreationTimestamp="2026-05-21 14:46:45 +0000 UTC" firstStartedPulling="2026-05-21 14:46:46.342783936 +0000 UTC m=+281.595071644" lastFinishedPulling="2026-05-21 14:46:49.425815208 +0000 UTC m=+284.678102915" observedRunningTime="2026-05-21 14:46:50.493001153 +0000 UTC m=+285.745288883" watchObservedRunningTime="2026-05-21 14:46:50.494032521 +0000 UTC m=+285.746320250" May 21 14:47:05.287894 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:05.287868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:47:05.287894 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:05.287884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:47:05.292468 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:05.292448 2563 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:47:18.733356 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.733302 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl"] May 21 14:47:18.735533 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.735511 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.741989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.741711 2563 status_manager.go:895] "Failed to get status for pod" podUID="2c9faf26-0e26-43d0-8274-cdbdbce0010b" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" err="pods \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" May 21 14:47:18.742450 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:47:18.742420 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-b79wj\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b79wj\"" type="*v1.Secret" May 21 14:47:18.742450 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.742446 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:47:18.742996 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.742978 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:47:18.743098 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.743006 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:47:18.743842 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.743819 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:47:18.769179 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.769140 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl"] May 21 14:47:18.844958 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.844912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.845134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.844969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.845134 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.845082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vf47\" (UniqueName: \"kubernetes.io/projected/2c9faf26-0e26-43d0-8274-cdbdbce0010b-kube-api-access-6vf47\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.946591 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.946549 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.946761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.946646 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vf47\" (UniqueName: \"kubernetes.io/projected/2c9faf26-0e26-43d0-8274-cdbdbce0010b-kube-api-access-6vf47\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.946761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.946704 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.949278 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.949250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.949278 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.949266 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c9faf26-0e26-43d0-8274-cdbdbce0010b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:18.954098 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:18.954067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vf47\" (UniqueName: \"kubernetes.io/projected/2c9faf26-0e26-43d0-8274-cdbdbce0010b-kube-api-access-6vf47\") pod \"opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl\" (UID: \"2c9faf26-0e26-43d0-8274-cdbdbce0010b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:19.549861 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.549829 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b79wj\"" May 21 14:47:19.556009 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.555984 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:19.705899 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.705863 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl"] May 21 14:47:19.714691 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.713270 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:47:19.746219 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.746183 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq"] May 21 14:47:19.749777 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.749752 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.753244 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753220 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 14:47:19.753415 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753227 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 14:47:19.753415 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753300 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:47:19.753565 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753413 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-klz7w\"" May 21 14:47:19.753565 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753443 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 14:47:19.753701 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.753573 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:47:19.760668 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.760642 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq"] May 21 14:47:19.853848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.853759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-metrics-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.853848 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.853797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.854028 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.853852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08a7c898-b83d-44d4-a2e3-c8073380e55b-manager-config\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.854028 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.853948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lmm7\" (UniqueName: \"kubernetes.io/projected/08a7c898-b83d-44d4-a2e3-c8073380e55b-kube-api-access-6lmm7\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.955201 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.955161 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08a7c898-b83d-44d4-a2e3-c8073380e55b-manager-config\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.955400 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.955217 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lmm7\" (UniqueName: \"kubernetes.io/projected/08a7c898-b83d-44d4-a2e3-c8073380e55b-kube-api-access-6lmm7\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.955400 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.955250 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-metrics-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.955400 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.955272 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.955920 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.955891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08a7c898-b83d-44d4-a2e3-c8073380e55b-manager-config\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.957879 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.957850 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.957969 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.957892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a7c898-b83d-44d4-a2e3-c8073380e55b-metrics-cert\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:19.967602 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:19.967568 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lmm7\" (UniqueName: \"kubernetes.io/projected/08a7c898-b83d-44d4-a2e3-c8073380e55b-kube-api-access-6lmm7\") pod \"lws-controller-manager-99c58c8b8-wfjcq\" (UID: \"08a7c898-b83d-44d4-a2e3-c8073380e55b\") " pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:20.062279 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:20.062201 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:20.244436 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:20.244306 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq"] May 21 14:47:20.247223 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:47:20.247184 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a7c898_b83d_44d4_a2e3_c8073380e55b.slice/crio-244fe0d10d65f5b31c53d4a071aae6363437083a615d828c030047be3414a383 WatchSource:0}: Error finding container 244fe0d10d65f5b31c53d4a071aae6363437083a615d828c030047be3414a383: Status 404 returned error can't find the container with id 244fe0d10d65f5b31c53d4a071aae6363437083a615d828c030047be3414a383 May 21 14:47:20.567095 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:20.567054 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" event={"ID":"2c9faf26-0e26-43d0-8274-cdbdbce0010b","Type":"ContainerStarted","Data":"460f551cef7c7c8484ee4873c5399571d23bb1175655114d499c2e5f5e27b19d"} May 21 14:47:20.568519 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:20.568461 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" event={"ID":"08a7c898-b83d-44d4-a2e3-c8073380e55b","Type":"ContainerStarted","Data":"244fe0d10d65f5b31c53d4a071aae6363437083a615d828c030047be3414a383"} May 21 14:47:22.577286 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:22.577248 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" event={"ID":"2c9faf26-0e26-43d0-8274-cdbdbce0010b","Type":"ContainerStarted","Data":"959d5dbd9efd7161b4b2b61d0f729812efce2399f2a472778ec30c73e6eb3ecf"} May 21 14:47:22.577781 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:22.577394 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:22.600413 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:22.600349 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" podStartSLOduration=2.225208905 podStartE2EDuration="4.600313738s" podCreationTimestamp="2026-05-21 14:47:18 +0000 UTC" firstStartedPulling="2026-05-21 14:47:19.7134745 +0000 UTC m=+314.965762221" lastFinishedPulling="2026-05-21 14:47:22.088579333 +0000 UTC m=+317.340867054" observedRunningTime="2026-05-21 14:47:22.598414842 +0000 UTC m=+317.850702572" watchObservedRunningTime="2026-05-21 14:47:22.600313738 +0000 UTC m=+317.852601469" May 21 14:47:24.585500 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:24.585455 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" event={"ID":"08a7c898-b83d-44d4-a2e3-c8073380e55b","Type":"ContainerStarted","Data":"d3c20b2ec8812763b067ff0a48605c85e58ee56b20a934d21cad8ab71b3214ca"} May 21 14:47:24.585882 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:24.585584 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:24.601124 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:24.601069 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" podStartSLOduration=1.9256759209999998 podStartE2EDuration="5.601053348s" podCreationTimestamp="2026-05-21 14:47:19 +0000 UTC" firstStartedPulling="2026-05-21 14:47:20.249856588 +0000 UTC m=+315.502144308" lastFinishedPulling="2026-05-21 14:47:23.925234029 +0000 UTC m=+319.177521735" observedRunningTime="2026-05-21 14:47:24.600292646 +0000 UTC m=+319.852580376" watchObservedRunningTime="2026-05-21 14:47:24.601053348 +0000 UTC m=+319.853341081" May 21 14:47:33.584008 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:33.583971 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl" May 21 14:47:35.591216 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:35.591185 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-99c58c8b8-wfjcq" May 21 14:47:36.248445 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.248408 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4"] May 21 14:47:36.252415 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.252393 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.256274 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.256252 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:47:36.256421 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.256279 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:47:36.256421 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.256279 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rpsjs\"" May 21 14:47:36.256585 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.256446 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:47:36.256626 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.256597 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:47:36.262568 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.262543 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4"] May 21 14:47:36.300765 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.300731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79f46f02-d125-437a-af19-a88a3af4c2bf-tmp\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.300965 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.300865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79f46f02-d125-437a-af19-a88a3af4c2bf-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.300965 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.300913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9k97\" (UniqueName: \"kubernetes.io/projected/79f46f02-d125-437a-af19-a88a3af4c2bf-kube-api-access-b9k97\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.401322 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.401283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79f46f02-d125-437a-af19-a88a3af4c2bf-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.401322 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.401353 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k97\" (UniqueName: \"kubernetes.io/projected/79f46f02-d125-437a-af19-a88a3af4c2bf-kube-api-access-b9k97\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.401592 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.401532 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79f46f02-d125-437a-af19-a88a3af4c2bf-tmp\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.403841 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.403804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79f46f02-d125-437a-af19-a88a3af4c2bf-tmp\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.403998 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.403983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79f46f02-d125-437a-af19-a88a3af4c2bf-tls-certs\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.410512 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.410476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k97\" (UniqueName: \"kubernetes.io/projected/79f46f02-d125-437a-af19-a88a3af4c2bf-kube-api-access-b9k97\") pod \"kube-auth-proxy-74bcf6bb97-7cwp4\" (UID: \"79f46f02-d125-437a-af19-a88a3af4c2bf\") " pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.563592 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.563555 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" May 21 14:47:36.694001 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:36.693950 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4"] May 21 14:47:36.696551 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:47:36.696525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f46f02_d125_437a_af19_a88a3af4c2bf.slice/crio-9c50899cfbfebd1fdb1d578c39cc2a59c81a3148813581ef311716a98a3f30e0 WatchSource:0}: Error finding container 9c50899cfbfebd1fdb1d578c39cc2a59c81a3148813581ef311716a98a3f30e0: Status 404 returned error can't find the container with id 9c50899cfbfebd1fdb1d578c39cc2a59c81a3148813581ef311716a98a3f30e0 May 21 14:47:37.631551 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:37.631496 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" event={"ID":"79f46f02-d125-437a-af19-a88a3af4c2bf","Type":"ContainerStarted","Data":"9c50899cfbfebd1fdb1d578c39cc2a59c81a3148813581ef311716a98a3f30e0"} May 21 14:47:39.639391 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:39.639311 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" event={"ID":"79f46f02-d125-437a-af19-a88a3af4c2bf","Type":"ContainerStarted","Data":"57edcdc411a970d013a5e3a4857eed769319bd3539121e4b4333b7024e2a418d"} May 21 14:47:39.656428 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:47:39.656377 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74bcf6bb97-7cwp4" podStartSLOduration=1.094682774 podStartE2EDuration="3.656362697s" podCreationTimestamp="2026-05-21 14:47:36 +0000 UTC" firstStartedPulling="2026-05-21 14:47:36.698828624 +0000 UTC m=+331.951116330" lastFinishedPulling="2026-05-21 14:47:39.260508542 +0000 UTC m=+334.512796253" observedRunningTime="2026-05-21 14:47:39.654451001 +0000 UTC m=+334.906738731" watchObservedRunningTime="2026-05-21 14:47:39.656362697 +0000 UTC m=+334.908650425" May 21 14:49:12.424541 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.424460 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4"] May 21 14:49:12.427748 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.427731 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:12.430417 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.430390 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:49:12.431488 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.431456 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:49:12.431488 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.431484 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9xzd4\"" May 21 14:49:12.440537 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.440514 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4"] May 21 14:49:12.441060 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.441033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnzv\" (UniqueName: \"kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv\") pod \"limitador-operator-controller-manager-85c4996f8c-bm2r4\" (UID: \"7e97ef4a-20cf-43fa-96a1-920f282e30ef\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:12.541675 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.541634 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnzv\" (UniqueName: \"kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv\") pod \"limitador-operator-controller-manager-85c4996f8c-bm2r4\" (UID: \"7e97ef4a-20cf-43fa-96a1-920f282e30ef\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:12.550312 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.550269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnzv\" (UniqueName: \"kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv\") pod \"limitador-operator-controller-manager-85c4996f8c-bm2r4\" (UID: \"7e97ef4a-20cf-43fa-96a1-920f282e30ef\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:12.737792 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.737703 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:12.869011 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.868985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4"] May 21 14:49:12.871729 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:49:12.871700 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e97ef4a_20cf_43fa_96a1_920f282e30ef.slice/crio-8110d617c940313261829cfa1bae4b6a13522bcc762e786cb26b01bcc82c2d20 WatchSource:0}: Error finding container 8110d617c940313261829cfa1bae4b6a13522bcc762e786cb26b01bcc82c2d20: Status 404 returned error can't find the container with id 8110d617c940313261829cfa1bae4b6a13522bcc762e786cb26b01bcc82c2d20 May 21 14:49:12.948266 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:12.948232 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" event={"ID":"7e97ef4a-20cf-43fa-96a1-920f282e30ef","Type":"ContainerStarted","Data":"8110d617c940313261829cfa1bae4b6a13522bcc762e786cb26b01bcc82c2d20"} May 21 14:49:14.956413 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:14.956310 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" event={"ID":"7e97ef4a-20cf-43fa-96a1-920f282e30ef","Type":"ContainerStarted","Data":"06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a"} May 21 14:49:14.956774 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:14.956442 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:14.972950 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:14.972894 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" podStartSLOduration=1.194137418 podStartE2EDuration="2.972877888s" podCreationTimestamp="2026-05-21 14:49:12 +0000 UTC" firstStartedPulling="2026-05-21 14:49:12.873824031 +0000 UTC m=+428.126111739" lastFinishedPulling="2026-05-21 14:49:14.652564502 +0000 UTC m=+429.904852209" observedRunningTime="2026-05-21 14:49:14.97253194 +0000 UTC m=+430.224819668" watchObservedRunningTime="2026-05-21 14:49:14.972877888 +0000 UTC m=+430.225165618" May 21 14:49:25.962030 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:25.961997 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:28.902605 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.902574 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4"] May 21 14:49:28.902995 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.902810 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" containerName="manager" containerID="cri-o://06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a" gracePeriod=2 May 21 14:49:28.915249 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.915215 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4"] May 21 14:49:28.926789 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.926754 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn"] May 21 14:49:28.927182 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.927167 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" containerName="manager" May 21 14:49:28.927226 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.927185 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" containerName="manager" May 21 14:49:28.927259 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.927251 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" containerName="manager" May 21 14:49:28.930210 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.930193 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:28.941143 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.941115 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn"] May 21 14:49:28.958861 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.958823 2563 status_manager.go:895] "Failed to get status for pod" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" err="pods \"limitador-operator-controller-manager-85c4996f8c-bm2r4\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" May 21 14:49:28.980981 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:28.980943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vlc\" (UniqueName: \"kubernetes.io/projected/e6f02350-3621-4b3a-9d8d-f1dd46d42d3c-kube-api-access-c5vlc\") pod \"limitador-operator-controller-manager-85c4996f8c-2mbfn\" (UID: \"e6f02350-3621-4b3a-9d8d-f1dd46d42d3c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:29.081961 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.081921 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vlc\" (UniqueName: \"kubernetes.io/projected/e6f02350-3621-4b3a-9d8d-f1dd46d42d3c-kube-api-access-c5vlc\") pod \"limitador-operator-controller-manager-85c4996f8c-2mbfn\" (UID: \"e6f02350-3621-4b3a-9d8d-f1dd46d42d3c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:29.099048 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.099021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vlc\" (UniqueName: \"kubernetes.io/projected/e6f02350-3621-4b3a-9d8d-f1dd46d42d3c-kube-api-access-c5vlc\") pod \"limitador-operator-controller-manager-85c4996f8c-2mbfn\" (UID: \"e6f02350-3621-4b3a-9d8d-f1dd46d42d3c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:29.136998 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.136969 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:29.139432 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.139401 2563 status_manager.go:895] "Failed to get status for pod" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" err="pods \"limitador-operator-controller-manager-85c4996f8c-bm2r4\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" May 21 14:49:29.182548 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.182464 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmnzv\" (UniqueName: \"kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv\") pod \"7e97ef4a-20cf-43fa-96a1-920f282e30ef\" (UID: \"7e97ef4a-20cf-43fa-96a1-920f282e30ef\") " May 21 14:49:29.184814 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.184785 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv" (OuterVolumeSpecName: "kube-api-access-dmnzv") pod "7e97ef4a-20cf-43fa-96a1-920f282e30ef" (UID: "7e97ef4a-20cf-43fa-96a1-920f282e30ef"). InnerVolumeSpecName "kube-api-access-dmnzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:49:29.283589 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.283553 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmnzv\" (UniqueName: \"kubernetes.io/projected/7e97ef4a-20cf-43fa-96a1-920f282e30ef-kube-api-access-dmnzv\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:49:29.290461 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.290411 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:29.406227 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.406196 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" path="/var/lib/kubelet/pods/7e97ef4a-20cf-43fa-96a1-920f282e30ef/volumes" May 21 14:49:29.437928 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:29.437903 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn"] May 21 14:49:29.439811 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:49:29.439774 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f02350_3621_4b3a_9d8d_f1dd46d42d3c.slice/crio-3cd7ee8d29c707771c0daf78148af99204109b18fb68d50a4291253f05f3e0ba WatchSource:0}: Error finding container 3cd7ee8d29c707771c0daf78148af99204109b18fb68d50a4291253f05f3e0ba: Status 404 returned error can't find the container with id 3cd7ee8d29c707771c0daf78148af99204109b18fb68d50a4291253f05f3e0ba May 21 14:49:30.008969 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.008928 2563 generic.go:358] "Generic (PLEG): container finished" podID="7e97ef4a-20cf-43fa-96a1-920f282e30ef" containerID="06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a" exitCode=0 May 21 14:49:30.009418 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.008982 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bm2r4" May 21 14:49:30.009418 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.009024 2563 scope.go:117] "RemoveContainer" containerID="06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a" May 21 14:49:30.010746 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.010711 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" event={"ID":"e6f02350-3621-4b3a-9d8d-f1dd46d42d3c","Type":"ContainerStarted","Data":"f3ce84c2c46b6d57ea25e8c9e8b026cfbc1ead36ed4a42bc8b0e3d3429563451"} May 21 14:49:30.010857 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.010753 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" event={"ID":"e6f02350-3621-4b3a-9d8d-f1dd46d42d3c","Type":"ContainerStarted","Data":"3cd7ee8d29c707771c0daf78148af99204109b18fb68d50a4291253f05f3e0ba"} May 21 14:49:30.010932 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.010902 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:49:30.017524 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.017509 2563 scope.go:117] "RemoveContainer" containerID="06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a" May 21 14:49:30.017806 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:49:30.017791 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a\": container with ID starting with 06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a not found: ID does not exist" containerID="06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a" May 21 14:49:30.017860 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.017813 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a"} err="failed to get container status \"06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a\": rpc error: code = NotFound desc = could not find container \"06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a\": container with ID starting with 06d2de6724c754d63545730884adebbc0895fa98e62eab60595f5db39ef1fd9a not found: ID does not exist" May 21 14:49:30.028462 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:30.028416 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" podStartSLOduration=2.028401368 podStartE2EDuration="2.028401368s" podCreationTimestamp="2026-05-21 14:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:49:30.027258181 +0000 UTC m=+445.279545909" watchObservedRunningTime="2026-05-21 14:49:30.028401368 +0000 UTC m=+445.280689094" May 21 14:49:41.017760 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:49:41.017725 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2mbfn" May 21 14:50:13.298039 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.298003 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:13.301550 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.301531 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:13.304437 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.304412 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4ftdk\"" May 21 14:50:13.309272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.309249 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:13.366323 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.366283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j24jt\" (UniqueName: \"kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt\") pod \"authorino-f99f4b5cd-hd6qc\" (UID: \"6d909cef-b603-4687-aa1d-ce4a25c7153a\") " pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:13.467684 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.467635 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j24jt\" (UniqueName: \"kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt\") pod \"authorino-f99f4b5cd-hd6qc\" (UID: \"6d909cef-b603-4687-aa1d-ce4a25c7153a\") " pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:13.477291 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.477247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j24jt\" (UniqueName: \"kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt\") pod \"authorino-f99f4b5cd-hd6qc\" (UID: \"6d909cef-b603-4687-aa1d-ce4a25c7153a\") " pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:13.487762 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.487732 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:13.490891 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.490873 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:13.494802 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.494777 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:13.569217 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.569121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkdv\" (UniqueName: \"kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv\") pod \"authorino-7498df8756-888wz\" (UID: \"f004a167-dbc1-43d7-8a44-f79cd8b5259e\") " pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:13.611929 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.611875 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:13.674127 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.669987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkdv\" (UniqueName: \"kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv\") pod \"authorino-7498df8756-888wz\" (UID: \"f004a167-dbc1-43d7-8a44-f79cd8b5259e\") " pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:13.691521 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.691488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkdv\" (UniqueName: \"kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv\") pod \"authorino-7498df8756-888wz\" (UID: \"f004a167-dbc1-43d7-8a44-f79cd8b5259e\") " pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:13.758396 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.758326 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:13.760955 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:50:13.760928 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d909cef_b603_4687_aa1d_ce4a25c7153a.slice/crio-98aeff634ef17357a2200a78a635dd60b88f226f54d567b4110ae875ce1c1577 WatchSource:0}: Error finding container 98aeff634ef17357a2200a78a635dd60b88f226f54d567b4110ae875ce1c1577: Status 404 returned error can't find the container with id 98aeff634ef17357a2200a78a635dd60b88f226f54d567b4110ae875ce1c1577 May 21 14:50:13.801709 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.801677 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:13.933851 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:13.933824 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:13.936259 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:50:13.936226 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf004a167_dbc1_43d7_8a44_f79cd8b5259e.slice/crio-858d422a3c2774b0cfe44f6b2104cad6005f91df3575fe40f4ac4d262c7f1f93 WatchSource:0}: Error finding container 858d422a3c2774b0cfe44f6b2104cad6005f91df3575fe40f4ac4d262c7f1f93: Status 404 returned error can't find the container with id 858d422a3c2774b0cfe44f6b2104cad6005f91df3575fe40f4ac4d262c7f1f93 May 21 14:50:14.158991 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:14.158897 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" event={"ID":"6d909cef-b603-4687-aa1d-ce4a25c7153a","Type":"ContainerStarted","Data":"98aeff634ef17357a2200a78a635dd60b88f226f54d567b4110ae875ce1c1577"} May 21 14:50:14.159893 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:14.159866 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-888wz" event={"ID":"f004a167-dbc1-43d7-8a44-f79cd8b5259e","Type":"ContainerStarted","Data":"858d422a3c2774b0cfe44f6b2104cad6005f91df3575fe40f4ac4d262c7f1f93"} May 21 14:50:18.177138 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:18.177093 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" event={"ID":"6d909cef-b603-4687-aa1d-ce4a25c7153a","Type":"ContainerStarted","Data":"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23"} May 21 14:50:18.178469 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:18.178440 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-888wz" event={"ID":"f004a167-dbc1-43d7-8a44-f79cd8b5259e","Type":"ContainerStarted","Data":"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb"} May 21 14:50:18.192374 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:18.192307 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" podStartSLOduration=1.6752661899999999 podStartE2EDuration="5.192292062s" podCreationTimestamp="2026-05-21 14:50:13 +0000 UTC" firstStartedPulling="2026-05-21 14:50:13.762541589 +0000 UTC m=+489.014829295" lastFinishedPulling="2026-05-21 14:50:17.279567454 +0000 UTC m=+492.531855167" observedRunningTime="2026-05-21 14:50:18.191404235 +0000 UTC m=+493.443691964" watchObservedRunningTime="2026-05-21 14:50:18.192292062 +0000 UTC m=+493.444579791" May 21 14:50:18.207141 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:18.207072 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-888wz" podStartSLOduration=1.863148785 podStartE2EDuration="5.207052312s" podCreationTimestamp="2026-05-21 14:50:13 +0000 UTC" firstStartedPulling="2026-05-21 14:50:13.937657394 +0000 UTC m=+489.189945101" lastFinishedPulling="2026-05-21 14:50:17.281560919 +0000 UTC m=+492.533848628" observedRunningTime="2026-05-21 14:50:18.204862913 +0000 UTC m=+493.457150644" watchObservedRunningTime="2026-05-21 14:50:18.207052312 +0000 UTC m=+493.459340043" May 21 14:50:18.230117 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:18.230078 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:20.186053 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:20.186012 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" podUID="6d909cef-b603-4687-aa1d-ce4a25c7153a" containerName="authorino" containerID="cri-o://d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23" gracePeriod=30 May 21 14:50:20.431735 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:20.431710 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:20.537417 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:20.537289 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j24jt\" (UniqueName: \"kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt\") pod \"6d909cef-b603-4687-aa1d-ce4a25c7153a\" (UID: \"6d909cef-b603-4687-aa1d-ce4a25c7153a\") " May 21 14:50:20.539524 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:20.539487 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt" (OuterVolumeSpecName: "kube-api-access-j24jt") pod "6d909cef-b603-4687-aa1d-ce4a25c7153a" (UID: "6d909cef-b603-4687-aa1d-ce4a25c7153a"). InnerVolumeSpecName "kube-api-access-j24jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:20.638691 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:20.638647 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j24jt\" (UniqueName: \"kubernetes.io/projected/6d909cef-b603-4687-aa1d-ce4a25c7153a-kube-api-access-j24jt\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:50:21.190667 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.190632 2563 generic.go:358] "Generic (PLEG): container finished" podID="6d909cef-b603-4687-aa1d-ce4a25c7153a" containerID="d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23" exitCode=0 May 21 14:50:21.191101 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.190676 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" event={"ID":"6d909cef-b603-4687-aa1d-ce4a25c7153a","Type":"ContainerDied","Data":"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23"} May 21 14:50:21.191101 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.190681 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" May 21 14:50:21.191101 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.190699 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-hd6qc" event={"ID":"6d909cef-b603-4687-aa1d-ce4a25c7153a","Type":"ContainerDied","Data":"98aeff634ef17357a2200a78a635dd60b88f226f54d567b4110ae875ce1c1577"} May 21 14:50:21.191101 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.190714 2563 scope.go:117] "RemoveContainer" containerID="d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23" May 21 14:50:21.199219 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.199202 2563 scope.go:117] "RemoveContainer" containerID="d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23" May 21 14:50:21.199477 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:50:21.199458 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23\": container with ID starting with d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23 not found: ID does not exist" containerID="d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23" May 21 14:50:21.199532 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.199486 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23"} err="failed to get container status \"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23\": rpc error: code = NotFound desc = could not find container \"d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23\": container with ID starting with d65a7a219035873a2cdcd3c4cbff9b0a54fe0f660e7026ce0e912cffb20f6c23 not found: ID does not exist" May 21 14:50:21.210926 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.210897 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:21.214383 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.214362 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-hd6qc"] May 21 14:50:21.403008 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:21.402976 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d909cef-b603-4687-aa1d-ce4a25c7153a" path="/var/lib/kubelet/pods/6d909cef-b603-4687-aa1d-ce4a25c7153a/volumes" May 21 14:50:46.036491 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.036449 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-f6c27"] May 21 14:50:46.036913 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.036824 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d909cef-b603-4687-aa1d-ce4a25c7153a" containerName="authorino" May 21 14:50:46.036913 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.036836 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d909cef-b603-4687-aa1d-ce4a25c7153a" containerName="authorino" May 21 14:50:46.036913 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.036898 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d909cef-b603-4687-aa1d-ce4a25c7153a" containerName="authorino" May 21 14:50:46.039869 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.039851 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.046031 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.046002 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-f6c27"] May 21 14:50:46.168178 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.168145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ck7n\" (UniqueName: \"kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n\") pod \"authorino-8b475cf9f-f6c27\" (UID: \"6887ffef-aa5a-4b57-80cf-841971d2da97\") " pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.213261 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.213217 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-f6c27"] May 21 14:50:46.213503 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:50:46.213483 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2ck7n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-f6c27" podUID="6887ffef-aa5a-4b57-80cf-841971d2da97" May 21 14:50:46.239773 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.239735 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2mxpt"] May 21 14:50:46.243038 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.243020 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.245459 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.245432 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 14:50:46.248908 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.248876 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2mxpt"] May 21 14:50:46.269086 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.269057 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ck7n\" (UniqueName: \"kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n\") pod \"authorino-8b475cf9f-f6c27\" (UID: \"6887ffef-aa5a-4b57-80cf-841971d2da97\") " pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.276558 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.276531 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.278030 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.278006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ck7n\" (UniqueName: \"kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n\") pod \"authorino-8b475cf9f-f6c27\" (UID: \"6887ffef-aa5a-4b57-80cf-841971d2da97\") " pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.280821 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.280797 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2mxpt"] May 21 14:50:46.281081 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:50:46.281063 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wgflx tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-wgflx tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-2mxpt" podUID="c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad" May 21 14:50:46.289203 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.289144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:46.305811 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.305778 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:50:46.309200 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.309182 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.315266 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.315235 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:50:46.370034 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.369995 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ck7n\" (UniqueName: \"kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n\") pod \"6887ffef-aa5a-4b57-80cf-841971d2da97\" (UID: \"6887ffef-aa5a-4b57-80cf-841971d2da97\") " May 21 14:50:46.370228 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.370133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgflx\" (UniqueName: \"kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.370228 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.370218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.372181 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.372157 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n" (OuterVolumeSpecName: "kube-api-access-2ck7n") pod "6887ffef-aa5a-4b57-80cf-841971d2da97" (UID: "6887ffef-aa5a-4b57-80cf-841971d2da97"). InnerVolumeSpecName "kube-api-access-2ck7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:46.470910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.470864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.470910 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.470919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.471137 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.470958 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgflx\" (UniqueName: \"kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.471137 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.470995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nhb5\" (UniqueName: \"kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.471214 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.471167 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ck7n\" (UniqueName: \"kubernetes.io/projected/6887ffef-aa5a-4b57-80cf-841971d2da97-kube-api-access-2ck7n\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:50:46.473558 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.473522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.478255 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.478230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgflx\" (UniqueName: \"kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx\") pod \"authorino-56fdd757f5-2mxpt\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:46.571656 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.571616 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nhb5\" (UniqueName: \"kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.571833 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.571717 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.574459 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.574428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.580110 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.580086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nhb5\" (UniqueName: \"kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5\") pod \"authorino-84bcd75596-h8626\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.620195 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.620157 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:50:46.752065 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:46.752042 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:50:46.754676 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:50:46.754650 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79c928c8_e495_4dbe_969b_e9b422fdf615.slice/crio-28eb31787beb778c8da48855f869bdc7e70f141cf2206d8dd69438ac69787a55 WatchSource:0}: Error finding container 28eb31787beb778c8da48855f869bdc7e70f141cf2206d8dd69438ac69787a55: Status 404 returned error can't find the container with id 28eb31787beb778c8da48855f869bdc7e70f141cf2206d8dd69438ac69787a55 May 21 14:50:47.281407 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.281372 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bcd75596-h8626" event={"ID":"79c928c8-e495-4dbe-969b-e9b422fdf615","Type":"ContainerStarted","Data":"28eb31787beb778c8da48855f869bdc7e70f141cf2206d8dd69438ac69787a55"} May 21 14:50:47.281765 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.281475 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:47.281765 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.281481 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-f6c27" May 21 14:50:47.296989 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.296965 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:47.318078 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.318045 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-f6c27"] May 21 14:50:47.320083 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.320059 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-f6c27"] May 21 14:50:47.379086 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.379053 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgflx\" (UniqueName: \"kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx\") pod \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " May 21 14:50:47.379220 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.379185 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert\") pod \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\" (UID: \"c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad\") " May 21 14:50:47.381272 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.381240 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx" (OuterVolumeSpecName: "kube-api-access-wgflx") pod "c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad" (UID: "c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad"). InnerVolumeSpecName "kube-api-access-wgflx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:47.381396 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.381380 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad" (UID: "c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:50:47.404133 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.404096 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6887ffef-aa5a-4b57-80cf-841971d2da97" path="/var/lib/kubelet/pods/6887ffef-aa5a-4b57-80cf-841971d2da97/volumes" May 21 14:50:47.480487 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.480456 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-tls-cert\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:50:47.480487 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:47.480484 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgflx\" (UniqueName: \"kubernetes.io/projected/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad-kube-api-access-wgflx\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:50:48.286759 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.286717 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-2mxpt" May 21 14:50:48.286759 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.286725 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bcd75596-h8626" event={"ID":"79c928c8-e495-4dbe-969b-e9b422fdf615","Type":"ContainerStarted","Data":"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4"} May 21 14:50:48.301162 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.301093 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-84bcd75596-h8626" podStartSLOduration=1.7955570600000001 podStartE2EDuration="2.301074872s" podCreationTimestamp="2026-05-21 14:50:46 +0000 UTC" firstStartedPulling="2026-05-21 14:50:46.755995454 +0000 UTC m=+522.008283162" lastFinishedPulling="2026-05-21 14:50:47.261513267 +0000 UTC m=+522.513800974" observedRunningTime="2026-05-21 14:50:48.300977263 +0000 UTC m=+523.553264992" watchObservedRunningTime="2026-05-21 14:50:48.301074872 +0000 UTC m=+523.553362601" May 21 14:50:48.323532 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.323498 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2mxpt"] May 21 14:50:48.330493 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.330462 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:48.330772 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.330743 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-888wz" podUID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" containerName="authorino" containerID="cri-o://5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb" gracePeriod=30 May 21 14:50:48.333124 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.333097 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-2mxpt"] May 21 14:50:48.581474 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.581449 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:48.690638 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.690588 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggkdv\" (UniqueName: \"kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv\") pod \"f004a167-dbc1-43d7-8a44-f79cd8b5259e\" (UID: \"f004a167-dbc1-43d7-8a44-f79cd8b5259e\") " May 21 14:50:48.692937 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.692904 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv" (OuterVolumeSpecName: "kube-api-access-ggkdv") pod "f004a167-dbc1-43d7-8a44-f79cd8b5259e" (UID: "f004a167-dbc1-43d7-8a44-f79cd8b5259e"). InnerVolumeSpecName "kube-api-access-ggkdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:48.791572 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:48.791531 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggkdv\" (UniqueName: \"kubernetes.io/projected/f004a167-dbc1-43d7-8a44-f79cd8b5259e-kube-api-access-ggkdv\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:50:49.291538 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.291505 2563 generic.go:358] "Generic (PLEG): container finished" podID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" containerID="5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb" exitCode=0 May 21 14:50:49.292021 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.291569 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-888wz" May 21 14:50:49.292021 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.291581 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-888wz" event={"ID":"f004a167-dbc1-43d7-8a44-f79cd8b5259e","Type":"ContainerDied","Data":"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb"} May 21 14:50:49.292021 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.291621 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-888wz" event={"ID":"f004a167-dbc1-43d7-8a44-f79cd8b5259e","Type":"ContainerDied","Data":"858d422a3c2774b0cfe44f6b2104cad6005f91df3575fe40f4ac4d262c7f1f93"} May 21 14:50:49.292021 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.291636 2563 scope.go:117] "RemoveContainer" containerID="5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb" May 21 14:50:49.300082 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.300063 2563 scope.go:117] "RemoveContainer" containerID="5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb" May 21 14:50:49.300468 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:50:49.300446 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb\": container with ID starting with 5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb not found: ID does not exist" containerID="5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb" May 21 14:50:49.300549 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.300480 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb"} err="failed to get container status \"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb\": rpc error: code = NotFound desc = could not find container \"5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb\": container with ID starting with 5b70c7b99eacba62d0f0e69c562ecde15290d38967bed226178bb7194bf64feb not found: ID does not exist" May 21 14:50:49.312223 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.312192 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:49.316354 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.316314 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-888wz"] May 21 14:50:49.405794 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.405757 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad" path="/var/lib/kubelet/pods/c6c43a34-d7ff-4ef5-a6f5-5dd0deb742ad/volumes" May 21 14:50:49.405988 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:50:49.405976 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" path="/var/lib/kubelet/pods/f004a167-dbc1-43d7-8a44-f79cd8b5259e/volumes" May 21 14:52:00.186676 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.186635 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh"] May 21 14:52:00.187211 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.187192 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" containerName="authorino" May 21 14:52:00.187254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.187219 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" containerName="authorino" May 21 14:52:00.187346 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.187317 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f004a167-dbc1-43d7-8a44-f79cd8b5259e" containerName="authorino" May 21 14:52:00.190894 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.190873 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.195715 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.195687 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 14:52:00.195925 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.195912 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 14:52:00.196148 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.196129 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 14:52:00.196526 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.196364 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fd8t9\"" May 21 14:52:00.197976 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.197942 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh"] May 21 14:52:00.280175 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.280135 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx"] May 21 14:52:00.283502 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.283482 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.285866 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.285847 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 14:52:00.292022 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.291998 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx"] May 21 14:52:00.309088 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d837fd-b30a-4311-9f04-f77d6fbdd47c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.309254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.309254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.309254 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.309456 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkfw\" (UniqueName: \"kubernetes.io/projected/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kube-api-access-qxkfw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.309456 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.309373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410187 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n82lj\" (UniqueName: \"kubernetes.io/projected/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kube-api-access-n82lj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410205 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410289 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410426 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410523 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkfw\" (UniqueName: \"kubernetes.io/projected/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kube-api-access-qxkfw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410656 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410686 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d837fd-b30a-4311-9f04-f77d6fbdd47c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.410711 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.411020 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.410852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.412748 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.412728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d837fd-b30a-4311-9f04-f77d6fbdd47c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.413231 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.413215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d837fd-b30a-4311-9f04-f77d6fbdd47c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.417865 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.417843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkfw\" (UniqueName: \"kubernetes.io/projected/50d837fd-b30a-4311-9f04-f77d6fbdd47c-kube-api-access-qxkfw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pxthh\" (UID: \"50d837fd-b30a-4311-9f04-f77d6fbdd47c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.502783 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.502698 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:00.511772 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n82lj\" (UniqueName: \"kubernetes.io/projected/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kube-api-access-n82lj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.511851 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511802 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.511911 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511860 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.511911 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511895 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.512071 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511937 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.512071 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.511985 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.512482 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.512449 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.512482 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.512470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.512892 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.512779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.514638 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.514616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.514638 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.514635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.519326 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.519295 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n82lj\" (UniqueName: \"kubernetes.io/projected/8a0b954e-5241-44d0-af9c-04b2fc2e1c7d-kube-api-access-n82lj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx\" (UID: \"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.595183 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.594658 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:00.652677 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.652589 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh"] May 21 14:52:00.655982 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:52:00.655610 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d837fd_b30a_4311_9f04_f77d6fbdd47c.slice/crio-0eabb4df72d08b5bcf8634f549efc31c271fb0536823c5e3bb1e10ba51efca13 WatchSource:0}: Error finding container 0eabb4df72d08b5bcf8634f549efc31c271fb0536823c5e3bb1e10ba51efca13: Status 404 returned error can't find the container with id 0eabb4df72d08b5bcf8634f549efc31c271fb0536823c5e3bb1e10ba51efca13 May 21 14:52:00.737607 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:00.737576 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx"] May 21 14:52:00.739418 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:52:00.739384 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0b954e_5241_44d0_af9c_04b2fc2e1c7d.slice/crio-f12e615e06dfd9d7c1276780a09b5567cde864f358fc53808d1b229f98546b80 WatchSource:0}: Error finding container f12e615e06dfd9d7c1276780a09b5567cde864f358fc53808d1b229f98546b80: Status 404 returned error can't find the container with id f12e615e06dfd9d7c1276780a09b5567cde864f358fc53808d1b229f98546b80 May 21 14:52:01.536185 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:01.536136 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" event={"ID":"50d837fd-b30a-4311-9f04-f77d6fbdd47c","Type":"ContainerStarted","Data":"0eabb4df72d08b5bcf8634f549efc31c271fb0536823c5e3bb1e10ba51efca13"} May 21 14:52:01.537501 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:01.537464 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" event={"ID":"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d","Type":"ContainerStarted","Data":"f12e615e06dfd9d7c1276780a09b5567cde864f358fc53808d1b229f98546b80"} May 21 14:52:05.987522 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:05.987495 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:52:05.988121 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:05.987567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:52:06.560904 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:06.560862 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" event={"ID":"50d837fd-b30a-4311-9f04-f77d6fbdd47c","Type":"ContainerStarted","Data":"9998c31c33fc38235b013941a2e47f8d904ea8506c3a5efa3a6d5e2354628fd2"} May 21 14:52:06.562578 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:06.562548 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" event={"ID":"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d","Type":"ContainerStarted","Data":"a93ec5fbc2396f7b632e6d001f03702c9b9da0734ac2099f245ad700db2eb52f"} May 21 14:52:12.586264 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:12.586223 2563 generic.go:358] "Generic (PLEG): container finished" podID="50d837fd-b30a-4311-9f04-f77d6fbdd47c" containerID="9998c31c33fc38235b013941a2e47f8d904ea8506c3a5efa3a6d5e2354628fd2" exitCode=0 May 21 14:52:12.586690 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:12.586302 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" event={"ID":"50d837fd-b30a-4311-9f04-f77d6fbdd47c","Type":"ContainerDied","Data":"9998c31c33fc38235b013941a2e47f8d904ea8506c3a5efa3a6d5e2354628fd2"} May 21 14:52:12.587900 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:12.587878 2563 generic.go:358] "Generic (PLEG): container finished" podID="8a0b954e-5241-44d0-af9c-04b2fc2e1c7d" containerID="a93ec5fbc2396f7b632e6d001f03702c9b9da0734ac2099f245ad700db2eb52f" exitCode=0 May 21 14:52:12.587984 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:12.587921 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" event={"ID":"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d","Type":"ContainerDied","Data":"a93ec5fbc2396f7b632e6d001f03702c9b9da0734ac2099f245ad700db2eb52f"} May 21 14:52:14.597671 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.597634 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" event={"ID":"50d837fd-b30a-4311-9f04-f77d6fbdd47c","Type":"ContainerStarted","Data":"9d2ef0d61fec45df1838582a9acbaef14cbe74fc89793e37ef5a2f068cda000e"} May 21 14:52:14.598149 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.597892 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:14.599286 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.599263 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" event={"ID":"8a0b954e-5241-44d0-af9c-04b2fc2e1c7d","Type":"ContainerStarted","Data":"45f83ada06d6f498304d8baa1ec7086f8edb1b422b99dce7f9fad391fe6b9892"} May 21 14:52:14.599483 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.599469 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:14.616376 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.616311 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" podStartSLOduration=1.236905443 podStartE2EDuration="14.616298002s" podCreationTimestamp="2026-05-21 14:52:00 +0000 UTC" firstStartedPulling="2026-05-21 14:52:00.65930623 +0000 UTC m=+595.911593940" lastFinishedPulling="2026-05-21 14:52:14.038698789 +0000 UTC m=+609.290986499" observedRunningTime="2026-05-21 14:52:14.614414274 +0000 UTC m=+609.866702004" watchObservedRunningTime="2026-05-21 14:52:14.616298002 +0000 UTC m=+609.868585731" May 21 14:52:14.631973 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:14.631926 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" podStartSLOduration=1.330254228 podStartE2EDuration="14.631912081s" podCreationTimestamp="2026-05-21 14:52:00 +0000 UTC" firstStartedPulling="2026-05-21 14:52:00.741172872 +0000 UTC m=+595.993460578" lastFinishedPulling="2026-05-21 14:52:14.042830712 +0000 UTC m=+609.295118431" observedRunningTime="2026-05-21 14:52:14.630027626 +0000 UTC m=+609.882315480" watchObservedRunningTime="2026-05-21 14:52:14.631912081 +0000 UTC m=+609.884199809" May 21 14:52:25.614840 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:25.614805 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx" May 21 14:52:25.617226 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:25.615775 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pxthh" May 21 14:52:50.283762 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.283725 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj"] May 21 14:52:50.287930 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.287912 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.290515 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.290495 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 14:52:50.297122 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.297098 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj"] May 21 14:52:50.454073 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.454246 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.454246 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.454246 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vfzs\" (UniqueName: \"kubernetes.io/projected/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kube-api-access-2vfzs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.454246 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e188b-8d3b-44e0-b748-2eae28baeb9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.454246 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.454237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.554934 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.554900 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.554970 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555004 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555128 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555033 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vfzs\" (UniqueName: \"kubernetes.io/projected/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kube-api-access-2vfzs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555284 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555163 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e188b-8d3b-44e0-b748-2eae28baeb9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555284 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555210 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555425 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555425 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.555492 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.555435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.557632 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.557610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e188b-8d3b-44e0-b748-2eae28baeb9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.557786 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.557767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e188b-8d3b-44e0-b748-2eae28baeb9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.562324 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.562298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vfzs\" (UniqueName: \"kubernetes.io/projected/b67e188b-8d3b-44e0-b748-2eae28baeb9c-kube-api-access-2vfzs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj\" (UID: \"b67e188b-8d3b-44e0-b748-2eae28baeb9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.599049 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.599010 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:50.734002 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.733978 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj"] May 21 14:52:50.736056 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:52:50.736030 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67e188b_8d3b_44e0_b748_2eae28baeb9c.slice/crio-739a8b8ccc88df8e2465fb70ab9719351e98de8ef8a77f7ee06f19dc4fbd29f3 WatchSource:0}: Error finding container 739a8b8ccc88df8e2465fb70ab9719351e98de8ef8a77f7ee06f19dc4fbd29f3: Status 404 returned error can't find the container with id 739a8b8ccc88df8e2465fb70ab9719351e98de8ef8a77f7ee06f19dc4fbd29f3 May 21 14:52:50.738165 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:50.738149 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:52:51.727162 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:51.727128 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" event={"ID":"b67e188b-8d3b-44e0-b748-2eae28baeb9c","Type":"ContainerStarted","Data":"1ad4b9a26bb5509829205da37b16b0431c5911154834d5948f0ec34a1e0aead9"} May 21 14:52:51.727162 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:51.727163 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" event={"ID":"b67e188b-8d3b-44e0-b748-2eae28baeb9c","Type":"ContainerStarted","Data":"739a8b8ccc88df8e2465fb70ab9719351e98de8ef8a77f7ee06f19dc4fbd29f3"} May 21 14:52:56.661285 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.661239 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cf5546749-fpkxj"] May 21 14:52:56.665006 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.664981 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.674126 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.674097 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cf5546749-fpkxj"] May 21 14:52:56.746956 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.746925 2563 generic.go:358] "Generic (PLEG): container finished" podID="b67e188b-8d3b-44e0-b748-2eae28baeb9c" containerID="1ad4b9a26bb5509829205da37b16b0431c5911154834d5948f0ec34a1e0aead9" exitCode=0 May 21 14:52:56.747101 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.746962 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" event={"ID":"b67e188b-8d3b-44e0-b748-2eae28baeb9c","Type":"ContainerDied","Data":"1ad4b9a26bb5509829205da37b16b0431c5911154834d5948f0ec34a1e0aead9"} May 21 14:52:56.816559 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.816524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-tls-cert\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.816747 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.816668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbft\" (UniqueName: \"kubernetes.io/projected/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-kube-api-access-gxbft\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.917915 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.917814 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-tls-cert\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.918097 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.917938 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbft\" (UniqueName: \"kubernetes.io/projected/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-kube-api-access-gxbft\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.920576 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.920544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-tls-cert\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.925947 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.925916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbft\" (UniqueName: \"kubernetes.io/projected/f7ffdace-532f-43aa-9c60-b3ac99b3efe6-kube-api-access-gxbft\") pod \"authorino-6cf5546749-fpkxj\" (UID: \"f7ffdace-532f-43aa-9c60-b3ac99b3efe6\") " pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:56.974577 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:56.974542 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cf5546749-fpkxj" May 21 14:52:57.104001 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.103972 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cf5546749-fpkxj"] May 21 14:52:57.105834 ip-10-0-132-243 kubenswrapper[2563]: W0521 14:52:57.105810 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7ffdace_532f_43aa_9c60_b3ac99b3efe6.slice/crio-371f42587d8ca5487dd3af72e81be7f0027db8afec7c95633d021ee1868ee759 WatchSource:0}: Error finding container 371f42587d8ca5487dd3af72e81be7f0027db8afec7c95633d021ee1868ee759: Status 404 returned error can't find the container with id 371f42587d8ca5487dd3af72e81be7f0027db8afec7c95633d021ee1868ee759 May 21 14:52:57.752210 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.752170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cf5546749-fpkxj" event={"ID":"f7ffdace-532f-43aa-9c60-b3ac99b3efe6","Type":"ContainerStarted","Data":"c247dbdf123c964d2c97143fd07a7f246001e86e10e5d9de4707390f85d9ff2d"} May 21 14:52:57.752210 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.752210 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cf5546749-fpkxj" event={"ID":"f7ffdace-532f-43aa-9c60-b3ac99b3efe6","Type":"ContainerStarted","Data":"371f42587d8ca5487dd3af72e81be7f0027db8afec7c95633d021ee1868ee759"} May 21 14:52:57.753781 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.753756 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" event={"ID":"b67e188b-8d3b-44e0-b748-2eae28baeb9c","Type":"ContainerStarted","Data":"c28ea160a2f9141cf32bc593fa5cd6707dfcd97e8eb099d753454b6c323c64c0"} May 21 14:52:57.753969 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.753954 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:52:57.767761 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.767715 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6cf5546749-fpkxj" podStartSLOduration=1.317686711 podStartE2EDuration="1.76769921s" podCreationTimestamp="2026-05-21 14:52:56 +0000 UTC" firstStartedPulling="2026-05-21 14:52:57.107004622 +0000 UTC m=+652.359292332" lastFinishedPulling="2026-05-21 14:52:57.557017121 +0000 UTC m=+652.809304831" observedRunningTime="2026-05-21 14:52:57.76651036 +0000 UTC m=+653.018798089" watchObservedRunningTime="2026-05-21 14:52:57.76769921 +0000 UTC m=+653.019986939" May 21 14:52:57.791438 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.791374 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" podStartSLOduration=7.447062584 podStartE2EDuration="7.79135309s" podCreationTimestamp="2026-05-21 14:52:50 +0000 UTC" firstStartedPulling="2026-05-21 14:52:56.747636919 +0000 UTC m=+651.999924630" lastFinishedPulling="2026-05-21 14:52:57.091927429 +0000 UTC m=+652.344215136" observedRunningTime="2026-05-21 14:52:57.789195462 +0000 UTC m=+653.041483209" watchObservedRunningTime="2026-05-21 14:52:57.79135309 +0000 UTC m=+653.043640818" May 21 14:52:57.796019 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.795986 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:52:57.796234 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:57.796202 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-84bcd75596-h8626" podUID="79c928c8-e495-4dbe-969b-e9b422fdf615" containerName="authorino" containerID="cri-o://9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4" gracePeriod=30 May 21 14:52:58.045983 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.045957 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:52:58.127673 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.127588 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert\") pod \"79c928c8-e495-4dbe-969b-e9b422fdf615\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " May 21 14:52:58.127673 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.127628 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nhb5\" (UniqueName: \"kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5\") pod \"79c928c8-e495-4dbe-969b-e9b422fdf615\" (UID: \"79c928c8-e495-4dbe-969b-e9b422fdf615\") " May 21 14:52:58.135939 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.133440 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5" (OuterVolumeSpecName: "kube-api-access-8nhb5") pod "79c928c8-e495-4dbe-969b-e9b422fdf615" (UID: "79c928c8-e495-4dbe-969b-e9b422fdf615"). InnerVolumeSpecName "kube-api-access-8nhb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:52:58.142412 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.142382 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "79c928c8-e495-4dbe-969b-e9b422fdf615" (UID: "79c928c8-e495-4dbe-969b-e9b422fdf615"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:52:58.229055 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.229011 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79c928c8-e495-4dbe-969b-e9b422fdf615-tls-cert\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:52:58.229055 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.229053 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nhb5\" (UniqueName: \"kubernetes.io/projected/79c928c8-e495-4dbe-969b-e9b422fdf615-kube-api-access-8nhb5\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\"" May 21 14:52:58.758710 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.758672 2563 generic.go:358] "Generic (PLEG): container finished" podID="79c928c8-e495-4dbe-969b-e9b422fdf615" containerID="9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4" exitCode=0 May 21 14:52:58.759133 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.758720 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bcd75596-h8626" May 21 14:52:58.759133 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.758733 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bcd75596-h8626" event={"ID":"79c928c8-e495-4dbe-969b-e9b422fdf615","Type":"ContainerDied","Data":"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4"} May 21 14:52:58.759133 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.758768 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bcd75596-h8626" event={"ID":"79c928c8-e495-4dbe-969b-e9b422fdf615","Type":"ContainerDied","Data":"28eb31787beb778c8da48855f869bdc7e70f141cf2206d8dd69438ac69787a55"} May 21 14:52:58.759279 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.759079 2563 scope.go:117] "RemoveContainer" containerID="9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4" May 21 14:52:58.776725 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.776695 2563 scope.go:117] "RemoveContainer" containerID="9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4" May 21 14:52:58.777030 ip-10-0-132-243 kubenswrapper[2563]: E0521 14:52:58.777009 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4\": container with ID starting with 9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4 not found: ID does not exist" containerID="9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4" May 21 14:52:58.777073 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.777040 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4"} err="failed to get container status \"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4\": rpc error: code = NotFound desc = could not find container \"9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4\": container with ID starting with 9dc1d53aa70e8134621c0fa038ce64b678d9a880de95e9f87a8f436dfe2a88e4 not found: ID does not exist" May 21 14:52:58.783893 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.783869 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:52:58.789432 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:58.789409 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84bcd75596-h8626"] May 21 14:52:59.403515 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:52:59.403474 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c928c8-e495-4dbe-969b-e9b422fdf615" path="/var/lib/kubelet/pods/79c928c8-e495-4dbe-969b-e9b422fdf615/volumes" May 21 14:53:08.772474 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:53:08.772436 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj" May 21 14:57:06.016518 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:57:06.016486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 14:57:06.017645 ip-10-0-132-243 kubenswrapper[2563]: I0521 14:57:06.017621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:02:06.041649 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:02:06.041618 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:02:06.044164 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:02:06.044137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:07:06.066991 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:07:06.066961 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:07:06.069059 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:07:06.069033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:12:06.096410 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:12:06.096377 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:12:06.098685 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:12:06.098659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:15:25.277519 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:25.277483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cf5546749-fpkxj_f7ffdace-532f-43aa-9c60-b3ac99b3efe6/authorino/0.log" May 21 15:15:30.525652 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:30.525615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl_2c9faf26-0e26-43d0-8274-cdbdbce0010b/manager/0.log" May 21 15:15:32.189504 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:32.189472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cf5546749-fpkxj_f7ffdace-532f-43aa-9c60-b3ac99b3efe6/authorino/0.log" May 21 15:15:33.014042 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:33.014009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-2mbfn_e6f02350-3621-4b3a-9d8d-f1dd46d42d3c/manager/0.log" May 21 15:15:33.584506 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:33.584474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bcf6bb97-7cwp4_79f46f02-d125-437a-af19-a88a3af4c2bf/kube-auth-proxy/0.log" May 21 15:15:34.390547 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.390506 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj_b67e188b-8d3b-44e0-b748-2eae28baeb9c/storage-initializer/0.log" May 21 15:15:34.398592 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.398551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xngkj_b67e188b-8d3b-44e0-b748-2eae28baeb9c/main/0.log" May 21 15:15:34.519389 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.519320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx_8a0b954e-5241-44d0-af9c-04b2fc2e1c7d/storage-initializer/0.log" May 21 15:15:34.527843 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.527814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-6c6kx_8a0b954e-5241-44d0-af9c-04b2fc2e1c7d/main/0.log" May 21 15:15:34.641008 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.640906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pxthh_50d837fd-b30a-4311-9f04-f77d6fbdd47c/storage-initializer/0.log" May 21 15:15:34.648042 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:34.648018 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pxthh_50d837fd-b30a-4311-9f04-f77d6fbdd47c/main/0.log" May 21 15:15:41.419715 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:41.419676 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gj56w_5b843c3c-db3e-4945-a8cc-2a89cd4d70ce/global-pull-secret-syncer/0.log" May 21 15:15:41.594373 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:41.594316 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qnlv5_52c496e7-e22f-42df-b946-676910070be7/konnectivity-agent/0.log" May 21 15:15:41.638886 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:41.638849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-243.ec2.internal_8d84741ee3eadebab7b094365b966a90/haproxy/0.log" May 21 15:15:46.148673 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:46.148640 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cf5546749-fpkxj_f7ffdace-532f-43aa-9c60-b3ac99b3efe6/authorino/0.log" May 21 15:15:46.635005 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:46.634977 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-2mbfn_e6f02350-3621-4b3a-9d8d-f1dd46d42d3c/manager/0.log" May 21 15:15:48.143558 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.143468 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-czzsv_7ec6cc99-0af7-44e8-81dd-2f8204d6a73f/cluster-monitoring-operator/0.log" May 21 15:15:48.169441 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.169399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pq5x8_b87451f9-9b96-452e-86c1-7ed8cd364639/kube-state-metrics/0.log" May 21 15:15:48.182489 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.182461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pq5x8_b87451f9-9b96-452e-86c1-7ed8cd364639/kube-rbac-proxy-main/0.log" May 21 15:15:48.200046 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.200022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pq5x8_b87451f9-9b96-452e-86c1-7ed8cd364639/kube-rbac-proxy-self/0.log" May 21 15:15:48.247668 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.247641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7b5ffbcd-n2p2l_c4ea518a-0237-47d6-b3b2-9960a40b7c98/metrics-server/0.log" May 21 15:15:48.300597 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.300566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wf42_c2377963-72da-47b5-9604-6da568fb51ed/node-exporter/0.log" May 21 15:15:48.319524 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.319494 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wf42_c2377963-72da-47b5-9604-6da568fb51ed/kube-rbac-proxy/0.log" May 21 15:15:48.341196 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.341175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wf42_c2377963-72da-47b5-9604-6da568fb51ed/init-textfile/0.log" May 21 15:15:48.575269 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.575240 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/prometheus/0.log" May 21 15:15:48.592638 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.592613 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/config-reloader/0.log" May 21 15:15:48.618182 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.618158 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/thanos-sidecar/0.log" May 21 15:15:48.637469 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.637446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/kube-rbac-proxy-web/0.log" May 21 15:15:48.661373 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.661345 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/kube-rbac-proxy/0.log" May 21 15:15:48.680798 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.680770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/kube-rbac-proxy-thanos/0.log" May 21 15:15:48.698152 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.698127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_df147e4e-35e7-405a-ae96-a5f22e324e66/init-config-reloader/0.log" May 21 15:15:48.732417 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.732375 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-957fq_11280cfe-c5c6-409f-a814-f472063376e8/prometheus-operator/0.log" May 21 15:15:48.748907 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.748885 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-957fq_11280cfe-c5c6-409f-a814-f472063376e8/kube-rbac-proxy/0.log" May 21 15:15:48.769288 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.769250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-c8qbr_96eb23f6-9333-48a7-b7ea-e237904bca17/prometheus-operator-admission-webhook/0.log" May 21 15:15:48.799107 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.799077 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d6d9785b-znxxs_7d460844-1ff0-40aa-8a43-688058b3bd38/telemeter-client/0.log" May 21 15:15:48.819220 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.819192 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d6d9785b-znxxs_7d460844-1ff0-40aa-8a43-688058b3bd38/reload/0.log" May 21 15:15:48.837237 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:48.837174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d6d9785b-znxxs_7d460844-1ff0-40aa-8a43-688058b3bd38/kube-rbac-proxy/0.log" May 21 15:15:50.253214 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.253159 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf"] May 21 15:15:50.255657 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.255189 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c928c8-e495-4dbe-969b-e9b422fdf615" containerName="authorino" May 21 15:15:50.255657 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.255222 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c928c8-e495-4dbe-969b-e9b422fdf615" containerName="authorino" May 21 15:15:50.255657 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.255430 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="79c928c8-e495-4dbe-969b-e9b422fdf615" containerName="authorino" May 21 15:15:50.259697 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.259670 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.260376 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.260357 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf"] May 21 15:15:50.261989 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.261971 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gccz6\"/\"openshift-service-ca.crt\"" May 21 15:15:50.262096 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.261995 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gccz6\"/\"default-dockercfg-chtxw\"" May 21 15:15:50.263156 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.263140 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gccz6\"/\"kube-root-ca.crt\"" May 21 15:15:50.390355 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.390294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-proc\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.390355 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.390355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-lib-modules\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.390578 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.390383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-podres\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.390578 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.390437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-sys\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.390578 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.390463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h5hg\" (UniqueName: \"kubernetes.io/projected/8aed6241-ded6-447d-9d7a-23a4bea5af24-kube-api-access-4h5hg\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491553 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491513 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-podres\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491691 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491568 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-sys\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491691 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491595 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h5hg\" (UniqueName: \"kubernetes.io/projected/8aed6241-ded6-447d-9d7a-23a4bea5af24-kube-api-access-4h5hg\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491691 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-proc\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491691 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-podres\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491691 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491692 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-lib-modules\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491852 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-sys\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491852 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-lib-modules\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.491852 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.491832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8aed6241-ded6-447d-9d7a-23a4bea5af24-proc\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.499225 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.499193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h5hg\" (UniqueName: \"kubernetes.io/projected/8aed6241-ded6-447d-9d7a-23a4bea5af24-kube-api-access-4h5hg\") pod \"perf-node-gather-daemonset-468lf\" (UID: \"8aed6241-ded6-447d-9d7a-23a4bea5af24\") " pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.571665 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.571634 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:50.710146 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.710118 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf"] May 21 15:15:50.712252 ip-10-0-132-243 kubenswrapper[2563]: W0521 15:15:50.712224 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8aed6241_ded6_447d_9d7a_23a4bea5af24.slice/crio-c4eb3c4283ade44593e5df79330db5c4934cb5a3662848294465aaa05a3410b8 WatchSource:0}: Error finding container c4eb3c4283ade44593e5df79330db5c4934cb5a3662848294465aaa05a3410b8: Status 404 returned error can't find the container with id c4eb3c4283ade44593e5df79330db5c4934cb5a3662848294465aaa05a3410b8 May 21 15:15:50.714053 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:50.714032 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:15:51.067358 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:51.067309 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-mtfqt_63553f03-4875-4140-b6ba-0d52233a9b10/download-server/0.log" May 21 15:15:51.617583 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:51.617540 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" event={"ID":"8aed6241-ded6-447d-9d7a-23a4bea5af24","Type":"ContainerStarted","Data":"d03a4ca020c22412b7092db89b68ce8c0fabc162a285d3332f549f13e6741948"} May 21 15:15:51.617583 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:51.617576 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" event={"ID":"8aed6241-ded6-447d-9d7a-23a4bea5af24","Type":"ContainerStarted","Data":"c4eb3c4283ade44593e5df79330db5c4934cb5a3662848294465aaa05a3410b8"} May 21 15:15:51.618004 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:51.617620 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:51.633805 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:51.633757 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" podStartSLOduration=1.6337437160000001 podStartE2EDuration="1.633743716s" podCreationTimestamp="2026-05-21 15:15:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:51.631875002 +0000 UTC m=+2026.884162731" watchObservedRunningTime="2026-05-21 15:15:51.633743716 +0000 UTC m=+2026.886031445" May 21 15:15:52.345344 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:52.345311 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbphl_d1735115-cc89-40bb-add6-5ea39ebe1f72/dns/0.log" May 21 15:15:52.364062 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:52.364020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jbphl_d1735115-cc89-40bb-add6-5ea39ebe1f72/kube-rbac-proxy/0.log" May 21 15:15:52.466143 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:52.466115 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mh292_7c09078b-b130-49e3-8a4e-84cfa4a0e237/dns-node-resolver/0.log" May 21 15:15:52.966981 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:52.966951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdnw9_833ae58b-c7a7-4099-8423-7e17d5a312fa/node-ca/0.log" May 21 15:15:53.872921 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:53.872886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bcf6bb97-7cwp4_79f46f02-d125-437a-af19-a88a3af4c2bf/kube-auth-proxy/0.log" May 21 15:15:54.545968 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:54.545919 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xst9j_86fd6b66-c53d-4f89-b12b-1d314909a952/serve-healthcheck-canary/0.log" May 21 15:15:55.007396 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:55.007285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-zgjn8_d059a681-c970-464e-8581-8cb82a02b74a/insights-operator/0.log" May 21 15:15:55.009220 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:55.009190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-zgjn8_d059a681-c970-464e-8581-8cb82a02b74a/insights-operator/1.log" May 21 15:15:55.141989 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:55.141962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzmjv_0285a5f0-a8ed-496a-8729-d8b30f2da432/kube-rbac-proxy/0.log" May 21 15:15:55.159037 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:55.159006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzmjv_0285a5f0-a8ed-496a-8729-d8b30f2da432/exporter/0.log" May 21 15:15:55.178608 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:55.178586 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzmjv_0285a5f0-a8ed-496a-8729-d8b30f2da432/extractor/0.log" May 21 15:15:57.166226 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:57.166193 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7cd99cbc-cb9bl_2c9faf26-0e26-43d0-8274-cdbdbce0010b/manager/0.log" May 21 15:15:57.631717 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:57.631692 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gccz6/perf-node-gather-daemonset-468lf" May 21 15:15:58.327448 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:15:58.327419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-99c58c8b8-wfjcq_08a7c898-b83d-44d4-a2e3-c8073380e55b/manager/0.log" May 21 15:16:02.788252 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:02.788223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wjcmc_21cd1ed4-8100-40df-9a73-b64b1cd59156/migrator/0.log" May 21 15:16:02.804771 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:02.804740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wjcmc_21cd1ed4-8100-40df-9a73-b64b1cd59156/graceful-termination/0.log" May 21 15:16:03.127628 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:03.127595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wkr74_7fde25a0-9f67-4a31-9753-0141d547989c/kube-storage-version-migrator-operator/1.log" May 21 15:16:03.129300 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:03.129269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wkr74_7fde25a0-9f67-4a31-9753-0141d547989c/kube-storage-version-migrator-operator/0.log" May 21 15:16:04.453795 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.453767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/kube-multus-additional-cni-plugins/0.log" May 21 15:16:04.471803 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.471774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/egress-router-binary-copy/0.log" May 21 15:16:04.490420 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.490394 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/cni-plugins/0.log" May 21 15:16:04.508191 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.508158 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/bond-cni-plugin/0.log" May 21 15:16:04.526424 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.526395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/routeoverride-cni/0.log" May 21 15:16:04.544678 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.544641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/whereabouts-cni-bincopy/0.log" May 21 15:16:04.565493 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.565462 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-brdn9_d080bedb-39b4-456e-ab98-c731bf783e8a/whereabouts-cni/0.log" May 21 15:16:04.596324 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.596278 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bgssk_f0db5469-3445-4472-9256-c07dc80f8a57/kube-multus/0.log" May 21 15:16:04.677217 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.677183 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nlsht_13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef/network-metrics-daemon/0.log" May 21 15:16:04.692255 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:04.692232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nlsht_13a12ccf-b510-4ba8-a3c6-bb0362e1e6ef/kube-rbac-proxy/0.log" May 21 15:16:05.762711 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.762681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-controller/0.log" May 21 15:16:05.792931 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.792890 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/0.log" May 21 15:16:05.809950 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.809926 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovn-acl-logging/1.log" May 21 15:16:05.844419 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.844386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/kube-rbac-proxy-node/0.log" May 21 15:16:05.878831 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.878806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:16:05.910171 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.910128 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/northd/0.log" May 21 15:16:05.940823 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.940795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/nbdb/0.log" May 21 15:16:05.980782 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:05.980752 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/sbdb/0.log" May 21 15:16:06.157712 ip-10-0-132-243 kubenswrapper[2563]: I0521 15:16:06.157678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hb8kt_939d2722-3419-4b4b-8397-ae904899918d/ovnkube-controller/0.log"