May 21 14:01:35.290820 ip-10-0-139-85 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 14:01:35.290830 ip-10-0-139-85 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 14:01:35.290836 ip-10-0-139-85 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 14:01:35.291045 ip-10-0-139-85 systemd[1]: Failed to start Kubernetes Kubelet. May 21 14:01:45.342026 ip-10-0-139-85 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 14:01:45.342045 ip-10-0-139-85 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aa8b288a49df4e76ab358c48ad898933 -- May 21 14:04:10.596943 ip-10-0-139-85 systemd[1]: Starting Kubernetes Kubelet... May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.074379 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078170 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078185 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078189 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078192 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078195 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078198 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078200 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:04:11.159127 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078203 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078205 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078208 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078211 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078213 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078216 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078219 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078222 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078224 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078226 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078229 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078232 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078236 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078239 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078242 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078246 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078249 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078251 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078254 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078257 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:04:11.159997 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078259 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078262 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078265 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078268 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078272 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078276 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078279 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078282 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078285 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078288 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078290 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078293 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078296 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078299 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078302 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078305 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078308 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078311 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078313 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:04:11.160658 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078316 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078319 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078322 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078324 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078327 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078329 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078333 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078336 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078339 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078342 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078344 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078347 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078349 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078352 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078354 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078357 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078359 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078362 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078364 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078368 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:04:11.161230 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078371 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078374 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078377 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078380 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078382 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078385 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078388 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078391 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078395 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078397 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078400 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078404 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078406 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078409 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078412 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078414 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078417 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078419 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078422 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078425 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:04:11.161813 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078867 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078873 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078876 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078879 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078882 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078885 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078887 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078890 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078892 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078895 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078898 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078900 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078903 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078906 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078909 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078911 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078914 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078916 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078919 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078921 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:04:11.162385 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078925 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078928 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078931 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078934 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078936 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078939 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078942 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078945 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078947 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078950 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078953 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078956 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078959 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078961 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078964 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078967 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078969 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078972 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078974 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078977 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:04:11.162966 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078979 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078982 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078984 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078987 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078989 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078992 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.078997 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079000 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079003 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079005 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079008 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079011 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079013 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079016 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079019 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079021 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079024 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079027 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079029 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:04:11.163520 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079032 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079034 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079037 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079040 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079043 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079045 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079048 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079050 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079053 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079055 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079058 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079060 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079063 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079066 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079068 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079071 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079073 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079076 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079078 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079081 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:04:11.164070 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079083 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079086 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079089 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079091 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079094 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079096 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.079099 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079765 2559 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079778 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079792 2559 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079797 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079803 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079807 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079812 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079816 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079821 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079824 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079828 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079832 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079835 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079838 2559 flags.go:64] FLAG: --cgroup-root="" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079841 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:04:11.164643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079844 2559 flags.go:64] FLAG: --client-ca-file="" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079847 2559 flags.go:64] FLAG: --cloud-config="" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079850 2559 flags.go:64] FLAG: --cloud-provider="external" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079853 2559 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079858 2559 flags.go:64] FLAG: --cluster-domain="" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079860 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079864 2559 flags.go:64] FLAG: --config-dir="" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079866 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079871 2559 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079875 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079878 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079882 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079885 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079889 2559 flags.go:64] FLAG: --contention-profiling="false" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079892 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079895 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079898 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079901 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079907 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079911 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079914 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079917 2559 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079921 2559 flags.go:64] FLAG: --enable-server="true" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079924 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079930 2559 flags.go:64] FLAG: --event-burst="100" May 21 14:04:11.165267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079933 2559 flags.go:64] FLAG: --event-qps="50" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079936 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079940 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079943 2559 flags.go:64] FLAG: --eviction-hard="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079948 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079950 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079954 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079957 2559 flags.go:64] FLAG: --eviction-soft="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079960 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079963 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079969 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079973 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079976 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079979 2559 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079982 2559 flags.go:64] FLAG: --feature-gates="" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079986 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079989 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079992 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079996 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.079999 2559 flags.go:64] FLAG: --healthz-port="10248" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080002 2559 flags.go:64] FLAG: --help="false" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080005 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-85.ec2.internal" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080008 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080011 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:04:11.165945 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080015 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080018 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080022 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080026 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080029 2559 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080032 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080035 2559 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080038 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080041 2559 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080043 2559 flags.go:64] FLAG: --kube-reserved="" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080047 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080050 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080053 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080056 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080059 2559 flags.go:64] FLAG: --lock-file="" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080063 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080066 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080069 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080079 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080082 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080086 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080089 2559 flags.go:64] FLAG: --logging-format="text" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080099 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080104 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:04:11.166634 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080107 2559 flags.go:64] FLAG: --manifest-url="" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080110 2559 flags.go:64] FLAG: --manifest-url-header="" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080116 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080119 2559 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080124 2559 flags.go:64] FLAG: --max-pods="110" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080126 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080129 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080132 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080136 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080139 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080142 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080145 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080154 2559 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080158 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080161 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080163 2559 flags.go:64] FLAG: --pod-cidr="" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080166 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080173 2559 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080176 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080179 2559 flags.go:64] FLAG: --pods-per-core="0" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080182 2559 flags.go:64] FLAG: --port="10250" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080185 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080189 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e097689e545eb996" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080192 2559 flags.go:64] FLAG: --qos-reserved="" May 21 14:04:11.167495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080195 2559 flags.go:64] FLAG: --read-only-port="10255" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080198 2559 flags.go:64] FLAG: --register-node="true" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080203 2559 flags.go:64] FLAG: --register-schedulable="true" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080207 2559 flags.go:64] FLAG: --register-with-taints="" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080212 2559 flags.go:64] FLAG: --registry-burst="10" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080214 2559 flags.go:64] FLAG: --registry-qps="5" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080218 2559 flags.go:64] FLAG: --reserved-cpus="" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080221 2559 flags.go:64] FLAG: --reserved-memory="" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080225 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080228 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080231 2559 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080234 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080237 2559 flags.go:64] FLAG: --runonce="false" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080241 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080244 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080247 2559 flags.go:64] FLAG: --seccomp-default="false" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080250 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080252 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080256 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080259 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080262 2559 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080266 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080269 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080272 2559 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080274 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080277 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:04:11.168207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080280 2559 flags.go:64] FLAG: --system-cgroups="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080283 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080289 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080291 2559 flags.go:64] FLAG: --tls-cert-file="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080294 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080299 2559 flags.go:64] FLAG: --tls-min-version="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080302 2559 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080304 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080308 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080313 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080316 2559 flags.go:64] FLAG: --v="2" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080320 2559 flags.go:64] FLAG: --version="false" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080324 2559 flags.go:64] FLAG: --vmodule="" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080329 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.080332 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080435 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080439 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080442 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080444 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080447 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080450 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080452 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080456 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:04:11.169358 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080459 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080461 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080464 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080466 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080470 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080473 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080475 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080478 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080480 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080483 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080486 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080488 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080490 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080493 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080496 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080498 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080501 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080505 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080509 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080511 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:04:11.170309 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080514 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080517 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080520 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080522 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080525 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080527 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080530 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080532 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080535 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080538 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080540 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080543 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080545 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080548 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080551 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080553 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080556 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080560 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080563 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080565 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:04:11.171086 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080568 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080570 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080573 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080575 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080578 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080581 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080583 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080586 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080588 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080592 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080596 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080599 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080602 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080605 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080607 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080610 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080612 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080615 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080618 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080635 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:04:11.171700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080638 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080643 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080645 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080648 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080651 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080654 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080656 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080659 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080662 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080665 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080668 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080671 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080675 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080679 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080683 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080687 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:04:11.172830 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.080690 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:04:11.172861 ip-10-0-139-85 systemd[1]: Started Kubernetes Kubelet. May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.081419 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.088104 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.088123 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088175 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088180 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088184 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088187 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088190 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088193 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088197 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088200 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088207 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088210 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088213 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:04:11.174245 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088216 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088219 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088221 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088225 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088227 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088230 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088233 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088235 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088238 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088241 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088245 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088248 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088251 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088254 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088256 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088259 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088262 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088265 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088268 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088270 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:04:11.175273 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088273 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088276 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088279 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088281 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088284 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088286 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088289 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088292 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088295 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088297 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088300 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088302 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088305 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088310 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088313 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088315 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088318 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088321 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088324 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088326 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:04:11.176351 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088329 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088332 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088334 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088338 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088340 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088343 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088345 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088349 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088353 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088357 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088360 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088362 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088365 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088368 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088371 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088373 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088376 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088379 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088381 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:04:11.177449 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088384 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088387 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088392 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088396 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088399 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088402 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088407 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088409 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088412 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088415 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088417 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088420 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088423 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088425 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088428 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:04:11.178527 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088431 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.088436 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088552 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088558 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088561 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088564 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088567 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088570 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088573 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088576 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088579 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088582 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088585 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088587 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088590 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:04:11.180032 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088592 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088595 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088598 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088601 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088604 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088606 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088609 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088612 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088616 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088619 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088639 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088643 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088646 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088648 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088651 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088655 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088658 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088661 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088664 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088667 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:04:11.180839 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088671 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088674 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088677 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088680 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088682 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088685 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088688 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088690 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088693 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088695 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088698 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088700 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088703 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088705 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088708 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088712 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088715 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088717 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088720 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088722 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:04:11.181927 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088730 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088732 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088735 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088738 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088741 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088743 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088746 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088748 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088751 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088754 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088756 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088759 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088762 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088765 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088768 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088770 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088773 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088776 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088779 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:04:11.182815 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088781 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088784 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088786 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088789 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088791 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088794 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088796 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088799 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088804 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088808 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088811 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088814 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088816 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:11.088820 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.088825 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:04:11.184079 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.089619 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.091663 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.092563 2559 server.go:1019] "Starting client certificate rotation" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.092664 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.092702 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.118050 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.120038 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.134136 2559 log.go:25] "Validated CRI v1 runtime API" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.139360 2559 log.go:25] "Validated CRI v1 image API" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.141130 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.145539 2559 fs.go:135] Filesystem UUIDs: map[41c90d18-d53a-4ce4-8e3d-9308f2eebcbb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 df4ce46a-d7e3-4029-a739-40f16ee5019a:/dev/nvme0n1p4] May 21 14:04:11.184758 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.145561 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.149829 2559 manager.go:217] Machine: {Timestamp:2026-05-21 14:04:11.149326544 +0000 UTC m=+0.421222635 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101273 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec275a5b869f80205ddb3a1ce5c145d8 SystemUUID:ec275a5b-869f-8020-5ddb-3a1ce5c145d8 BootID:aa8b288a-49df-4e76-ab35-8c48ad898933 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:f3:1c:80:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:f3:1c:80:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:db:57:1b:04:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.150674 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.150763 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.152758 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.152780 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.152927 2559 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.152936 2559 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.152943 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.153777 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.154805 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.155123 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.155240 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.157505 2559 kubelet.go:491] "Attempting to sync node with API server" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.157522 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.157536 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.157546 2559 kubelet.go:397] "Adding apiserver pod source" May 21 14:04:11.421736 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.157556 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.158856 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.158888 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.162092 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.164243 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166244 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166262 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166272 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166282 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166295 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166303 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166312 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166321 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166331 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166340 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166352 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.166361 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.168231 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.168400 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.171191 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.171194 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.171934 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2q9ww" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.172031 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.172071 2559 server.go:1295] "Started kubelet" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.172117 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.172531 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.172570 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.173780 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.179869 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2q9ww" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.188417 2559 server.go:317] "Adding debug handlers to kubelet server" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.189463 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.193819 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194249 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194475 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194489 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194596 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194662 2559 reconstruct.go:97] "Volume reconstruction finished" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.194671 2559 reconciler.go:26] "Reconciler: start to sync state" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195179 2559 factory.go:55] Registering systemd factory May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195230 2559 factory.go:223] Registration of the systemd container factory successfully May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195402 2559 factory.go:153] Registering CRI-O factory May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195414 2559 factory.go:223] Registration of the crio container factory successfully May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195463 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195485 2559 factory.go:103] Registering Raw factory May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.195506 2559 manager.go:1196] Started watching for new ooms in manager May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.195552 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.195725 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.196175 2559 manager.go:319] Starting recovery of all containers May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.207118 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:11.423332 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.208103 2559 manager.go:324] Recovery completed May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.209407 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-85.ec2.internal\" not found" node="ip-10-0-139-85.ec2.internal" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.215279 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217167 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217194 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217203 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217665 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217674 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.217690 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.219847 2559 policy_none.go:49] "None policy: Start" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.219860 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.219869 2559 state_mem.go:35] "Initializing new in-memory state store" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252176 2559 manager.go:341] "Starting Device Plugin manager" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.252203 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252212 2559 server.go:85] "Starting device plugin registration server" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252421 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252435 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252535 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252620 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.252649 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.253288 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.253327 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.331552 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.332677 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.332695 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.332712 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.332719 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.332758 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.335549 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.353567 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.354568 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.354598 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.354618 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.354657 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-85.ec2.internal" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.363256 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-85.ec2.internal" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.363277 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-85.ec2.internal\": node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.424885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.378853 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.433485 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal"] May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.433584 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.435089 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.435115 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.435124 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.436276 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.436475 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.436502 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439200 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439224 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439203 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439253 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439234 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.439287 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.440552 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.440580 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.441185 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientMemory" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.441209 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.441222 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeHasSufficientPID" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.471279 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-85.ec2.internal\" not found" node="ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.475669 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-85.ec2.internal\" not found" node="ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.479667 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.496704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.496729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.496747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8224d5ca3b6bacb7ce9024efcbf250f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-85.ec2.internal\" (UID: \"8224d5ca3b6bacb7ce9024efcbf250f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.580336 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597104 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597130 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.684250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597148 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8224d5ca3b6bacb7ce9024efcbf250f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-85.ec2.internal\" (UID: \"8224d5ca3b6bacb7ce9024efcbf250f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:11.685250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.685250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ab7eed552bf0f55450ac626aafbdf1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal\" (UID: \"5ab7eed552bf0f55450ac626aafbdf1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.685250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.597242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8224d5ca3b6bacb7ce9024efcbf250f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-85.ec2.internal\" (UID: \"8224d5ca3b6bacb7ce9024efcbf250f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:11.685250 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.681209 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.967015 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.773616 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:11.967015 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:11.778350 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:11.967015 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.781945 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:11.967015 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.882440 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:11.982890 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-85.ec2.internal\" not found" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.039507 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.092914 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.093050 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.093067 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.093067 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.095047 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.118099 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.119980 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.128321 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.158425 2559 apiserver.go:52] "Watching apiserver" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.165659 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.166058 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-cchrm","kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh","openshift-cluster-node-tuning-operator/tuned-7n79f","openshift-image-registry/node-ca-mctxb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal","openshift-multus/multus-additional-cni-plugins-85d9x","openshift-network-diagnostics/network-check-target-tlk25","openshift-dns/node-resolver-ng76h","openshift-multus/multus-92q8m","openshift-multus/network-metrics-daemon-tvwsb","openshift-network-operator/iptables-alerter-nnlcc","openshift-ovn-kubernetes/ovnkube-node-vjpld"] May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.167538 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.172967 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.174095 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.174985 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.175995 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.176078 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.176080 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.176080 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.176639 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9rfn8\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.176181 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.177228 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.177323 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.177814 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179184 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179196 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179211 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179226 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:04:12.213151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179191 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179559 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.179636 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztb55\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.180557 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92q8m" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.184978 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185001 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185070 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185079 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.185142 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185182 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4q685\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185310 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185374 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185414 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j7zv5\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185513 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185552 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mm79k\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185668 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185708 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.185716 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-96t66\"" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.186564 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.189381 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 13:59:11 +0000 UTC" deadline="2027-11-19 20:18:12.246317132 +0000 UTC" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.189401 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13134h14m0.05691843s" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.194844 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.195610 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-conf-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-netns\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-log-socket\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-netd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.215222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-etc-kubernetes\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8026789c-5011-4c2a-b0fa-225fa3185850-iptables-alerter-script\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-device-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgcb\" (UniqueName: \"kubernetes.io/projected/aab2ef30-1c22-439a-9b7d-c79c052518ff-kube-api-access-rzgcb\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnlrl\" (UniqueName: \"kubernetes.io/projected/4640c960-6c19-446d-9e43-e507f8d62cb8-kube-api-access-xnlrl\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-slash\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-sys-fs\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae0136d-1fcb-41f6-989b-3313c618d119-host\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab2ef30-1c22-439a-9b7d-c79c052518ff-tmp-dir\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-conf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-host\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-k8s-cni-cncf-io\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqzc\" (UniqueName: \"kubernetes.io/projected/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-kube-api-access-xbqzc\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.216204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae0136d-1fcb-41f6-989b-3313c618d119-serviceca\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-lib-modules\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-tuned\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cni-binary-copy\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-multus-certs\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-bin\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab2ef30-1c22-439a-9b7d-c79c052518ff-hosts-file\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-sys\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cnibin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-multus\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-etc-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201832 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-clp6k\"" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-config\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201837 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30bbdf39-5504-4540-8fe8-1b5a685ea880-konnectivity-ca\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.217107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-bin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.201961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-daemon-config\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202003 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-systemd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-ovn\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202094 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-node-log\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202186 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxml\" (UniqueName: \"kubernetes.io/projected/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-kube-api-access-8cxml\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202255 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-run\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202304 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-cnibin\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-var-lib-kubelet\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-system-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-hostroot\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovn-node-metrics-cert\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202408 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:04:12.217947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-systemd\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202453 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlcd\" (UniqueName: \"kubernetes.io/projected/8026789c-5011-4c2a-b0fa-225fa3185850-kube-api-access-zdlcd\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-system-cni-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-systemd-units\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n49g\" (UniqueName: \"kubernetes.io/projected/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kube-api-access-4n49g\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-os-release\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202583 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wb9fk\"" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-socket-dir-parent\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lv7\" (UniqueName: \"kubernetes.io/projected/711c2ea3-b86c-4e75-a166-60f426d56d98-kube-api-access-p8lv7\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysconfig\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsbf\" (UniqueName: \"kubernetes.io/projected/5a90dd5c-dfae-4609-a442-73a50777e1f5-kube-api-access-bcsbf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-env-overrides\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-socket-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30bbdf39-5504-4540-8fe8-1b5a685ea880-agent-certs\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-kubelet\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-var-lib-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202860 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-script-lib\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-os-release\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btg8n\" (UniqueName: \"kubernetes.io/projected/3ae0136d-1fcb-41f6-989b-3313c618d119-kube-api-access-btg8n\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-kubernetes\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-tmp\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.202989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-netns\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203017 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-kubelet\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8026789c-5011-4c2a-b0fa-225fa3185850-host-slash\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-registration-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.203099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-modprobe-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.219859 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.208787 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2fsk\"" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.233704 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.262171 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zg48k" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.271485 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zg48k" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysconfig\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsbf\" (UniqueName: \"kubernetes.io/projected/5a90dd5c-dfae-4609-a442-73a50777e1f5-kube-api-access-bcsbf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysconfig\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311728 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-env-overrides\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-socket-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30bbdf39-5504-4540-8fe8-1b5a685ea880-agent-certs\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311823 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-kubelet\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311846 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-var-lib-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311892 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-script-lib\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-socket-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311915 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-os-release\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-kubelet\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.355234 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311942 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-var-lib-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.311992 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btg8n\" (UniqueName: \"kubernetes.io/projected/3ae0136d-1fcb-41f6-989b-3313c618d119-kube-api-access-btg8n\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-kubernetes\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-os-release\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-tmp\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-netns\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312103 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-kubelet\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312128 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8026789c-5011-4c2a-b0fa-225fa3185850-host-slash\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-registration-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-kubernetes\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-registration-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-netns\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-modprobe-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-kubelet\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.356589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312298 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-conf-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8026789c-5011-4c2a-b0fa-225fa3185850-host-slash\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312346 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-netns\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312374 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-log-socket\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-netd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-log-socket\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-modprobe-d\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-netns\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312429 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-etc-kubernetes\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-etc-kubernetes\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-netd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312572 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8026789c-5011-4c2a-b0fa-225fa3185850-iptables-alerter-script\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312597 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.357518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-conf-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312638 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-device-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgcb\" (UniqueName: \"kubernetes.io/projected/aab2ef30-1c22-439a-9b7d-c79c052518ff-kube-api-access-rzgcb\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312714 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnlrl\" (UniqueName: \"kubernetes.io/projected/4640c960-6c19-446d-9e43-e507f8d62cb8-kube-api-access-xnlrl\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312737 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312944 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-slash\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312974 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-sys-fs\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312997 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae0136d-1fcb-41f6-989b-3313c618d119-host\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313021 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab2ef30-1c22-439a-9b7d-c79c052518ff-tmp-dir\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313043 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-conf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-sys-fs\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313086 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-host\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-slash\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8026789c-5011-4c2a-b0fa-225fa3185850-iptables-alerter-script\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-sysctl-conf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-host\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.593487 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ae0136d-1fcb-41f6-989b-3313c618d119-host\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313289 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab2ef30-1c22-439a-9b7d-c79c052518ff-tmp-dir\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-device-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-k8s-cni-cncf-io\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313110 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-k8s-cni-cncf-io\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqzc\" (UniqueName: \"kubernetes.io/projected/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-kube-api-access-xbqzc\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313663 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313684 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae0136d-1fcb-41f6-989b-3313c618d119-serviceca\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313706 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-lib-modules\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313727 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-tuned\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313749 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313774 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cni-binary-copy\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.313795 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-multus-certs\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.312174 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316059 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-bin\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-cni-bin\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab2ef30-1c22-439a-9b7d-c79c052518ff-hosts-file\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.595514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316154 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-sys\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-lib-modules\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316181 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cnibin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316208 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-multus\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-etc-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316255 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-config\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316281 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30bbdf39-5504-4540-8fe8-1b5a685ea880-konnectivity-ca\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316308 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.316390 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-run-multus-certs\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.316462 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:12.816441047 +0000 UTC m=+2.088337144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-multus\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab2ef30-1c22-439a-9b7d-c79c052518ff-hosts-file\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-sys\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711c2ea3-b86c-4e75-a166-60f426d56d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-etc-openvswitch\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cnibin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.596501 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-env-overrides\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316895 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-bin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316928 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-daemon-config\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316935 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-cni-binary-copy\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316952 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-systemd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-script-lib\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316976 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-ovn\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.316993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-host-var-lib-cni-bin\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317003 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-systemd\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-node-log\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317059 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxml\" (UniqueName: \"kubernetes.io/projected/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-kube-api-access-8cxml\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-run-ovn\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317084 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-node-log\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-run\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317138 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597212 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317152 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-cnibin\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317171 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-var-lib-kubelet\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317185 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-system-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317202 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-hostroot\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovnkube-config\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30bbdf39-5504-4540-8fe8-1b5a685ea880-konnectivity-ca\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovn-node-metrics-cert\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317321 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-systemd\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-run\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317351 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlcd\" (UniqueName: \"kubernetes.io/projected/8026789c-5011-4c2a-b0fa-225fa3185850-kube-api-access-zdlcd\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-cnibin\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317382 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-system-cni-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317388 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-daemon-config\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-systemd-units\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-var-lib-kubelet\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317435 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n49g\" (UniqueName: \"kubernetes.io/projected/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kube-api-access-4n49g\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317461 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-os-release\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.597809 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-system-cni-dir\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317489 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-socket-dir-parent\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-hostroot\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lv7\" (UniqueName: \"kubernetes.io/projected/711c2ea3-b86c-4e75-a166-60f426d56d98-kube-api-access-p8lv7\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-systemd\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711c2ea3-b86c-4e75-a166-60f426d56d98-system-cni-dir\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317556 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-os-release\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ae0136d-1fcb-41f6-989b-3313c618d119-serviceca\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-systemd-units\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.317786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-multus-socket-dir-parent\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.319027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-etc-tuned\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.319055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a90dd5c-dfae-4609-a442-73a50777e1f5-tmp\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.319261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-ovn-node-metrics-cert\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.319283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30bbdf39-5504-4540-8fe8-1b5a685ea880-agent-certs\") pod \"konnectivity-agent-cchrm\" (UID: \"30bbdf39-5504-4540-8fe8-1b5a685ea880\") " pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.322680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnlrl\" (UniqueName: \"kubernetes.io/projected/4640c960-6c19-446d-9e43-e507f8d62cb8-kube-api-access-xnlrl\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.322946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsbf\" (UniqueName: \"kubernetes.io/projected/5a90dd5c-dfae-4609-a442-73a50777e1f5-kube-api-access-bcsbf\") pod \"tuned-7n79f\" (UID: \"5a90dd5c-dfae-4609-a442-73a50777e1f5\") " pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.323042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btg8n\" (UniqueName: \"kubernetes.io/projected/3ae0136d-1fcb-41f6-989b-3313c618d119-kube-api-access-btg8n\") pod \"node-ca-mctxb\" (UID: \"3ae0136d-1fcb-41f6-989b-3313c618d119\") " pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.598404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.323278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgcb\" (UniqueName: \"kubernetes.io/projected/aab2ef30-1c22-439a-9b7d-c79c052518ff-kube-api-access-rzgcb\") pod \"node-resolver-ng76h\" (UID: \"aab2ef30-1c22-439a-9b7d-c79c052518ff\") " pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.326011 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab7eed552bf0f55450ac626aafbdf1d.slice/crio-da82e9e9bd52693062306548e762478d43c49fa2e2b7e04889fde8c133b106f2 WatchSource:0}: Error finding container da82e9e9bd52693062306548e762478d43c49fa2e2b7e04889fde8c133b106f2: Status 404 returned error can't find the container with id da82e9e9bd52693062306548e762478d43c49fa2e2b7e04889fde8c133b106f2 May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.326188 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8224d5ca3b6bacb7ce9024efcbf250f8.slice/crio-c51bc8423e11ccc1064f307a32ef1125fb6430c35f78b42b1ed1e6c56002067e WatchSource:0}: Error finding container c51bc8423e11ccc1064f307a32ef1125fb6430c35f78b42b1ed1e6c56002067e: Status 404 returned error can't find the container with id c51bc8423e11ccc1064f307a32ef1125fb6430c35f78b42b1ed1e6c56002067e May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.327977 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.327996 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.328008 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.328070 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:12.828056321 +0000 UTC m=+2.099952398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.330110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlcd\" (UniqueName: \"kubernetes.io/projected/8026789c-5011-4c2a-b0fa-225fa3185850-kube-api-access-zdlcd\") pod \"iptables-alerter-nnlcc\" (UID: \"8026789c-5011-4c2a-b0fa-225fa3185850\") " pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.330786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lv7\" (UniqueName: \"kubernetes.io/projected/711c2ea3-b86c-4e75-a166-60f426d56d98-kube-api-access-p8lv7\") pod \"multus-additional-cni-plugins-85d9x\" (UID: \"711c2ea3-b86c-4e75-a166-60f426d56d98\") " pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.331571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqzc\" (UniqueName: \"kubernetes.io/projected/fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d-kube-api-access-xbqzc\") pod \"multus-92q8m\" (UID: \"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d\") " pod="openshift-multus/multus-92q8m" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.332199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n49g\" (UniqueName: \"kubernetes.io/projected/4ee64c9a-bd2a-4950-9cd6-f2e097efd148-kube-api-access-4n49g\") pod \"aws-ebs-csi-driver-node-x2bkh\" (UID: \"4ee64c9a-bd2a-4950-9cd6-f2e097efd148\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.332836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxml\" (UniqueName: \"kubernetes.io/projected/a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79-kube-api-access-8cxml\") pod \"ovnkube-node-vjpld\" (UID: \"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.333080 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.335405 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" event={"ID":"5ab7eed552bf0f55450ac626aafbdf1d","Type":"ContainerStarted","Data":"da82e9e9bd52693062306548e762478d43c49fa2e2b7e04889fde8c133b106f2"} May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.338704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" event={"ID":"8224d5ca3b6bacb7ce9024efcbf250f8","Type":"ContainerStarted","Data":"c51bc8423e11ccc1064f307a32ef1125fb6430c35f78b42b1ed1e6c56002067e"} May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.347758 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92q8m" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.355032 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnlcc" May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.358190 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4a4d94_4215_4db9_b7ce_4ea5c3dc849d.slice/crio-a75951a03dd34d85b44fd988549f8f458ee5bb0007115883069584e0f22a7c34 WatchSource:0}: Error finding container a75951a03dd34d85b44fd988549f8f458ee5bb0007115883069584e0f22a7c34: Status 404 returned error can't find the container with id a75951a03dd34d85b44fd988549f8f458ee5bb0007115883069584e0f22a7c34 May 21 14:04:12.598990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.360348 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.362866 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8026789c_5011_4c2a_b0fa_225fa3185850.slice/crio-08b474905d45e2de0b9ad936b0a62f0ed9c11f2c45e9224576ddcf0bc0a55ac6 WatchSource:0}: Error finding container 08b474905d45e2de0b9ad936b0a62f0ed9c11f2c45e9224576ddcf0bc0a55ac6: Status 404 returned error can't find the container with id 08b474905d45e2de0b9ad936b0a62f0ed9c11f2c45e9224576ddcf0bc0a55ac6 May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.367211 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03aeb8c_ba9e_4ca7_b33c_7c7949df7a79.slice/crio-a287cf9b7615578cc2735b1c12318bf8df7fba7c7496a064ef60baedd5e20806 WatchSource:0}: Error finding container a287cf9b7615578cc2735b1c12318bf8df7fba7c7496a064ef60baedd5e20806: Status 404 returned error can't find the container with id a287cf9b7615578cc2735b1c12318bf8df7fba7c7496a064ef60baedd5e20806 May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.415674 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.514031 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85d9x" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.521517 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711c2ea3_b86c_4e75_a166_60f426d56d98.slice/crio-33b260a976d724c072af865cbaa457d64014eb32316ed8a6e511d578160b2ed9 WatchSource:0}: Error finding container 33b260a976d724c072af865cbaa457d64014eb32316ed8a6e511d578160b2ed9: Status 404 returned error can't find the container with id 33b260a976d724c072af865cbaa457d64014eb32316ed8a6e511d578160b2ed9 May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.533565 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.540127 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee64c9a_bd2a_4950_9cd6_f2e097efd148.slice/crio-79fae20218f28166bae599960a21c1aed7274aba83c7686d34104a66455da14c WatchSource:0}: Error finding container 79fae20218f28166bae599960a21c1aed7274aba83c7686d34104a66455da14c: Status 404 returned error can't find the container with id 79fae20218f28166bae599960a21c1aed7274aba83c7686d34104a66455da14c May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.557682 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7n79f" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.562568 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a90dd5c_dfae_4609_a442_73a50777e1f5.slice/crio-549203aebc721397740b8a3e3dd541af802fb19f68d8d76d93b2d06d0fb95f34 WatchSource:0}: Error finding container 549203aebc721397740b8a3e3dd541af802fb19f68d8d76d93b2d06d0fb95f34: Status 404 returned error can't find the container with id 549203aebc721397740b8a3e3dd541af802fb19f68d8d76d93b2d06d0fb95f34 May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.571139 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mctxb" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.576114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae0136d_1fcb_41f6_989b_3313c618d119.slice/crio-b9b44d7c259604fefec9bee5d6954146d7d12248baf9eb3671c010950b52ac7e WatchSource:0}: Error finding container b9b44d7c259604fefec9bee5d6954146d7d12248baf9eb3671c010950b52ac7e: Status 404 returned error can't find the container with id b9b44d7c259604fefec9bee5d6954146d7d12248baf9eb3671c010950b52ac7e May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.576942 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:12.599723 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.582755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bbdf39_5504_4540_8fe8_1b5a685ea880.slice/crio-d346045c7b570e054d23d5311961ddec00ba7a0de21f2ea6ea5e6d57484b518c WatchSource:0}: Error finding container d346045c7b570e054d23d5311961ddec00ba7a0de21f2ea6ea5e6d57484b518c: Status 404 returned error can't find the container with id d346045c7b570e054d23d5311961ddec00ba7a0de21f2ea6ea5e6d57484b518c May 21 14:04:12.609699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.609677 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng76h" May 21 14:04:12.614877 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:12.614858 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab2ef30_1c22_439a_9b7d_c79c052518ff.slice/crio-386b7119b915055b28700beff73219b93cd88d6827c75008b336a9fe345759d2 WatchSource:0}: Error finding container 386b7119b915055b28700beff73219b93cd88d6827c75008b336a9fe345759d2: Status 404 returned error can't find the container with id 386b7119b915055b28700beff73219b93cd88d6827c75008b336a9fe345759d2 May 21 14:04:12.823597 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.823532 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:12.823797 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.823728 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:12.823797 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.823795 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:13.823776371 +0000 UTC m=+3.095672465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:12.924417 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:12.924314 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:12.924571 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.924542 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:12.924571 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.924561 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:12.924703 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.924574 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:12.924703 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:12.924652 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:13.924617652 +0000 UTC m=+3.196513742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:13.272422 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.272318 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 13:59:12 +0000 UTC" deadline="2027-11-10 21:45:29.253416132 +0000 UTC" May 21 14:04:13.272422 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.272360 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12919h41m15.981059988s" May 21 14:04:13.344925 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.344418 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:13.344925 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.344542 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:13.365918 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.365836 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7n79f" event={"ID":"5a90dd5c-dfae-4609-a442-73a50777e1f5","Type":"ContainerStarted","Data":"549203aebc721397740b8a3e3dd541af802fb19f68d8d76d93b2d06d0fb95f34"} May 21 14:04:13.379249 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.379209 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" event={"ID":"4ee64c9a-bd2a-4950-9cd6-f2e097efd148","Type":"ContainerStarted","Data":"79fae20218f28166bae599960a21c1aed7274aba83c7686d34104a66455da14c"} May 21 14:04:13.388254 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.388091 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92q8m" event={"ID":"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d","Type":"ContainerStarted","Data":"a75951a03dd34d85b44fd988549f8f458ee5bb0007115883069584e0f22a7c34"} May 21 14:04:13.402997 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.402939 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mctxb" event={"ID":"3ae0136d-1fcb-41f6-989b-3313c618d119","Type":"ContainerStarted","Data":"b9b44d7c259604fefec9bee5d6954146d7d12248baf9eb3671c010950b52ac7e"} May 21 14:04:13.410649 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.410602 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:13.415186 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.415152 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerStarted","Data":"33b260a976d724c072af865cbaa457d64014eb32316ed8a6e511d578160b2ed9"} May 21 14:04:13.429283 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.429145 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"a287cf9b7615578cc2735b1c12318bf8df7fba7c7496a064ef60baedd5e20806"} May 21 14:04:13.445205 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.445165 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnlcc" event={"ID":"8026789c-5011-4c2a-b0fa-225fa3185850","Type":"ContainerStarted","Data":"08b474905d45e2de0b9ad936b0a62f0ed9c11f2c45e9224576ddcf0bc0a55ac6"} May 21 14:04:13.457930 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.457819 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng76h" event={"ID":"aab2ef30-1c22-439a-9b7d-c79c052518ff","Type":"ContainerStarted","Data":"386b7119b915055b28700beff73219b93cd88d6827c75008b336a9fe345759d2"} May 21 14:04:13.469191 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.469154 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cchrm" event={"ID":"30bbdf39-5504-4540-8fe8-1b5a685ea880","Type":"ContainerStarted","Data":"d346045c7b570e054d23d5311961ddec00ba7a0de21f2ea6ea5e6d57484b518c"} May 21 14:04:13.539651 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.539610 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:13.835131 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.834457 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:13.835131 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.834638 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:13.835131 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.834705 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:15.834684884 +0000 UTC m=+5.106580975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:13.935056 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:13.934991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:13.935239 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.935199 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:13.935239 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.935218 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:13.935239 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.935231 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:13.935408 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:13.935303 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:15.935284081 +0000 UTC m=+5.207180163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:14.276827 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:14.276733 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 13:59:12 +0000 UTC" deadline="2028-02-12 09:21:56.480273824 +0000 UTC" May 21 14:04:14.276827 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:14.276773 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15163h17m42.203504565s" May 21 14:04:14.333655 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:14.333085 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:14.333655 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:14.333236 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:15.184966 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:15.184736 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:04:15.341394 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:15.339426 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:15.341394 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.339600 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:15.851920 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:15.851245 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:15.851920 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.851447 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:15.851920 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.851515 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:19.851496162 +0000 UTC m=+9.123392255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:15.952106 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:15.952058 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:15.952291 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.952251 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:15.952291 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.952270 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:15.952291 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.952282 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:15.952434 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:15.952346 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:19.952325507 +0000 UTC m=+9.224221605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:16.333651 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:16.333141 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:16.333651 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:16.333287 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:17.334882 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:17.334653 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:17.334882 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:17.334783 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:18.333410 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:18.333056 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:18.333410 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:18.333204 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:19.333508 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:19.333479 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:19.333963 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.333605 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:19.884670 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:19.884618 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:19.884845 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.884766 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:19.884845 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.884832 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:27.884812447 +0000 UTC m=+17.156708542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:19.985747 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:19.985702 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:19.985908 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.985893 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:19.985965 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.985917 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:19.985965 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.985929 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:19.986070 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:19.985994 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:27.985975353 +0000 UTC m=+17.257871443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:20.333672 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:20.333154 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:20.333672 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:20.333305 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:21.334297 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:21.333715 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:21.334297 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:21.333862 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:22.333257 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:22.333218 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:22.333421 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:22.333355 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:23.333144 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:23.333113 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:23.333513 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:23.333225 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:24.333896 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:24.333868 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:24.334337 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:24.334040 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:25.333556 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:25.333521 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:25.333732 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:25.333654 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:26.333514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:26.333475 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:26.333945 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:26.333649 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:27.333943 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:27.333833 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:27.334358 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:27.333957 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:27.944568 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:27.944533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:27.944794 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:27.944657 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:27.944794 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:27.944725 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:43.944705292 +0000 UTC m=+33.216601374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:28.044957 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:28.044920 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:28.045123 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:28.045063 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:28.045123 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:28.045078 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:28.045123 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:28.045087 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:28.045263 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:28.045142 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:04:44.045127898 +0000 UTC m=+33.317024168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:28.333167 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:28.333075 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:28.333335 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:28.333220 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:29.333466 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:29.333431 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:29.333932 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:29.333558 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:30.333132 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:30.333100 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:30.333316 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:30.333228 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:31.334459 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:31.334418 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:31.334885 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:31.334517 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:32.333412 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.333016 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:32.333481 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:32.333400 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:32.525141 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.524978 2559 generic.go:358] "Generic (PLEG): container finished" podID="5ab7eed552bf0f55450ac626aafbdf1d" containerID="ed194c60294a83cd9b47b074d9096482453aa4904c2ae915804072d71e5f5a94" exitCode=0 May 21 14:04:32.525804 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.525053 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" event={"ID":"5ab7eed552bf0f55450ac626aafbdf1d","Type":"ContainerDied","Data":"ed194c60294a83cd9b47b074d9096482453aa4904c2ae915804072d71e5f5a94"} May 21 14:04:32.526431 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.526409 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng76h" event={"ID":"aab2ef30-1c22-439a-9b7d-c79c052518ff","Type":"ContainerStarted","Data":"fd1ce65a83d2c9aab47c30bed711cc59cbb4f08a951ffdb496a350cb3a4233ae"} May 21 14:04:32.527612 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.527582 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cchrm" event={"ID":"30bbdf39-5504-4540-8fe8-1b5a685ea880","Type":"ContainerStarted","Data":"c38f493196528c73e050f55d09d96cdab5b7952d5f3da07fdb26568e67e6bc45"} May 21 14:04:32.528724 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.528703 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7n79f" event={"ID":"5a90dd5c-dfae-4609-a442-73a50777e1f5","Type":"ContainerStarted","Data":"04712ff4723c270cebffc48ea1223214697e71423ee3a97292ff7e1355e49854"} May 21 14:04:32.530060 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.530037 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" event={"ID":"4ee64c9a-bd2a-4950-9cd6-f2e097efd148","Type":"ContainerStarted","Data":"cdad961a8a75fc2807980207b65377e2f63ce4947097f111500fe2cf4c590163"} May 21 14:04:32.531425 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.531392 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92q8m" event={"ID":"fa4a4d94-4215-4db9-b7ce-4ea5c3dc849d","Type":"ContainerStarted","Data":"aeb025abc025b6e74a8cee3369f5fe54633131d231798fb91beef0c32dc1285e"} May 21 14:04:32.532722 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.532700 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" event={"ID":"8224d5ca3b6bacb7ce9024efcbf250f8","Type":"ContainerStarted","Data":"10b25da1ec257c09fd25ca916ffbf15e1e06f070bded12258c7403f6d45708e2"} May 21 14:04:32.533854 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.533833 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mctxb" event={"ID":"3ae0136d-1fcb-41f6-989b-3313c618d119","Type":"ContainerStarted","Data":"80c6f94955f48a36a81af0fd446c54bbb7dc14482ae0c2236735753bb4eccb15"} May 21 14:04:32.535051 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.535032 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="5e3f7d9f9ff8ac2b77516fdd2798856efaaf6e317ee8dd8e37826a5535b5ed61" exitCode=0 May 21 14:04:32.535117 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.535091 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"5e3f7d9f9ff8ac2b77516fdd2798856efaaf6e317ee8dd8e37826a5535b5ed61"} May 21 14:04:32.537143 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.537123 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"8b15bf0632184133e5b68056d98a330b266c8c7dff2f3b23523893b3a34b2c50"} May 21 14:04:32.537236 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.537149 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"061cf36a7994aaa9e1921ac3355e88079b1b29d10ff2f472d872198ff2ccf6a3"} May 21 14:04:32.537236 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.537159 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"48806dd072faba6b79527546c3b6feb7ba5b958e46e7c384368eb4e4901b5c4a"} May 21 14:04:32.537236 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.537168 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"471b94f888c4d33555968d8637dcbca71a691e12553337031b3252e826586695"} May 21 14:04:32.541461 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.541412 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ng76h" podStartSLOduration=2.661043522 podStartE2EDuration="21.541399158s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.61619865 +0000 UTC m=+1.888094740" lastFinishedPulling="2026-05-21 14:04:31.496554297 +0000 UTC m=+20.768450376" observedRunningTime="2026-05-21 14:04:32.541180501 +0000 UTC m=+21.813076601" watchObservedRunningTime="2026-05-21 14:04:32.541399158 +0000 UTC m=+21.813295260" May 21 14:04:32.562254 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.562208 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-92q8m" podStartSLOduration=2.278789634 podStartE2EDuration="21.562190914s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.360776861 +0000 UTC m=+1.632672946" lastFinishedPulling="2026-05-21 14:04:31.644178145 +0000 UTC m=+20.916074226" observedRunningTime="2026-05-21 14:04:32.561806909 +0000 UTC m=+21.833703008" watchObservedRunningTime="2026-05-21 14:04:32.562190914 +0000 UTC m=+21.834087014" May 21 14:04:32.603548 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.603499 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7n79f" podStartSLOduration=2.681767509 podStartE2EDuration="21.603484494s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.563940158 +0000 UTC m=+1.835836238" lastFinishedPulling="2026-05-21 14:04:31.485657133 +0000 UTC m=+20.757553223" observedRunningTime="2026-05-21 14:04:32.602897874 +0000 UTC m=+21.874793973" watchObservedRunningTime="2026-05-21 14:04:32.603484494 +0000 UTC m=+21.875380592" May 21 14:04:32.641347 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.641308 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cchrm" podStartSLOduration=2.7394144110000003 podStartE2EDuration="21.641293586s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.583773444 +0000 UTC m=+1.855669525" lastFinishedPulling="2026-05-21 14:04:31.485652614 +0000 UTC m=+20.757548700" observedRunningTime="2026-05-21 14:04:32.622559146 +0000 UTC m=+21.894455236" watchObservedRunningTime="2026-05-21 14:04:32.641293586 +0000 UTC m=+21.913189685" May 21 14:04:32.641463 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.641375 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-85.ec2.internal" podStartSLOduration=20.64137215 podStartE2EDuration="20.64137215s" podCreationTimestamp="2026-05-21 14:04:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:04:32.640964884 +0000 UTC m=+21.912860983" watchObservedRunningTime="2026-05-21 14:04:32.64137215 +0000 UTC m=+21.913268248" May 21 14:04:32.660694 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:32.660655 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mctxb" podStartSLOduration=2.743318534 podStartE2EDuration="21.660619548s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.577384565 +0000 UTC m=+1.849280642" lastFinishedPulling="2026-05-21 14:04:31.494685565 +0000 UTC m=+20.766581656" observedRunningTime="2026-05-21 14:04:32.660471313 +0000 UTC m=+21.932367415" watchObservedRunningTime="2026-05-21 14:04:32.660619548 +0000 UTC m=+21.932515647" May 21 14:04:33.333665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.333608 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:33.333915 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:33.333798 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:33.367452 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.367420 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:04:33.542791 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.542701 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"07ef9e3adb8b25e79adcdc04522d7dafb7b8b3ca8d335824dc9b9a6c886afa0b"} May 21 14:04:33.542791 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.542745 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"979c43f96683f9ef403139ed27946441554d6045b4a44de142af5484c91a4460"} May 21 14:04:33.544304 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.544272 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnlcc" event={"ID":"8026789c-5011-4c2a-b0fa-225fa3185850","Type":"ContainerStarted","Data":"0a995c1ffc2e6a354df6a2a87875debaa49376864d62874a3ef55c4777cba022"} May 21 14:04:33.546070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.545957 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" event={"ID":"4ee64c9a-bd2a-4950-9cd6-f2e097efd148","Type":"ContainerStarted","Data":"83d5f832288ae22c5fa35bdec3987cd628db7d11b004cccdc9ca1206bcc1aa52"} May 21 14:04:33.577161 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:33.576166 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnlcc" podStartSLOduration=3.4550831779999998 podStartE2EDuration="22.576147171s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.364432548 +0000 UTC m=+1.636328625" lastFinishedPulling="2026-05-21 14:04:31.485496536 +0000 UTC m=+20.757392618" observedRunningTime="2026-05-21 14:04:33.559315242 +0000 UTC m=+22.831211342" watchObservedRunningTime="2026-05-21 14:04:33.576147171 +0000 UTC m=+22.848043271" May 21 14:04:34.263657 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.263541 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:04:33.36744431Z","UUID":"4ed18e48-2cd8-4850-ae27-7fdc7339199e","Handler":null,"Name":"","Endpoint":""} May 21 14:04:34.267138 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.267115 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:04:34.267138 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.267145 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:04:34.333521 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.333491 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:34.333673 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:34.333620 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:34.550277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.550245 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" event={"ID":"5ab7eed552bf0f55450ac626aafbdf1d","Type":"ContainerStarted","Data":"0050bbf52d8d48ca4aa78c5cfa92c63f666b2458d1a36a30409954c4daa1944c"} May 21 14:04:34.565798 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:34.565759 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-85.ec2.internal" podStartSLOduration=22.565745402 podStartE2EDuration="22.565745402s" podCreationTimestamp="2026-05-21 14:04:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:04:34.564652236 +0000 UTC m=+23.836548337" watchObservedRunningTime="2026-05-21 14:04:34.565745402 +0000 UTC m=+23.837641501" May 21 14:04:35.333117 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:35.333081 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:35.333308 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:35.333188 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:35.553778 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:35.553740 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" event={"ID":"4ee64c9a-bd2a-4950-9cd6-f2e097efd148","Type":"ContainerStarted","Data":"0cea9fc8ad4d7df4817d976775b3992cb23bcb2bff115c31201b86a506bb4b97"} May 21 14:04:35.557217 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:35.557183 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"54da40abd362935fd31b9f27ade184577159b9d794ed47edc5703e99cf105f76"} May 21 14:04:35.572000 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:35.571941 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2bkh" podStartSLOduration=2.592436895 podStartE2EDuration="24.571921106s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.541305933 +0000 UTC m=+1.813202010" lastFinishedPulling="2026-05-21 14:04:34.52079013 +0000 UTC m=+23.792686221" observedRunningTime="2026-05-21 14:04:35.571476331 +0000 UTC m=+24.843372441" watchObservedRunningTime="2026-05-21 14:04:35.571921106 +0000 UTC m=+24.843817205" May 21 14:04:36.333527 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:36.333341 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:36.333692 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:36.333645 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:36.786458 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:36.786426 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:36.787093 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:36.787075 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:37.334072 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.333968 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:37.334203 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:37.334072 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:37.561379 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.561344 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="be9af871660c2ff2c1ba427e2cbc2b75901b0bf5fd47372c7372d73c4abb935f" exitCode=0 May 21 14:04:37.561539 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.561435 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"be9af871660c2ff2c1ba427e2cbc2b75901b0bf5fd47372c7372d73c4abb935f"} May 21 14:04:37.564658 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.564615 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" event={"ID":"a03aeb8c-ba9e-4ca7-b33c-7c7949df7a79","Type":"ContainerStarted","Data":"d3c7a133a6ccaadee41f420862a0d8cc36581f22d6d87363555e38f9b09e7c03"} May 21 14:04:37.564858 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.564826 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:37.567860 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.565825 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:37.567860 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.565867 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:37.567860 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.565882 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:37.568320 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.568303 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cchrm" May 21 14:04:37.583440 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.583417 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:37.583573 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.583482 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:04:37.631825 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:37.631721 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" podStartSLOduration=6.936925004 podStartE2EDuration="26.631705961s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.368638613 +0000 UTC m=+1.640534690" lastFinishedPulling="2026-05-21 14:04:32.06341955 +0000 UTC m=+21.335315647" observedRunningTime="2026-05-21 14:04:37.631641443 +0000 UTC m=+26.903537535" watchObservedRunningTime="2026-05-21 14:04:37.631705961 +0000 UTC m=+26.903602099" May 21 14:04:38.333162 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:38.333127 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:38.333606 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:38.333243 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:38.569023 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:38.568982 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="e8640517644369b1c7f3859cdb0b0881aa39ebf82124a022246d4a9048b3535d" exitCode=0 May 21 14:04:38.569169 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:38.569048 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"e8640517644369b1c7f3859cdb0b0881aa39ebf82124a022246d4a9048b3535d"} May 21 14:04:39.203271 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:39.203238 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlk25"] May 21 14:04:39.203415 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:39.203366 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:39.203468 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:39.203447 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:39.207331 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:39.207304 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvwsb"] May 21 14:04:39.207456 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:39.207408 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:39.207504 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:39.207487 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:40.333335 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:40.333304 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:40.333755 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:40.333307 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:40.333755 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:40.333432 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:40.333755 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:40.333494 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:40.575580 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:40.575545 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="fa33629d724a695bb5ed9a5c0b852fa919d3836d16ab6fcece3e9be3e1a5ae65" exitCode=0 May 21 14:04:40.575759 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:40.575603 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"fa33629d724a695bb5ed9a5c0b852fa919d3836d16ab6fcece3e9be3e1a5ae65"} May 21 14:04:42.332982 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:42.332951 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:42.333529 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:42.332962 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:42.333529 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:42.333061 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:42.333529 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:42.333149 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:43.969885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:43.969848 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:43.970390 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:43.970012 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:43.970390 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:43.970096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:05:15.97006419 +0000 UTC m=+65.241960268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:44.071071 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.071034 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:44.071249 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.071207 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:44.071249 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.071228 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:44.071249 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.071241 2559 projected.go:194] Error preparing data for projected volume kube-api-access-2wr5n for pod openshift-network-diagnostics/network-check-target-tlk25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:44.071413 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.071311 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n podName:ed746a16-3fc0-4c2d-984b-06236cbe9dfa nodeName:}" failed. No retries permitted until 2026-05-21 14:05:16.071291176 +0000 UTC m=+65.343187273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wr5n" (UniqueName: "kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n") pod "network-check-target-tlk25" (UID: "ed746a16-3fc0-4c2d-984b-06236cbe9dfa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:44.333423 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.333339 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:44.333423 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.333373 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:44.333659 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.333482 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:04:44.333659 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.333637 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlk25" podUID="ed746a16-3fc0-4c2d-984b-06236cbe9dfa" May 21 14:04:44.549833 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.549806 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-85.ec2.internal" event="NodeReady" May 21 14:04:44.550009 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.549942 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:04:44.614949 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.614851 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jtdln"] May 21 14:04:44.646331 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.646301 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4mldb"] May 21 14:04:44.646492 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.646457 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.649222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.649197 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:04:44.649222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.649201 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v7ff7\"" May 21 14:04:44.649407 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.649268 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:04:44.660471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.660447 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4mldb"] May 21 14:04:44.660580 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.660479 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtdln"] May 21 14:04:44.660637 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.660593 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:44.663142 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.663095 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:04:44.663582 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.663374 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8szvz\"" May 21 14:04:44.663582 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.663457 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:04:44.663582 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.663381 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:04:44.777094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df665aa-9805-4ba0-99d5-d6eeafedfb83-config-volume\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.777273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:44.777273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74g4\" (UniqueName: \"kubernetes.io/projected/6df665aa-9805-4ba0-99d5-d6eeafedfb83-kube-api-access-b74g4\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.777273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.777273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrms\" (UniqueName: \"kubernetes.io/projected/764a2c35-44d7-4a1a-905a-5818b012f2ae-kube-api-access-wvrms\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:44.777273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.777255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df665aa-9805-4ba0-99d5-d6eeafedfb83-tmp-dir\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.878417 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878327 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.878417 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878380 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrms\" (UniqueName: \"kubernetes.io/projected/764a2c35-44d7-4a1a-905a-5818b012f2ae-kube-api-access-wvrms\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:44.878654 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.878495 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:44.878654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878507 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df665aa-9805-4ba0-99d5-d6eeafedfb83-tmp-dir\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.878654 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.878569 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:45.378547326 +0000 UTC m=+34.650443409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:04:44.878654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878611 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df665aa-9805-4ba0-99d5-d6eeafedfb83-config-volume\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.878845 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878673 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:44.878845 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.878713 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b74g4\" (UniqueName: \"kubernetes.io/projected/6df665aa-9805-4ba0-99d5-d6eeafedfb83-kube-api-access-b74g4\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.878845 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.878817 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:44.878947 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:44.878871 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:04:45.378857521 +0000 UTC m=+34.650753605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:04:44.879080 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.879058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6df665aa-9805-4ba0-99d5-d6eeafedfb83-tmp-dir\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.879235 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.879216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6df665aa-9805-4ba0-99d5-d6eeafedfb83-config-volume\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.890848 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.890826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74g4\" (UniqueName: \"kubernetes.io/projected/6df665aa-9805-4ba0-99d5-d6eeafedfb83-kube-api-access-b74g4\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:44.890996 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:44.890955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrms\" (UniqueName: \"kubernetes.io/projected/764a2c35-44d7-4a1a-905a-5818b012f2ae-kube-api-access-wvrms\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:45.383338 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:45.383299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:45.383957 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:45.383392 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:45.383957 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:45.383452 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:45.383957 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:45.383475 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:45.383957 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:45.383521 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:46.383502163 +0000 UTC m=+35.655398240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:04:45.383957 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:45.383561 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:04:46.383534949 +0000 UTC m=+35.655431068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:04:46.333615 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.333581 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:04:46.333773 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.333657 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:04:46.336581 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.336560 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:04:46.337660 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.337617 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:04:46.337797 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.337779 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgr2\"" May 21 14:04:46.337879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.337805 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:04:46.337879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.337823 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2rcd\"" May 21 14:04:46.392411 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.392385 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:46.392698 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:46.392430 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:46.392698 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:46.392527 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:46.392698 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:46.392533 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:46.392698 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:46.392575 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:48.392562983 +0000 UTC m=+37.664459060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:04:46.392698 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:46.392587 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:04:48.392581611 +0000 UTC m=+37.664477688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:04:47.589317 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:47.589131 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="1516e2d43c25315307c2cdc9e80ded85d80b9d7af14f87213a1745e497135f2e" exitCode=0 May 21 14:04:47.589715 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:47.589219 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"1516e2d43c25315307c2cdc9e80ded85d80b9d7af14f87213a1745e497135f2e"} May 21 14:04:48.405277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:48.405241 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:48.405426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:48.405310 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:48.405751 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:48.405650 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:48.405751 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:48.405683 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:48.405949 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:48.405754 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:04:52.405721129 +0000 UTC m=+41.677617228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:04:48.405949 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:48.405788 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:52.405777338 +0000 UTC m=+41.677673429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:04:48.594262 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:48.594220 2559 generic.go:358] "Generic (PLEG): container finished" podID="711c2ea3-b86c-4e75-a166-60f426d56d98" containerID="ae38261a79d1c9d99a363b198eb517149e33aea7c40759722f7b76096c95da41" exitCode=0 May 21 14:04:48.594611 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:48.594281 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerDied","Data":"ae38261a79d1c9d99a363b198eb517149e33aea7c40759722f7b76096c95da41"} May 21 14:04:49.598612 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:49.598576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85d9x" event={"ID":"711c2ea3-b86c-4e75-a166-60f426d56d98","Type":"ContainerStarted","Data":"7bc363dd21083c2059ebc566c1404fef20f135e06198f4b8d25aea9d1618c6d3"} May 21 14:04:49.622523 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:49.622472 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-85d9x" podStartSLOduration=4.417957306 podStartE2EDuration="38.622457387s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:04:12.522862258 +0000 UTC m=+1.794758348" lastFinishedPulling="2026-05-21 14:04:46.727362333 +0000 UTC m=+35.999258429" observedRunningTime="2026-05-21 14:04:49.621274579 +0000 UTC m=+38.893170677" watchObservedRunningTime="2026-05-21 14:04:49.622457387 +0000 UTC m=+38.894353487" May 21 14:04:52.437200 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:52.437164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:04:52.437597 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:52.437224 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:04:52.437597 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:52.437328 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:52.437597 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:52.437342 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:52.437597 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:52.437376 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:05:00.437362754 +0000 UTC m=+49.709258831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:04:52.437597 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:04:52.437404 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:05:00.43738604 +0000 UTC m=+49.709282116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:04:55.273197 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.273158 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br"] May 21 14:04:55.305363 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.305330 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br"] May 21 14:04:55.305532 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.305454 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.308240 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.308215 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 14:04:55.308365 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.308215 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 14:04:55.309205 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.309186 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 14:04:55.309205 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.309192 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 14:04:55.458455 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.458413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9086928a-4e6c-4970-931e-a6261b017ba2-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.458649 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.458472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9086928a-4e6c-4970-931e-a6261b017ba2-tmp\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.458649 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.458540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7zc\" (UniqueName: \"kubernetes.io/projected/9086928a-4e6c-4970-931e-a6261b017ba2-kube-api-access-2l7zc\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.558974 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.558884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9086928a-4e6c-4970-931e-a6261b017ba2-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.558974 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.558948 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9086928a-4e6c-4970-931e-a6261b017ba2-tmp\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.558974 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.558978 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7zc\" (UniqueName: \"kubernetes.io/projected/9086928a-4e6c-4970-931e-a6261b017ba2-kube-api-access-2l7zc\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.559355 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.559329 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9086928a-4e6c-4970-931e-a6261b017ba2-tmp\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.562448 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.562425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9086928a-4e6c-4970-931e-a6261b017ba2-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.567846 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.567822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7zc\" (UniqueName: \"kubernetes.io/projected/9086928a-4e6c-4970-931e-a6261b017ba2-kube-api-access-2l7zc\") pod \"klusterlet-addon-workmgr-58f85c89d6-f99br\" (UID: \"9086928a-4e6c-4970-931e-a6261b017ba2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.613928 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.613897 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:04:55.794742 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:55.794710 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br"] May 21 14:04:55.798705 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:04:55.798678 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9086928a_4e6c_4970_931e_a6261b017ba2.slice/crio-1d2e9bca629b0e91307178513ce7bf9a5d42e8c18279cb2bc9a671353d5f9f5e WatchSource:0}: Error finding container 1d2e9bca629b0e91307178513ce7bf9a5d42e8c18279cb2bc9a671353d5f9f5e: Status 404 returned error can't find the container with id 1d2e9bca629b0e91307178513ce7bf9a5d42e8c18279cb2bc9a671353d5f9f5e May 21 14:04:56.611830 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:04:56.611795 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" event={"ID":"9086928a-4e6c-4970-931e-a6261b017ba2","Type":"ContainerStarted","Data":"1d2e9bca629b0e91307178513ce7bf9a5d42e8c18279cb2bc9a671353d5f9f5e"} May 21 14:05:00.498182 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.497845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:05:00.498182 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.497917 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:05:00.498182 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:00.498043 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:05:00.498182 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:00.498104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:05:16.498083614 +0000 UTC m=+65.769979715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:05:00.498770 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:00.498282 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:05:00.498770 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:00.498338 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:05:16.498322124 +0000 UTC m=+65.770218203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:05:00.620244 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.620164 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" event={"ID":"9086928a-4e6c-4970-931e-a6261b017ba2","Type":"ContainerStarted","Data":"2198a1bcac3b3843bf85157081ccb2a7d0c2e6b8fc871e69da8b086f24f968fb"} May 21 14:05:00.620432 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.620352 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:05:00.621723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.621696 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:05:00.635778 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:00.635738 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" podStartSLOduration=1.083541807 podStartE2EDuration="5.635727033s" podCreationTimestamp="2026-05-21 14:04:55 +0000 UTC" firstStartedPulling="2026-05-21 14:04:55.801074288 +0000 UTC m=+45.072970369" lastFinishedPulling="2026-05-21 14:05:00.353259488 +0000 UTC m=+49.625155595" observedRunningTime="2026-05-21 14:05:00.634997355 +0000 UTC m=+49.906893453" watchObservedRunningTime="2026-05-21 14:05:00.635727033 +0000 UTC m=+49.907623132" May 21 14:05:09.590066 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:09.590041 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjpld" May 21 14:05:15.986414 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:15.986376 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:05:15.991896 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:15.991874 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:05:15.996811 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:15.996793 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:05:15.996868 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:15.996851 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:19.99683578 +0000 UTC m=+129.268731870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : secret "metrics-daemon-secret" not found May 21 14:05:16.087249 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.087220 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:05:16.090980 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.090961 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:05:16.100881 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.100859 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:05:16.110585 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.110563 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr5n\" (UniqueName: \"kubernetes.io/projected/ed746a16-3fc0-4c2d-984b-06236cbe9dfa-kube-api-access-2wr5n\") pod \"network-check-target-tlk25\" (UID: \"ed746a16-3fc0-4c2d-984b-06236cbe9dfa\") " pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:05:16.360177 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.360103 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgr2\"" May 21 14:05:16.369174 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.369155 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:05:16.508210 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.508182 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlk25"] May 21 14:05:16.511313 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:05:16.511277 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded746a16_3fc0_4c2d_984b_06236cbe9dfa.slice/crio-739656cf839f7bf772258d5b2a8e4deeee860467ebbae19dcdbffd75ed0564e7 WatchSource:0}: Error finding container 739656cf839f7bf772258d5b2a8e4deeee860467ebbae19dcdbffd75ed0564e7: Status 404 returned error can't find the container with id 739656cf839f7bf772258d5b2a8e4deeee860467ebbae19dcdbffd75ed0564e7 May 21 14:05:16.591841 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.591804 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:05:16.591984 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.591869 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:05:16.591984 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:16.591960 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:05:16.592063 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:16.592020 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:05:48.592003753 +0000 UTC m=+97.863899829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:05:16.592063 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:16.591962 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:05:16.592146 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:16.592106 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:05:48.592093753 +0000 UTC m=+97.863989843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:05:16.650373 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:16.650350 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlk25" event={"ID":"ed746a16-3fc0-4c2d-984b-06236cbe9dfa","Type":"ContainerStarted","Data":"739656cf839f7bf772258d5b2a8e4deeee860467ebbae19dcdbffd75ed0564e7"} May 21 14:05:19.657988 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:19.657957 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlk25" event={"ID":"ed746a16-3fc0-4c2d-984b-06236cbe9dfa","Type":"ContainerStarted","Data":"f35fe8e005043c3e751da0956cf8e0b1cb4add5b582f21b8895b46217c78bd48"} May 21 14:05:19.658391 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:19.658084 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:05:19.677192 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:19.677147 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tlk25" podStartSLOduration=66.015877981 podStartE2EDuration="1m8.677133971s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:05:16.513112317 +0000 UTC m=+65.785008406" lastFinishedPulling="2026-05-21 14:05:19.174368298 +0000 UTC m=+68.446264396" observedRunningTime="2026-05-21 14:05:19.67680892 +0000 UTC m=+68.948705020" watchObservedRunningTime="2026-05-21 14:05:19.677133971 +0000 UTC m=+68.949030069" May 21 14:05:48.608847 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:48.608811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:05:48.609295 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:48.608882 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:05:48.609295 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:48.608969 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:05:48.609295 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:48.608992 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:05:48.609295 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:48.609045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls podName:6df665aa-9805-4ba0-99d5-d6eeafedfb83 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:52.609030393 +0000 UTC m=+161.880926470 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls") pod "dns-default-jtdln" (UID: "6df665aa-9805-4ba0-99d5-d6eeafedfb83") : secret "dns-default-metrics-tls" not found May 21 14:05:48.609295 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:05:48.609072 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert podName:764a2c35-44d7-4a1a-905a-5818b012f2ae nodeName:}" failed. No retries permitted until 2026-05-21 14:06:52.609054443 +0000 UTC m=+161.880950539 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert") pod "ingress-canary-4mldb" (UID: "764a2c35-44d7-4a1a-905a-5818b012f2ae") : secret "canary-serving-cert" not found May 21 14:05:50.662437 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:05:50.662409 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tlk25" May 21 14:06:20.041819 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:20.041767 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:06:20.042333 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:20.041920 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:06:20.042333 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:20.041995 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs podName:4640c960-6c19-446d-9e43-e507f8d62cb8 nodeName:}" failed. No retries permitted until 2026-05-21 14:08:22.041976638 +0000 UTC m=+251.313872736 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs") pod "network-metrics-daemon-tvwsb" (UID: "4640c960-6c19-446d-9e43-e507f8d62cb8") : secret "metrics-daemon-secret" not found May 21 14:06:25.911170 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.911135 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf"] May 21 14:06:25.913377 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.913360 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" May 21 14:06:25.915612 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.915590 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 14:06:25.915733 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.915721 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 14:06:25.916845 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.916829 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-57zw9\"" May 21 14:06:25.921582 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:25.921562 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf"] May 21 14:06:26.023813 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.023783 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5475f7447f-48fc4"] May 21 14:06:26.025400 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.025386 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.028735 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.028715 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:06:26.028867 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.028849 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-shx8g\"" May 21 14:06:26.029601 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.029583 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:06:26.031847 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.031831 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:06:26.035027 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.035008 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:06:26.043182 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.043161 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5475f7447f-48fc4"] May 21 14:06:26.084521 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.084496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wb4s\" (UniqueName: \"kubernetes.io/projected/2fd2b16e-16a7-44a9-82a7-d853a512fb79-kube-api-access-5wb4s\") pod \"volume-data-source-validator-5cf8c89d64-shrsf\" (UID: \"2fd2b16e-16a7-44a9-82a7-d853a512fb79\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" May 21 14:06:26.122890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.122865 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc"] May 21 14:06:26.124658 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.124644 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.129070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.129050 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 14:06:26.129167 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.129096 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 14:06:26.129388 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.129364 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 14:06:26.129491 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.129425 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x8r46\"" May 21 14:06:26.137963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.137943 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc"] May 21 14:06:26.185779 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wb4s\" (UniqueName: \"kubernetes.io/projected/2fd2b16e-16a7-44a9-82a7-d853a512fb79-kube-api-access-5wb4s\") pod \"volume-data-source-validator-5cf8c89d64-shrsf\" (UID: \"2fd2b16e-16a7-44a9-82a7-d853a512fb79\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" May 21 14:06:26.185779 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.185938 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57hbz\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.185938 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.185938 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.185938 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.185938 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.185938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.186109 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.186011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.186109 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.186039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.193458 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.193438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wb4s\" (UniqueName: \"kubernetes.io/projected/2fd2b16e-16a7-44a9-82a7-d853a512fb79-kube-api-access-5wb4s\") pod \"volume-data-source-validator-5cf8c89d64-shrsf\" (UID: \"2fd2b16e-16a7-44a9-82a7-d853a512fb79\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" May 21 14:06:26.222375 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.222347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" May 21 14:06:26.286968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.286937 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287101 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.286972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287101 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.286997 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287101 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287020 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287101 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287084 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287226 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.287121 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:26.287226 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.287139 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:26.287226 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.287203 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.787186644 +0000 UTC m=+136.059082721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:26.287567 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287112 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287567 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.287567 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287446 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287567 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wcx\" (UniqueName: \"kubernetes.io/projected/e223dc0d-9444-47b8-9ffd-01c9ee73976b-kube-api-access-d6wcx\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.287567 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57hbz\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.287890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.287871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.288284 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.288264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.288435 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.288416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.290122 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.290093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.290605 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.290587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.296516 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.296235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57hbz\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.296516 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.296351 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.341180 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.341150 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf"] May 21 14:06:26.345285 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:26.345256 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd2b16e_16a7_44a9_82a7_d853a512fb79.slice/crio-0eed3c26593271d728aaa6de2b25b36c3ac302dc6d129bfece0560dd63d534ac WatchSource:0}: Error finding container 0eed3c26593271d728aaa6de2b25b36c3ac302dc6d129bfece0560dd63d534ac: Status 404 returned error can't find the container with id 0eed3c26593271d728aaa6de2b25b36c3ac302dc6d129bfece0560dd63d534ac May 21 14:06:26.388042 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.388021 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.388138 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.388067 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wcx\" (UniqueName: \"kubernetes.io/projected/e223dc0d-9444-47b8-9ffd-01c9ee73976b-kube-api-access-d6wcx\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.388184 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.388163 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:06:26.388234 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.388221 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls podName:e223dc0d-9444-47b8-9ffd-01c9ee73976b nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.88820596 +0000 UTC m=+136.160102038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls") pod "cluster-samples-operator-697587599-xpcfc" (UID: "e223dc0d-9444-47b8-9ffd-01c9ee73976b") : secret "samples-operator-tls" not found May 21 14:06:26.399020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.398992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wcx\" (UniqueName: \"kubernetes.io/projected/e223dc0d-9444-47b8-9ffd-01c9ee73976b-kube-api-access-d6wcx\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.778947 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.778910 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" event={"ID":"2fd2b16e-16a7-44a9-82a7-d853a512fb79","Type":"ContainerStarted","Data":"0eed3c26593271d728aaa6de2b25b36c3ac302dc6d129bfece0560dd63d534ac"} May 21 14:06:26.791434 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.791413 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:26.791535 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.791523 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:26.791576 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.791537 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:26.791609 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.791587 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.791573236 +0000 UTC m=+137.063469313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:26.892235 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:26.892198 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:26.892399 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.892362 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:06:26.892465 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:26.892445 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls podName:e223dc0d-9444-47b8-9ffd-01c9ee73976b nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.892421774 +0000 UTC m=+137.164317851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls") pod "cluster-samples-operator-697587599-xpcfc" (UID: "e223dc0d-9444-47b8-9ffd-01c9ee73976b") : secret "samples-operator-tls" not found May 21 14:06:27.799399 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:27.799375 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:27.799713 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:27.799509 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:27.799713 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:27.799527 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:27.799713 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:27.799577 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.799562456 +0000 UTC m=+139.071458536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:27.899973 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:27.899941 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:27.900130 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:27.900093 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:06:27.900178 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:27.900154 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls podName:e223dc0d-9444-47b8-9ffd-01c9ee73976b nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.900137173 +0000 UTC m=+139.172033256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls") pod "cluster-samples-operator-697587599-xpcfc" (UID: "e223dc0d-9444-47b8-9ffd-01c9ee73976b") : secret "samples-operator-tls" not found May 21 14:06:28.784179 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:28.784143 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" event={"ID":"2fd2b16e-16a7-44a9-82a7-d853a512fb79","Type":"ContainerStarted","Data":"6a0786ae9fbae24b7f3fc1c15b558f48c57df3b8dbf77f8ced4aeb877fca6c0d"} May 21 14:06:28.808916 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:28.806288 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-shrsf" podStartSLOduration=2.385795232 podStartE2EDuration="3.80627135s" podCreationTimestamp="2026-05-21 14:06:25 +0000 UTC" firstStartedPulling="2026-05-21 14:06:26.347039083 +0000 UTC m=+135.618935160" lastFinishedPulling="2026-05-21 14:06:27.767515196 +0000 UTC m=+137.039411278" observedRunningTime="2026-05-21 14:06:28.80433967 +0000 UTC m=+138.076235769" watchObservedRunningTime="2026-05-21 14:06:28.80627135 +0000 UTC m=+138.078167480" May 21 14:06:29.814223 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:29.814190 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:29.814578 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:29.814309 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:29.814578 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:29.814320 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:29.814578 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:29.814367 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.814353797 +0000 UTC m=+143.086249873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:29.915305 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:29.915271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:29.915462 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:29.915377 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:06:29.915462 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:29.915427 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls podName:e223dc0d-9444-47b8-9ffd-01c9ee73976b nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.915413411 +0000 UTC m=+143.187309489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls") pod "cluster-samples-operator-697587599-xpcfc" (UID: "e223dc0d-9444-47b8-9ffd-01c9ee73976b") : secret "samples-operator-tls" not found May 21 14:06:31.261925 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.261893 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt"] May 21 14:06:31.263762 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.263746 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" May 21 14:06:31.266250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.266228 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2h6r4\"" May 21 14:06:31.266353 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.266228 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 14:06:31.267263 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.267246 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 14:06:31.275979 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.275956 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt"] May 21 14:06:31.426061 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.426016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgqd\" (UniqueName: \"kubernetes.io/projected/9fd8942d-221e-4e04-bf42-2d35af98049e-kube-api-access-6cgqd\") pod \"migrator-b985f5d89-xjwwt\" (UID: \"9fd8942d-221e-4e04-bf42-2d35af98049e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" May 21 14:06:31.527459 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.527367 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgqd\" (UniqueName: \"kubernetes.io/projected/9fd8942d-221e-4e04-bf42-2d35af98049e-kube-api-access-6cgqd\") pod \"migrator-b985f5d89-xjwwt\" (UID: \"9fd8942d-221e-4e04-bf42-2d35af98049e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" May 21 14:06:31.535462 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.535434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgqd\" (UniqueName: \"kubernetes.io/projected/9fd8942d-221e-4e04-bf42-2d35af98049e-kube-api-access-6cgqd\") pod \"migrator-b985f5d89-xjwwt\" (UID: \"9fd8942d-221e-4e04-bf42-2d35af98049e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" May 21 14:06:31.572306 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.572285 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" May 21 14:06:31.689142 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.689110 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt"] May 21 14:06:31.691765 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:31.691739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd8942d_221e_4e04_bf42_2d35af98049e.slice/crio-c0964e06707c54f09f58f406c7cfa5944062d8a7ceab3d765fd1af7a51ba8828 WatchSource:0}: Error finding container c0964e06707c54f09f58f406c7cfa5944062d8a7ceab3d765fd1af7a51ba8828: Status 404 returned error can't find the container with id c0964e06707c54f09f58f406c7cfa5944062d8a7ceab3d765fd1af7a51ba8828 May 21 14:06:31.790726 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:31.790663 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" event={"ID":"9fd8942d-221e-4e04-bf42-2d35af98049e","Type":"ContainerStarted","Data":"c0964e06707c54f09f58f406c7cfa5944062d8a7ceab3d765fd1af7a51ba8828"} May 21 14:06:33.795433 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:33.795395 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" event={"ID":"9fd8942d-221e-4e04-bf42-2d35af98049e","Type":"ContainerStarted","Data":"fd4f4902e6b43549242fd086fa70bf84e7941309e6eeb96536a8b640dd498867"} May 21 14:06:33.795433 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:33.795437 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" event={"ID":"9fd8942d-221e-4e04-bf42-2d35af98049e","Type":"ContainerStarted","Data":"35b2234067761b0ba88117ce9655a30c7c56f4c7b0421de8e8198a1ebf45cf00"} May 21 14:06:33.817006 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:33.816964 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xjwwt" podStartSLOduration=1.3457114479999999 podStartE2EDuration="2.816951129s" podCreationTimestamp="2026-05-21 14:06:31 +0000 UTC" firstStartedPulling="2026-05-21 14:06:31.693648949 +0000 UTC m=+140.965545040" lastFinishedPulling="2026-05-21 14:06:33.164888444 +0000 UTC m=+142.436784721" observedRunningTime="2026-05-21 14:06:33.816864069 +0000 UTC m=+143.088760168" watchObservedRunningTime="2026-05-21 14:06:33.816951129 +0000 UTC m=+143.088847228" May 21 14:06:33.842255 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:33.842232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:33.842364 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:33.842352 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:33.842403 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:33.842366 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:33.842432 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:33.842407 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.84239554 +0000 UTC m=+151.114291618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:33.942718 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:33.942682 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:33.942864 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:33.942806 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:06:33.942947 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:33.942870 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls podName:e223dc0d-9444-47b8-9ffd-01c9ee73976b nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.942851762 +0000 UTC m=+151.214747852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls") pod "cluster-samples-operator-697587599-xpcfc" (UID: "e223dc0d-9444-47b8-9ffd-01c9ee73976b") : secret "samples-operator-tls" not found May 21 14:06:34.225362 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.225332 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7684"] May 21 14:06:34.227331 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.227316 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.229949 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.229926 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 14:06:34.229949 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.229944 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 14:06:34.230113 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.229950 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 14:06:34.230113 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.229998 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dj6s9\"" May 21 14:06:34.231248 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.231224 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 14:06:34.235835 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.235817 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7684"] May 21 14:06:34.346195 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.346158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxzgx\" (UniqueName: \"kubernetes.io/projected/2909e73e-0704-4366-8745-d82f6741b27e-kube-api-access-rxzgx\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.346195 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.346207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2909e73e-0704-4366-8745-d82f6741b27e-signing-key\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.346404 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.346233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2909e73e-0704-4366-8745-d82f6741b27e-signing-cabundle\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.447171 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.447137 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxzgx\" (UniqueName: \"kubernetes.io/projected/2909e73e-0704-4366-8745-d82f6741b27e-kube-api-access-rxzgx\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.447171 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.447178 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2909e73e-0704-4366-8745-d82f6741b27e-signing-key\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.447394 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.447195 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2909e73e-0704-4366-8745-d82f6741b27e-signing-cabundle\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.447896 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.447875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2909e73e-0704-4366-8745-d82f6741b27e-signing-cabundle\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.449568 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.449548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2909e73e-0704-4366-8745-d82f6741b27e-signing-key\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.456717 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.456699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxzgx\" (UniqueName: \"kubernetes.io/projected/2909e73e-0704-4366-8745-d82f6741b27e-kube-api-access-rxzgx\") pod \"service-ca-67d667c7d-c7684\" (UID: \"2909e73e-0704-4366-8745-d82f6741b27e\") " pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.536913 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.536841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-c7684" May 21 14:06:34.580319 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.579673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng76h_aab2ef30-1c22-439a-9b7d-c79c052518ff/dns-node-resolver/0.log" May 21 14:06:34.673209 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.673177 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-c7684"] May 21 14:06:34.675782 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:34.675754 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2909e73e_0704_4366_8745_d82f6741b27e.slice/crio-90a862db7af8e85076923d2d77349bc32fec8fdd0b8a315f0395f65c15125f5a WatchSource:0}: Error finding container 90a862db7af8e85076923d2d77349bc32fec8fdd0b8a315f0395f65c15125f5a: Status 404 returned error can't find the container with id 90a862db7af8e85076923d2d77349bc32fec8fdd0b8a315f0395f65c15125f5a May 21 14:06:34.797951 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:34.797873 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-c7684" event={"ID":"2909e73e-0704-4366-8745-d82f6741b27e","Type":"ContainerStarted","Data":"90a862db7af8e85076923d2d77349bc32fec8fdd0b8a315f0395f65c15125f5a"} May 21 14:06:35.778984 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:35.778941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mctxb_3ae0136d-1fcb-41f6-989b-3313c618d119/node-ca/0.log" May 21 14:06:36.776913 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:36.776883 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xjwwt_9fd8942d-221e-4e04-bf42-2d35af98049e/migrator/0.log" May 21 14:06:36.803486 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:36.803415 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-c7684" event={"ID":"2909e73e-0704-4366-8745-d82f6741b27e","Type":"ContainerStarted","Data":"cf74164943623c8c8e1c484e2545b5e52ad68235a594438657a5c7b33556cb90"} May 21 14:06:36.824426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:36.824383 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-c7684" podStartSLOduration=0.948188264 podStartE2EDuration="2.824370358s" podCreationTimestamp="2026-05-21 14:06:34 +0000 UTC" firstStartedPulling="2026-05-21 14:06:34.677644834 +0000 UTC m=+143.949540911" lastFinishedPulling="2026-05-21 14:06:36.553826924 +0000 UTC m=+145.825723005" observedRunningTime="2026-05-21 14:06:36.823442094 +0000 UTC m=+146.095338195" watchObservedRunningTime="2026-05-21 14:06:36.824370358 +0000 UTC m=+146.096266457" May 21 14:06:36.976602 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:36.976576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xjwwt_9fd8942d-221e-4e04-bf42-2d35af98049e/graceful-termination/0.log" May 21 14:06:41.902594 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:41.902555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") pod \"image-registry-5475f7447f-48fc4\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:41.903051 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:41.902714 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:41.903051 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:41.902730 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5475f7447f-48fc4: secret "image-registry-tls" not found May 21 14:06:41.903051 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:41.902787 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls podName:c8933db2-4a63-450b-8b0b-7553dafb2d38 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:57.902769815 +0000 UTC m=+167.174665907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls") pod "image-registry-5475f7447f-48fc4" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38") : secret "image-registry-tls" not found May 21 14:06:42.003642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:42.003603 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:42.006063 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:42.006039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e223dc0d-9444-47b8-9ffd-01c9ee73976b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xpcfc\" (UID: \"e223dc0d-9444-47b8-9ffd-01c9ee73976b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:42.033311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:42.033280 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" May 21 14:06:42.156508 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:42.156359 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc"] May 21 14:06:42.822129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:42.822096 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" event={"ID":"e223dc0d-9444-47b8-9ffd-01c9ee73976b","Type":"ContainerStarted","Data":"4249442dc57f7ed860ad380bbcd05c1101e45c32d338741c9546aa39dd015b7c"} May 21 14:06:44.828084 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:44.828050 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" event={"ID":"e223dc0d-9444-47b8-9ffd-01c9ee73976b","Type":"ContainerStarted","Data":"ae092bb452b88b4c20a4dce44efd13ce766d5ccf45fc25f400bde941ab2887a8"} May 21 14:06:44.828084 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:44.828088 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" event={"ID":"e223dc0d-9444-47b8-9ffd-01c9ee73976b","Type":"ContainerStarted","Data":"5eccfe315b92815cc614301e6a235acb7add4458a39bdb287b0156510fda0f96"} May 21 14:06:44.851344 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:44.851293 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xpcfc" podStartSLOduration=16.9904295 podStartE2EDuration="18.85128015s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:42.198415102 +0000 UTC m=+151.470311179" lastFinishedPulling="2026-05-21 14:06:44.059265735 +0000 UTC m=+153.331161829" observedRunningTime="2026-05-21 14:06:44.85037475 +0000 UTC m=+154.122270849" watchObservedRunningTime="2026-05-21 14:06:44.85128015 +0000 UTC m=+154.123176248" May 21 14:06:47.657153 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:47.657109 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtdln" podUID="6df665aa-9805-4ba0-99d5-d6eeafedfb83" May 21 14:06:47.671339 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:47.671301 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-4mldb" podUID="764a2c35-44d7-4a1a-905a-5818b012f2ae" May 21 14:06:47.837009 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:47.836980 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtdln" May 21 14:06:49.344195 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:49.344158 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tvwsb" podUID="4640c960-6c19-446d-9e43-e507f8d62cb8" May 21 14:06:52.680555 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.680519 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:06:52.681057 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.680602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:06:52.682912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.682877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6df665aa-9805-4ba0-99d5-d6eeafedfb83-metrics-tls\") pod \"dns-default-jtdln\" (UID: \"6df665aa-9805-4ba0-99d5-d6eeafedfb83\") " pod="openshift-dns/dns-default-jtdln" May 21 14:06:52.683015 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.682935 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/764a2c35-44d7-4a1a-905a-5818b012f2ae-cert\") pod \"ingress-canary-4mldb\" (UID: \"764a2c35-44d7-4a1a-905a-5818b012f2ae\") " pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:06:52.940472 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.940390 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v7ff7\"" May 21 14:06:52.947785 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:52.947752 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtdln" May 21 14:06:53.067224 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.067198 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtdln"] May 21 14:06:53.069716 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:53.069685 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df665aa_9805_4ba0_99d5_d6eeafedfb83.slice/crio-6e156be75d5321f5ad346d5d3ab5c0aecadd723e0ba3c10609c1adfb5c0a768a WatchSource:0}: Error finding container 6e156be75d5321f5ad346d5d3ab5c0aecadd723e0ba3c10609c1adfb5c0a768a: Status 404 returned error can't find the container with id 6e156be75d5321f5ad346d5d3ab5c0aecadd723e0ba3c10609c1adfb5c0a768a May 21 14:06:53.468588 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.468550 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-95crj"] May 21 14:06:53.470696 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.470670 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.473680 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.473651 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:06:53.474582 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.474557 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nx82v\"" May 21 14:06:53.474784 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.474766 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:06:53.474848 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.474814 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:06:53.474944 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.474921 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:06:53.485483 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.485460 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5475f7447f-48fc4"] May 21 14:06:53.485712 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:06:53.485685 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5475f7447f-48fc4" podUID="c8933db2-4a63-450b-8b0b-7553dafb2d38" May 21 14:06:53.486987 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.486966 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95crj"] May 21 14:06:53.511610 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.511575 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55647dd54c-9lq8s"] May 21 14:06:53.513837 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.513817 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.530728 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.530702 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55647dd54c-9lq8s"] May 21 14:06:53.587179 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587150 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzcm\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-kube-api-access-jjzcm\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587179 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-image-registry-private-configuration\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-data-volume\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.587426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-trusted-ca\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-bound-sa-token\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.587426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndfr\" (UniqueName: \"kubernetes.io/projected/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-api-access-8ndfr\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.587666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-certificates\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.587666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f618f4-9ab8-4718-96a5-07c1c9f2a996-ca-trust-extracted\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-tls\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.587666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-crio-socket\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.587879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.587691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-installation-pull-secrets\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.688645 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688595 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-certificates\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688687 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f618f4-9ab8-4718-96a5-07c1c9f2a996-ca-trust-extracted\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688707 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-tls\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688723 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-crio-socket\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688763 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-installation-pull-secrets\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688833 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzcm\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-kube-api-access-jjzcm\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688861 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-image-registry-private-configuration\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-data-volume\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-crio-socket\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688913 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-trusted-ca\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688941 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-bound-sa-token\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.688977 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndfr\" (UniqueName: \"kubernetes.io/projected/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-api-access-8ndfr\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689821 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f618f4-9ab8-4718-96a5-07c1c9f2a996-ca-trust-extracted\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689821 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-data-volume\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.689821 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-certificates\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689975 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f618f4-9ab8-4718-96a5-07c1c9f2a996-trusted-ca\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.689975 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.689964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.691882 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.691705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.692043 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.692022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-installation-pull-secrets\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.692163 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.692119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-registry-tls\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.692263 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.692243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f618f4-9ab8-4718-96a5-07c1c9f2a996-image-registry-private-configuration\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.699300 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.699245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndfr\" (UniqueName: \"kubernetes.io/projected/e1f9fdee-f420-4de2-b777-87fa5c6b5ded-kube-api-access-8ndfr\") pod \"insights-runtime-extractor-95crj\" (UID: \"e1f9fdee-f420-4de2-b777-87fa5c6b5ded\") " pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.699444 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.699385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-bound-sa-token\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.699444 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.699420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzcm\" (UniqueName: \"kubernetes.io/projected/90f618f4-9ab8-4718-96a5-07c1c9f2a996-kube-api-access-jjzcm\") pod \"image-registry-55647dd54c-9lq8s\" (UID: \"90f618f4-9ab8-4718-96a5-07c1c9f2a996\") " pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.782259 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.782138 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95crj" May 21 14:06:53.823480 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.823443 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:53.853572 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.853541 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:53.853948 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.853912 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtdln" event={"ID":"6df665aa-9805-4ba0-99d5-d6eeafedfb83","Type":"ContainerStarted","Data":"6e156be75d5321f5ad346d5d3ab5c0aecadd723e0ba3c10609c1adfb5c0a768a"} May 21 14:06:53.859264 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.859232 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:53.891253 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891221 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891420 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891274 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57hbz\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891420 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891304 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891420 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891324 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891420 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891363 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891420 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891392 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.891729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891447 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca\") pod \"c8933db2-4a63-450b-8b0b-7553dafb2d38\" (UID: \"c8933db2-4a63-450b-8b0b-7553dafb2d38\") " May 21 14:06:53.892010 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.891937 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:06:53.892128 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.892020 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:06:53.892312 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.892248 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:06:53.894322 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.894278 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:06:53.894426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.894318 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:06:53.894426 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.894393 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:06:53.894816 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.894789 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz" (OuterVolumeSpecName: "kube-api-access-57hbz") pod "c8933db2-4a63-450b-8b0b-7553dafb2d38" (UID: "c8933db2-4a63-450b-8b0b-7553dafb2d38"). InnerVolumeSpecName "kube-api-access-57hbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:06:53.926336 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.926304 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95crj"] May 21 14:06:53.992448 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992410 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-image-registry-private-configuration\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992448 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992449 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57hbz\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-kube-api-access-57hbz\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992677 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992467 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-certificates\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992677 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992483 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8933db2-4a63-450b-8b0b-7553dafb2d38-ca-trust-extracted\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992677 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992498 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-bound-sa-token\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992677 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992512 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8933db2-4a63-450b-8b0b-7553dafb2d38-installation-pull-secrets\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:53.992677 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:53.992527 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8933db2-4a63-450b-8b0b-7553dafb2d38-trusted-ca\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:54.179048 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:54.179013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f9fdee_f420_4de2_b777_87fa5c6b5ded.slice/crio-960d8e37dd3434d1e239390b7a7a62de5552d37480f6864d18c8fbcb39499392 WatchSource:0}: Error finding container 960d8e37dd3434d1e239390b7a7a62de5552d37480f6864d18c8fbcb39499392: Status 404 returned error can't find the container with id 960d8e37dd3434d1e239390b7a7a62de5552d37480f6864d18c8fbcb39499392 May 21 14:06:54.319425 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.319395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55647dd54c-9lq8s"] May 21 14:06:54.322426 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:54.322394 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f618f4_9ab8_4718_96a5_07c1c9f2a996.slice/crio-97ecd8af3b33e040cc7155e20d7720573c7b5d8c0f3189e0c7298c78fd8366d6 WatchSource:0}: Error finding container 97ecd8af3b33e040cc7155e20d7720573c7b5d8c0f3189e0c7298c78fd8366d6: Status 404 returned error can't find the container with id 97ecd8af3b33e040cc7155e20d7720573c7b5d8c0f3189e0c7298c78fd8366d6 May 21 14:06:54.857762 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.857727 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" event={"ID":"90f618f4-9ab8-4718-96a5-07c1c9f2a996","Type":"ContainerStarted","Data":"037a0494762809c5a23bffa6dec691d84e1fcc072190291bd246a924085b89a4"} May 21 14:06:54.858174 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.857769 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" event={"ID":"90f618f4-9ab8-4718-96a5-07c1c9f2a996","Type":"ContainerStarted","Data":"97ecd8af3b33e040cc7155e20d7720573c7b5d8c0f3189e0c7298c78fd8366d6"} May 21 14:06:54.858174 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.857818 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:06:54.859239 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.859213 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtdln" event={"ID":"6df665aa-9805-4ba0-99d5-d6eeafedfb83","Type":"ContainerStarted","Data":"be6978372831996182c239a235ba167d95442c90cf2cd6f7f52d41fc5a53b068"} May 21 14:06:54.859353 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.859243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtdln" event={"ID":"6df665aa-9805-4ba0-99d5-d6eeafedfb83","Type":"ContainerStarted","Data":"33d2988f58f2f08e16bdde852dcb6efeaa94b1425bdefc9be69cf83beba5c1ae"} May 21 14:06:54.859407 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.859350 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jtdln" May 21 14:06:54.860651 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.860577 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5475f7447f-48fc4" May 21 14:06:54.860885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.860862 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95crj" event={"ID":"e1f9fdee-f420-4de2-b777-87fa5c6b5ded","Type":"ContainerStarted","Data":"8ca7e59cb1077f0875b5ad9bc4062c971ca8ba2a76285b775723b59e9c02c1c4"} May 21 14:06:54.861003 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.860888 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95crj" event={"ID":"e1f9fdee-f420-4de2-b777-87fa5c6b5ded","Type":"ContainerStarted","Data":"960d8e37dd3434d1e239390b7a7a62de5552d37480f6864d18c8fbcb39499392"} May 21 14:06:54.876684 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.876615 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" podStartSLOduration=1.876599282 podStartE2EDuration="1.876599282s" podCreationTimestamp="2026-05-21 14:06:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:06:54.876307594 +0000 UTC m=+164.148203694" watchObservedRunningTime="2026-05-21 14:06:54.876599282 +0000 UTC m=+164.148495380" May 21 14:06:54.893589 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.893549 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jtdln" podStartSLOduration=129.757821375 podStartE2EDuration="2m10.893533833s" podCreationTimestamp="2026-05-21 14:04:44 +0000 UTC" firstStartedPulling="2026-05-21 14:06:53.071895405 +0000 UTC m=+162.343791481" lastFinishedPulling="2026-05-21 14:06:54.207607847 +0000 UTC m=+163.479503939" observedRunningTime="2026-05-21 14:06:54.893346293 +0000 UTC m=+164.165242394" watchObservedRunningTime="2026-05-21 14:06:54.893533833 +0000 UTC m=+164.165429935" May 21 14:06:54.920029 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.920001 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5475f7447f-48fc4"] May 21 14:06:54.923424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:54.923396 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5475f7447f-48fc4"] May 21 14:06:55.004976 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:55.004953 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8933db2-4a63-450b-8b0b-7553dafb2d38-registry-tls\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:06:55.336995 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:55.336961 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8933db2-4a63-450b-8b0b-7553dafb2d38" path="/var/lib/kubelet/pods/c8933db2-4a63-450b-8b0b-7553dafb2d38/volumes" May 21 14:06:55.865285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:55.865250 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95crj" event={"ID":"e1f9fdee-f420-4de2-b777-87fa5c6b5ded","Type":"ContainerStarted","Data":"c955a957d6fc1e27e2b94b9ac78e83f1c4e01cb99e54a3d882b5de6de5e651fb"} May 21 14:06:56.869650 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:56.869549 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95crj" event={"ID":"e1f9fdee-f420-4de2-b777-87fa5c6b5ded","Type":"ContainerStarted","Data":"485d0b1c1687baf4f4bd74afa86cf0b23b6f790e863be60178e25cd39baa378e"} May 21 14:06:56.887853 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:56.887808 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-95crj" podStartSLOduration=1.6467487159999998 podStartE2EDuration="3.887793767s" podCreationTimestamp="2026-05-21 14:06:53 +0000 UTC" firstStartedPulling="2026-05-21 14:06:54.257381011 +0000 UTC m=+163.529277094" lastFinishedPulling="2026-05-21 14:06:56.498426068 +0000 UTC m=+165.770322145" observedRunningTime="2026-05-21 14:06:56.887661626 +0000 UTC m=+166.159557725" watchObservedRunningTime="2026-05-21 14:06:56.887793767 +0000 UTC m=+166.159689864" May 21 14:06:59.333274 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:59.333239 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:06:59.336289 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:59.336263 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8szvz\"" May 21 14:06:59.343685 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:59.343663 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4mldb" May 21 14:06:59.462592 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:59.462565 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4mldb"] May 21 14:06:59.465656 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:06:59.465613 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764a2c35_44d7_4a1a_905a_5818b012f2ae.slice/crio-4740a5f93e5f295cddc8916ed89d470f027a378f007eeaad85a5fe6d44316a52 WatchSource:0}: Error finding container 4740a5f93e5f295cddc8916ed89d470f027a378f007eeaad85a5fe6d44316a52: Status 404 returned error can't find the container with id 4740a5f93e5f295cddc8916ed89d470f027a378f007eeaad85a5fe6d44316a52 May 21 14:06:59.878443 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:06:59.878406 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4mldb" event={"ID":"764a2c35-44d7-4a1a-905a-5818b012f2ae","Type":"ContainerStarted","Data":"4740a5f93e5f295cddc8916ed89d470f027a378f007eeaad85a5fe6d44316a52"} May 21 14:07:00.620822 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:00.620717 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" podUID="9086928a-4e6c-4970-931e-a6261b017ba2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.7:8000/readyz\": dial tcp 10.134.0.7:8000: connect: connection refused" May 21 14:07:00.882421 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:00.882335 2559 generic.go:358] "Generic (PLEG): container finished" podID="9086928a-4e6c-4970-931e-a6261b017ba2" containerID="2198a1bcac3b3843bf85157081ccb2a7d0c2e6b8fc871e69da8b086f24f968fb" exitCode=1 May 21 14:07:00.882421 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:00.882393 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" event={"ID":"9086928a-4e6c-4970-931e-a6261b017ba2","Type":"ContainerDied","Data":"2198a1bcac3b3843bf85157081ccb2a7d0c2e6b8fc871e69da8b086f24f968fb"} May 21 14:07:00.882796 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:00.882782 2559 scope.go:117] "RemoveContainer" containerID="2198a1bcac3b3843bf85157081ccb2a7d0c2e6b8fc871e69da8b086f24f968fb" May 21 14:07:01.337322 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.337303 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:07:01.886553 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.886512 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4mldb" event={"ID":"764a2c35-44d7-4a1a-905a-5818b012f2ae","Type":"ContainerStarted","Data":"26fbf59b5aa635f1be33dc00372f6f2ae2a5ee76fe244bf1d10aa7d84ddbe4a3"} May 21 14:07:01.887906 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.887884 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" event={"ID":"9086928a-4e6c-4970-931e-a6261b017ba2","Type":"ContainerStarted","Data":"f8c4ae4d76bef1a9842c80c8d5b12d3781e7a016e40cbbf46fb2e0fc2408e0b9"} May 21 14:07:01.888142 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.888125 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:07:01.888723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.888704 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f85c89d6-f99br" May 21 14:07:01.902610 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:01.902556 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4mldb" podStartSLOduration=136.007788562 podStartE2EDuration="2m17.902543351s" podCreationTimestamp="2026-05-21 14:04:44 +0000 UTC" firstStartedPulling="2026-05-21 14:06:59.467927202 +0000 UTC m=+168.739823282" lastFinishedPulling="2026-05-21 14:07:01.362681981 +0000 UTC m=+170.634578071" observedRunningTime="2026-05-21 14:07:01.901745562 +0000 UTC m=+171.173641651" watchObservedRunningTime="2026-05-21 14:07:01.902543351 +0000 UTC m=+171.174439450" May 21 14:07:04.867792 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:04.867753 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jtdln" May 21 14:07:08.130447 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.130409 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw"] May 21 14:07:08.134107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.134089 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.138449 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.138419 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:07:08.138580 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.138419 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 14:07:08.139345 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.139300 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 14:07:08.139345 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.139313 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:07:08.139512 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.139352 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:07:08.139512 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.139367 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 14:07:08.139655 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.139521 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxnft\"" May 21 14:07:08.177195 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.177160 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw"] May 21 14:07:08.178482 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.178457 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cbkch"] May 21 14:07:08.181791 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.181771 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.184844 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.184811 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:07:08.185523 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.185507 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6lljt\"" May 21 14:07:08.185696 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.185671 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:07:08.185815 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.185776 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:07:08.203322 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbdt\" (UniqueName: \"kubernetes.io/projected/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-api-access-5rbdt\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.203468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.203468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.203468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.203642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b4e3f5-056f-41a0-ad73-757e118bbce1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.203642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.203505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.304826 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.304784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-wtmp\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.304826 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.304828 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.304891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-sys\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.304928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6n6\" (UniqueName: \"kubernetes.io/projected/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-kube-api-access-2s6n6\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.304976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-textfile\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-metrics-client-ca\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-root\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305118 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305153 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b4e3f5-056f-41a0-ad73-757e118bbce1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305207 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:07:08.305278 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 14:07:08.305318 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-tls\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.305726 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:07:08.305343 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls podName:01b4e3f5-056f-41a0-ad73-757e118bbce1 nodeName:}" failed. No retries permitted until 2026-05-21 14:07:08.805323305 +0000 UTC m=+178.077219391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-thlnw" (UID: "01b4e3f5-056f-41a0-ad73-757e118bbce1") : secret "kube-state-metrics-tls" not found May 21 14:07:08.305726 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305366 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbdt\" (UniqueName: \"kubernetes.io/projected/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-api-access-5rbdt\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305726 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305726 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b4e3f5-056f-41a0-ad73-757e118bbce1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.305930 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.305880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b4e3f5-056f-41a0-ad73-757e118bbce1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.307787 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.307769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.314886 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.314854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbdt\" (UniqueName: \"kubernetes.io/projected/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-api-access-5rbdt\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.405922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.405892 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-root\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406099 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.405949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-root\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406099 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406009 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406099 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406039 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406099 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-tls\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406601 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-wtmp\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406712 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406876 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-wtmp\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.406876 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406747 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-sys\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407014 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406913 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6n6\" (UniqueName: \"kubernetes.io/projected/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-kube-api-access-2s6n6\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407014 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406795 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-sys\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407014 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406950 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-textfile\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407014 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.406975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-metrics-client-ca\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407268 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.407233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-textfile\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.407530 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.407510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-metrics-client-ca\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.408676 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.408655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.408749 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.408714 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-node-exporter-tls\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.421831 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.421807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6n6\" (UniqueName: \"kubernetes.io/projected/4e9ad073-2d8a-41b6-a5be-2d2039a3c182-kube-api-access-2s6n6\") pod \"node-exporter-cbkch\" (UID: \"4e9ad073-2d8a-41b6-a5be-2d2039a3c182\") " pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.491788 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.491764 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cbkch" May 21 14:07:08.499601 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:07:08.499574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9ad073_2d8a_41b6_a5be_2d2039a3c182.slice/crio-9d1f050ac63b22907e4a90dedeb6b0023564a11e908b06ecc6e7cfc375a318da WatchSource:0}: Error finding container 9d1f050ac63b22907e4a90dedeb6b0023564a11e908b06ecc6e7cfc375a318da: Status 404 returned error can't find the container with id 9d1f050ac63b22907e4a90dedeb6b0023564a11e908b06ecc6e7cfc375a318da May 21 14:07:08.809493 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.809401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.811831 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.811805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b4e3f5-056f-41a0-ad73-757e118bbce1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-thlnw\" (UID: \"01b4e3f5-056f-41a0-ad73-757e118bbce1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:08.905429 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:08.905395 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbkch" event={"ID":"4e9ad073-2d8a-41b6-a5be-2d2039a3c182","Type":"ContainerStarted","Data":"9d1f050ac63b22907e4a90dedeb6b0023564a11e908b06ecc6e7cfc375a318da"} May 21 14:07:09.045463 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:09.045118 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" May 21 14:07:09.195120 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:09.195086 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw"] May 21 14:07:09.198673 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:07:09.198641 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b4e3f5_056f_41a0_ad73_757e118bbce1.slice/crio-0bf8aa3248105b47f0542374cc0e63e7c662852fb2d15931d0b5f60f033c7199 WatchSource:0}: Error finding container 0bf8aa3248105b47f0542374cc0e63e7c662852fb2d15931d0b5f60f033c7199: Status 404 returned error can't find the container with id 0bf8aa3248105b47f0542374cc0e63e7c662852fb2d15931d0b5f60f033c7199 May 21 14:07:09.911769 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:09.911726 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" event={"ID":"01b4e3f5-056f-41a0-ad73-757e118bbce1","Type":"ContainerStarted","Data":"0bf8aa3248105b47f0542374cc0e63e7c662852fb2d15931d0b5f60f033c7199"} May 21 14:07:09.913241 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:09.913212 2559 generic.go:358] "Generic (PLEG): container finished" podID="4e9ad073-2d8a-41b6-a5be-2d2039a3c182" containerID="edd5a6bafc9188830f5b1ae8688f04053f0ffad172c5ba14dba289c9819b7ca3" exitCode=0 May 21 14:07:09.913382 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:09.913261 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbkch" event={"ID":"4e9ad073-2d8a-41b6-a5be-2d2039a3c182","Type":"ContainerDied","Data":"edd5a6bafc9188830f5b1ae8688f04053f0ffad172c5ba14dba289c9819b7ca3"} May 21 14:07:10.918020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.917981 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbkch" event={"ID":"4e9ad073-2d8a-41b6-a5be-2d2039a3c182","Type":"ContainerStarted","Data":"7a24b8c4e9799945cdb8d465eba5265769190dd91f52d2843db4572739c4002b"} May 21 14:07:10.918473 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.918026 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbkch" event={"ID":"4e9ad073-2d8a-41b6-a5be-2d2039a3c182","Type":"ContainerStarted","Data":"978d6ace454c70e1fd7545efad0c79dfacbfca8b7948a610b097465ed561d4a9"} May 21 14:07:10.919919 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.919891 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" event={"ID":"01b4e3f5-056f-41a0-ad73-757e118bbce1","Type":"ContainerStarted","Data":"29f1a62446a19841228f46dad0e50e21a631ae81188dad151597b2c435b26feb"} May 21 14:07:10.920038 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.919924 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" event={"ID":"01b4e3f5-056f-41a0-ad73-757e118bbce1","Type":"ContainerStarted","Data":"8a6b83455707adf7790584902d7733360af6f802c5d784cbda4d2393f7c49a82"} May 21 14:07:10.920038 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.919938 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" event={"ID":"01b4e3f5-056f-41a0-ad73-757e118bbce1","Type":"ContainerStarted","Data":"499486773aa4b5cf69c0fd5313704225e8065eb771bbef43a04839659ecb66ff"} May 21 14:07:10.943055 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.943006 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cbkch" podStartSLOduration=1.938998279 podStartE2EDuration="2.94298393s" podCreationTimestamp="2026-05-21 14:07:08 +0000 UTC" firstStartedPulling="2026-05-21 14:07:08.50117374 +0000 UTC m=+177.773069816" lastFinishedPulling="2026-05-21 14:07:09.505159376 +0000 UTC m=+178.777055467" observedRunningTime="2026-05-21 14:07:10.942937697 +0000 UTC m=+180.214833797" watchObservedRunningTime="2026-05-21 14:07:10.94298393 +0000 UTC m=+180.214880026" May 21 14:07:10.970982 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:10.970909 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-thlnw" podStartSLOduration=1.648048298 podStartE2EDuration="2.970891843s" podCreationTimestamp="2026-05-21 14:07:08 +0000 UTC" firstStartedPulling="2026-05-21 14:07:09.201198497 +0000 UTC m=+178.473094588" lastFinishedPulling="2026-05-21 14:07:10.524042051 +0000 UTC m=+179.795938133" observedRunningTime="2026-05-21 14:07:10.970326215 +0000 UTC m=+180.242222315" watchObservedRunningTime="2026-05-21 14:07:10.970891843 +0000 UTC m=+180.242787942" May 21 14:07:12.457285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.457250 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b45cc9c9-bc72k"] May 21 14:07:12.461478 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.461461 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.464056 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.464032 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 14:07:12.465285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.465263 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ejtb2o8bt0vok\"" May 21 14:07:12.465398 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.465287 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:07:12.465398 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.465337 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 14:07:12.465398 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.465368 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nprzk\"" May 21 14:07:12.465652 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.465636 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 14:07:12.469671 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.469648 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b45cc9c9-bc72k"] May 21 14:07:12.541866 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.541830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-tls\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542022 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.541873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-client-certs\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542022 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.541937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542022 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.541992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799qr\" (UniqueName: \"kubernetes.io/projected/7c925183-24d1-4bc0-960f-fa7ec87119b4-kube-api-access-799qr\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542131 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.542044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-metrics-server-audit-profiles\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542131 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.542077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-client-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.542131 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.542095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c925183-24d1-4bc0-960f-fa7ec87119b4-audit-log\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643041 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-client-certs\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643097 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-799qr\" (UniqueName: \"kubernetes.io/projected/7c925183-24d1-4bc0-960f-fa7ec87119b4-kube-api-access-799qr\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-metrics-server-audit-profiles\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643228 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-client-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643257 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c925183-24d1-4bc0-960f-fa7ec87119b4-audit-log\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.643364 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.643299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-tls\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.645083 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.644910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-metrics-server-audit-profiles\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.645684 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.645260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c925183-24d1-4bc0-960f-fa7ec87119b4-audit-log\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.645684 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.645581 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c925183-24d1-4bc0-960f-fa7ec87119b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.647776 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.647755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-client-ca-bundle\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.647971 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.647950 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-client-certs\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.648893 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.648869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c925183-24d1-4bc0-960f-fa7ec87119b4-secret-metrics-server-tls\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.654972 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.654923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-799qr\" (UniqueName: \"kubernetes.io/projected/7c925183-24d1-4bc0-960f-fa7ec87119b4-kube-api-access-799qr\") pod \"metrics-server-7b45cc9c9-bc72k\" (UID: \"7c925183-24d1-4bc0-960f-fa7ec87119b4\") " pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.771764 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.771681 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:12.906251 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.906226 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b45cc9c9-bc72k"] May 21 14:07:12.908428 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:07:12.908399 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c925183_24d1_4bc0_960f_fa7ec87119b4.slice/crio-b3fa05f6f1bf909d56ed5b30db1f9a18caf695d3d19c0d407171e5351f121384 WatchSource:0}: Error finding container b3fa05f6f1bf909d56ed5b30db1f9a18caf695d3d19c0d407171e5351f121384: Status 404 returned error can't find the container with id b3fa05f6f1bf909d56ed5b30db1f9a18caf695d3d19c0d407171e5351f121384 May 21 14:07:12.926080 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:12.926051 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" event={"ID":"7c925183-24d1-4bc0-960f-fa7ec87119b4","Type":"ContainerStarted","Data":"b3fa05f6f1bf909d56ed5b30db1f9a18caf695d3d19c0d407171e5351f121384"} May 21 14:07:14.267376 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.267343 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:07:14.270865 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.270846 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.273781 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.273754 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tn2tg\"" May 21 14:07:14.273898 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.273860 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:07:14.273898 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.273865 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:07:14.274058 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.273949 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3plqmteilvh43\"" May 21 14:07:14.274144 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274119 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:07:14.274201 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274173 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:07:14.274547 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274525 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:07:14.274664 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274525 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:07:14.274753 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274703 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:07:14.274753 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274709 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:07:14.274899 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274750 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:07:14.274961 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.274947 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:07:14.275076 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.275059 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:07:14.277416 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.277397 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:07:14.289176 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.289152 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:07:14.360160 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360353 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360353 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360491 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360491 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360593 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360593 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360593 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360765 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjlx\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360765 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360765 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.360922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.361076 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.361076 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.361076 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.360998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462177 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462138 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shjlx\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462177 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462179 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462400 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462400 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462241 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462400 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462269 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462542 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462424 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462542 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462472 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462542 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462522 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462549 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462578 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462661 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462952 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462719 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462952 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462758 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462952 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462797 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462952 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462829 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.462952 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.462862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.463186 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.463064 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.463961 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.463910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.465025 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.464998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.466315 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.465906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.466315 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.465917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.466315 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.466005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.466388 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.466752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.467071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.467116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.467820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.467833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.468912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.467909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.469258 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.469117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.469258 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.469218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.470050 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.470025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.470142 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.470039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.471247 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.471205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjlx\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx\") pod \"prometheus-k8s-0\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.581596 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.581504 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:14.967858 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:14.967826 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:07:14.971146 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:07:14.971118 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bcfa2d_304b_46c5_99ab_d13bda782675.slice/crio-62fcaf2c79c86f2832173c4fdae6a6d3ec91bf00204e0ca1d7218cc3096a5fa7 WatchSource:0}: Error finding container 62fcaf2c79c86f2832173c4fdae6a6d3ec91bf00204e0ca1d7218cc3096a5fa7: Status 404 returned error can't find the container with id 62fcaf2c79c86f2832173c4fdae6a6d3ec91bf00204e0ca1d7218cc3096a5fa7 May 21 14:07:15.870555 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:15.870519 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55647dd54c-9lq8s" May 21 14:07:15.937007 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:15.936948 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" event={"ID":"7c925183-24d1-4bc0-960f-fa7ec87119b4","Type":"ContainerStarted","Data":"23a88780d7d9ee185f5638744c390e582fdea3879725295522862065d7fed4a6"} May 21 14:07:15.938310 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:15.938284 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"62fcaf2c79c86f2832173c4fdae6a6d3ec91bf00204e0ca1d7218cc3096a5fa7"} May 21 14:07:15.956912 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:15.956861 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" podStartSLOduration=1.990254964 podStartE2EDuration="3.956847416s" podCreationTimestamp="2026-05-21 14:07:12 +0000 UTC" firstStartedPulling="2026-05-21 14:07:12.910369621 +0000 UTC m=+182.182265705" lastFinishedPulling="2026-05-21 14:07:14.876962077 +0000 UTC m=+184.148858157" observedRunningTime="2026-05-21 14:07:15.956841009 +0000 UTC m=+185.228737111" watchObservedRunningTime="2026-05-21 14:07:15.956847416 +0000 UTC m=+185.228743515" May 21 14:07:16.942367 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:16.942327 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" exitCode=0 May 21 14:07:16.942851 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:16.942418 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} May 21 14:07:20.955330 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:20.955292 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} May 21 14:07:20.955330 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:20.955330 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} May 21 14:07:22.963448 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:22.963410 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} May 21 14:07:22.963879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:22.963455 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} May 21 14:07:22.963879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:22.963470 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} May 21 14:07:22.963879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:22.963482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerStarted","Data":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} May 21 14:07:22.995055 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:22.994998 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.659133453 podStartE2EDuration="8.994981528s" podCreationTimestamp="2026-05-21 14:07:14 +0000 UTC" firstStartedPulling="2026-05-21 14:07:14.973198012 +0000 UTC m=+184.245094089" lastFinishedPulling="2026-05-21 14:07:22.309046084 +0000 UTC m=+191.580942164" observedRunningTime="2026-05-21 14:07:22.993669665 +0000 UTC m=+192.265565763" watchObservedRunningTime="2026-05-21 14:07:22.994981528 +0000 UTC m=+192.266877628" May 21 14:07:24.582557 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:24.582519 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:07:32.772637 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:32.772594 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:32.773041 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:32.772665 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:52.777382 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:52.777348 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:07:52.781299 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:07:52.781268 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b45cc9c9-bc72k" May 21 14:08:14.581711 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:14.581656 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:14.601889 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:14.601862 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:15.119145 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:15.119115 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:22.047739 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:22.047690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:08:22.050051 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:22.050017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4640c960-6c19-446d-9e43-e507f8d62cb8-metrics-certs\") pod \"network-metrics-daemon-tvwsb\" (UID: \"4640c960-6c19-446d-9e43-e507f8d62cb8\") " pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:08:22.340819 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:22.340735 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2rcd\"" May 21 14:08:22.348345 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:22.348314 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvwsb" May 21 14:08:22.481669 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:22.481608 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvwsb"] May 21 14:08:22.485058 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:08:22.485020 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640c960_6c19_446d_9e43_e507f8d62cb8.slice/crio-a30048f4324e0bd0685da2c21d3dfc0f20c16ded0f0c5152d0899e52af2ce12e WatchSource:0}: Error finding container a30048f4324e0bd0685da2c21d3dfc0f20c16ded0f0c5152d0899e52af2ce12e: Status 404 returned error can't find the container with id a30048f4324e0bd0685da2c21d3dfc0f20c16ded0f0c5152d0899e52af2ce12e May 21 14:08:23.128480 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:23.128437 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvwsb" event={"ID":"4640c960-6c19-446d-9e43-e507f8d62cb8","Type":"ContainerStarted","Data":"a30048f4324e0bd0685da2c21d3dfc0f20c16ded0f0c5152d0899e52af2ce12e"} May 21 14:08:24.132957 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:24.132915 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvwsb" event={"ID":"4640c960-6c19-446d-9e43-e507f8d62cb8","Type":"ContainerStarted","Data":"44af2fe9f4c86ed5527a661cb47c9526d3c47bfe3c14c90a150d715f974bdd81"} May 21 14:08:24.132957 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:24.132957 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvwsb" event={"ID":"4640c960-6c19-446d-9e43-e507f8d62cb8","Type":"ContainerStarted","Data":"6f014e5b9a4a96d82b38f73cff776c6f8c91fa9975c92052e87c3cae7430edc5"} May 21 14:08:24.164797 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:24.164743 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tvwsb" podStartSLOduration=252.194008034 podStartE2EDuration="4m13.164725499s" podCreationTimestamp="2026-05-21 14:04:11 +0000 UTC" firstStartedPulling="2026-05-21 14:08:22.486739068 +0000 UTC m=+251.758635158" lastFinishedPulling="2026-05-21 14:08:23.457456539 +0000 UTC m=+252.729352623" observedRunningTime="2026-05-21 14:08:24.163453399 +0000 UTC m=+253.435349498" watchObservedRunningTime="2026-05-21 14:08:24.164725499 +0000 UTC m=+253.436621619" May 21 14:08:32.737217 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737125 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:32.737786 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737736 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="prometheus" containerID="cri-o://9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" gracePeriod=600 May 21 14:08:32.737890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737789 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-web" containerID="cri-o://f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" gracePeriod=600 May 21 14:08:32.737890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737815 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="thanos-sidecar" containerID="cri-o://0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" gracePeriod=600 May 21 14:08:32.737890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737836 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy" containerID="cri-o://d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" gracePeriod=600 May 21 14:08:32.737890 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737788 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-thanos" containerID="cri-o://de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" gracePeriod=600 May 21 14:08:32.738065 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.737823 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="config-reloader" containerID="cri-o://ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" gracePeriod=600 May 21 14:08:32.978581 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:32.978553 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.038343 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038270 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038343 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038312 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038343 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038342 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038365 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038390 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038419 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038445 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjlx\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038489 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038517 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038545 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038568 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.038600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038598 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038642 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038668 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038750 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038782 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038816 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038819 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:33.039070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.038839 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config\") pod \"50bcfa2d-304b-46c5-99ab-d13bda782675\" (UID: \"50bcfa2d-304b-46c5-99ab-d13bda782675\") " May 21 14:08:33.039458 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.039094 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.039458 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.039113 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:33.041024 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.039910 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:33.041024 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.040322 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:08:33.041459 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.041430 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.042068 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.041784 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.042068 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.041842 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.042068 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.041737 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.042321 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.042299 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:33.042548 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.042520 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:33.042927 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.042872 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx" (OuterVolumeSpecName: "kube-api-access-shjlx") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "kube-api-access-shjlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:08:33.043070 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.043045 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out" (OuterVolumeSpecName: "config-out") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:08:33.043238 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.043214 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.043549 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.043529 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:08:33.043880 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.043855 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config" (OuterVolumeSpecName: "config") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.044614 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.044584 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.044614 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.044602 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.053600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.053576 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config" (OuterVolumeSpecName: "web-config") pod "50bcfa2d-304b-46c5-99ab-d13bda782675" (UID: "50bcfa2d-304b-46c5-99ab-d13bda782675"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:33.140267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140221 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-grpc-tls\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140265 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-web-config\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140278 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjlx\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-kube-api-access-shjlx\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140293 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140308 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140321 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140332 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50bcfa2d-304b-46c5-99ab-d13bda782675-tls-assets\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140345 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140357 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-kube-rbac-proxy\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140399 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140414 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-metrics-client-ca\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140429 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50bcfa2d-304b-46c5-99ab-d13bda782675-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140442 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140456 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-config\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140471 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-prometheus-k8s-db\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140484 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50bcfa2d-304b-46c5-99ab-d13bda782675-config-out\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.140496 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.140497 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50bcfa2d-304b-46c5-99ab-d13bda782675-secret-metrics-client-certs\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:08:33.157913 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157882 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" exitCode=0 May 21 14:08:33.157913 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157911 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" exitCode=0 May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157922 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" exitCode=0 May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157931 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" exitCode=0 May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157940 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" exitCode=0 May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157948 2559 generic.go:358] "Generic (PLEG): container finished" podID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" exitCode=0 May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157948 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.157991 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158004 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158010 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158015 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158027 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158036 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158045 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50bcfa2d-304b-46c5-99ab-d13bda782675","Type":"ContainerDied","Data":"62fcaf2c79c86f2832173c4fdae6a6d3ec91bf00204e0ca1d7218cc3096a5fa7"} May 21 14:08:33.158069 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.158062 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.166256 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.166241 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.172585 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.172566 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.178613 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.178593 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.183237 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.183214 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:33.185558 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.185544 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.188588 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.188567 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:33.192136 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.192119 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.198618 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.198602 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.204383 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.204366 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.204641 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.204601 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.204689 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.204646 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.204689 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.204681 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.204899 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.204885 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.204949 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.204904 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.204949 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.204917 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.205146 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.205128 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.205238 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205150 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.205238 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205170 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.205400 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.205385 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.205455 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205409 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.205455 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205430 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.205711 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.205692 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.205781 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205719 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.205781 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205737 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.205988 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.205972 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.206034 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.205992 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.206034 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206014 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.206217 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:08:33.206201 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.206255 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206222 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.206255 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206242 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.206450 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206435 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.206450 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206450 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.206656 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206636 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.206709 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206657 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.206856 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206841 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.206893 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.206856 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.207043 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207029 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.207081 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207043 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.207237 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207223 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.207275 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207237 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.207397 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207385 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.207432 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207399 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.207723 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207616 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.207762 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207727 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.207948 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207924 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.207989 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.207951 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.208180 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208156 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.208180 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208174 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.208427 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208399 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.208490 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208427 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.208782 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208710 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.208782 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208733 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.209026 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.208996 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.209112 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209027 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.209274 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209255 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.209334 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209274 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.209465 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209450 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.209505 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209465 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.209689 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209666 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.209766 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209692 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.209922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209904 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.209983 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.209923 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.210126 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210107 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.210203 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210128 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.210314 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210291 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.210359 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210317 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.210491 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210474 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.210560 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210493 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.210735 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210717 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.210785 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210736 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.210960 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210943 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.211013 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.210960 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.211162 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211143 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.211231 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211165 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.211377 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211361 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.211437 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211379 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.211561 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211545 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.211638 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211562 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.211805 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211785 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.211861 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.211808 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.212037 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212019 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.212037 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212036 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.212226 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212208 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.212226 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212225 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.212416 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212393 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.212464 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212417 2559 scope.go:117] "RemoveContainer" containerID="de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916" May 21 14:08:33.212633 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212604 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916"} err="failed to get container status \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": rpc error: code = NotFound desc = could not find container \"de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916\": container with ID starting with de00cdfc943e57ec4ed895e0fd69aaf4fee16fdd086354298520cd5dc517f916 not found: ID does not exist" May 21 14:08:33.212680 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212632 2559 scope.go:117] "RemoveContainer" containerID="d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3" May 21 14:08:33.212792 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212778 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3"} err="failed to get container status \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": rpc error: code = NotFound desc = could not find container \"d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3\": container with ID starting with d29376576e55602c1e8f4344bada02e9b1078715f1dbb5b9567f71c699b402e3 not found: ID does not exist" May 21 14:08:33.212835 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212792 2559 scope.go:117] "RemoveContainer" containerID="f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8" May 21 14:08:33.212982 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212966 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8"} err="failed to get container status \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": rpc error: code = NotFound desc = could not find container \"f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8\": container with ID starting with f8c6959b9d5adb73c5cb570bfd121f5e4f11765b20b0f5e3dc07161f9d6991f8 not found: ID does not exist" May 21 14:08:33.212982 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.212981 2559 scope.go:117] "RemoveContainer" containerID="0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98" May 21 14:08:33.213150 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213135 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98"} err="failed to get container status \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": rpc error: code = NotFound desc = could not find container \"0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98\": container with ID starting with 0cde6fa42b62289ee4a16c4689b3527ab4892d4735e2f713a7b26625d5231a98 not found: ID does not exist" May 21 14:08:33.213198 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213150 2559 scope.go:117] "RemoveContainer" containerID="ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f" May 21 14:08:33.213290 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213277 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f"} err="failed to get container status \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": rpc error: code = NotFound desc = could not find container \"ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f\": container with ID starting with ae5625a06584738c5bc49246964815e18c6381bf918d2e59d68e9d27bd92a36f not found: ID does not exist" May 21 14:08:33.213339 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213291 2559 scope.go:117] "RemoveContainer" containerID="9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1" May 21 14:08:33.213465 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213436 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1"} err="failed to get container status \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": rpc error: code = NotFound desc = could not find container \"9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1\": container with ID starting with 9870b29d0285640e88e08f67c58f19632b975564b62e0eb9db20085cda3524a1 not found: ID does not exist" May 21 14:08:33.213508 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213467 2559 scope.go:117] "RemoveContainer" containerID="206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e" May 21 14:08:33.213669 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.213653 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e"} err="failed to get container status \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": rpc error: code = NotFound desc = could not find container \"206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e\": container with ID starting with 206f2dda9accb82ef5869d41ba4ce8a5cb7133547080893315cd7b5ee4deff0e not found: ID does not exist" May 21 14:08:33.220167 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220148 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:33.220437 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220425 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-thanos" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220439 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-thanos" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220447 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="config-reloader" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220452 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="config-reloader" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220463 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="thanos-sidecar" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220468 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="thanos-sidecar" May 21 14:08:33.220479 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220479 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="init-config-reloader" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220485 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="init-config-reloader" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220492 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-web" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220497 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-web" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220504 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="prometheus" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220509 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="prometheus" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220518 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220523 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220565 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-thanos" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220572 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="config-reloader" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220579 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220587 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="thanos-sidecar" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220592 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="kube-rbac-proxy-web" May 21 14:08:33.220665 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.220599 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" containerName="prometheus" May 21 14:08:33.225519 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.225502 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.229796 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.229778 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tn2tg\"" May 21 14:08:33.230073 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230054 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 14:08:33.230151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230077 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 14:08:33.230151 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230085 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 14:08:33.230260 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230208 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 14:08:33.230260 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230223 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3plqmteilvh43\"" May 21 14:08:33.230260 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230219 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 14:08:33.230260 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230253 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 14:08:33.230425 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230311 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 14:08:33.230468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230442 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 14:08:33.230857 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.230837 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 14:08:33.231269 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.231252 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 14:08:33.233431 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.233412 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 14:08:33.237248 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.237228 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 14:08:33.240602 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.240580 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:33.337149 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.337071 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50bcfa2d-304b-46c5-99ab-d13bda782675" path="/var/lib/kubelet/pods/50bcfa2d-304b-46c5-99ab-d13bda782675/volumes" May 21 14:08:33.342184 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342287 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342287 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342287 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342287 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlzcr\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-kube-api-access-wlzcr\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342424 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.342642 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.342618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.443755 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443717 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.443968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443765 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.443968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443783 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.443968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443797 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.443968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443931 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444190 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.443975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlzcr\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-kube-api-access-wlzcr\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444190 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444033 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444190 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444359 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444415 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444380 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444415 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444517 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444413 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444517 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444621 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444518 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444621 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444554 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444621 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444589 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444805 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444618 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444805 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444676 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.444805 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.444721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.445559 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.445264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.445559 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.445553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.445762 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.445581 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.447129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.446819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.447129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.446934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.447129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.446971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.447129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.446968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.447891 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.447560 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.448030 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.447997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e2d766-5571-44c1-a12b-60ce2676fa31-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.448096 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.448082 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-config\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.448787 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.448762 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.448894 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.448831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e2d766-5571-44c1-a12b-60ce2676fa31-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.449260 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.449239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.449360 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.449343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.449527 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.449501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.449767 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.449750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e2d766-5571-44c1-a12b-60ce2676fa31-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.453120 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.453097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlzcr\" (UniqueName: \"kubernetes.io/projected/24e2d766-5571-44c1-a12b-60ce2676fa31-kube-api-access-wlzcr\") pod \"prometheus-k8s-0\" (UID: \"24e2d766-5571-44c1-a12b-60ce2676fa31\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.535378 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.535340 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:08:33.668691 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:33.668532 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 14:08:33.671505 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:08:33.671471 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e2d766_5571_44c1_a12b_60ce2676fa31.slice/crio-8d1ac334a015dad9d8802211e444dd46b80c6914d8b5b2953b56396baca6c2ed WatchSource:0}: Error finding container 8d1ac334a015dad9d8802211e444dd46b80c6914d8b5b2953b56396baca6c2ed: Status 404 returned error can't find the container with id 8d1ac334a015dad9d8802211e444dd46b80c6914d8b5b2953b56396baca6c2ed May 21 14:08:34.163553 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:34.163512 2559 generic.go:358] "Generic (PLEG): container finished" podID="24e2d766-5571-44c1-a12b-60ce2676fa31" containerID="89014047d22ee35e5b64ff28f31f1f62c8f765dd0375159aacfb7c4a6e48d072" exitCode=0 May 21 14:08:34.164028 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:34.163568 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerDied","Data":"89014047d22ee35e5b64ff28f31f1f62c8f765dd0375159aacfb7c4a6e48d072"} May 21 14:08:34.164028 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:34.163588 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"8d1ac334a015dad9d8802211e444dd46b80c6914d8b5b2953b56396baca6c2ed"} May 21 14:08:35.169440 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169403 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"daea3aaee83ba5db1e4ab191bc4ceb367bdbe2150e2bf0d321f34fdc996ddebc"} May 21 14:08:35.169440 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169440 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"b95b2bb32f4efc11c415cde2d61712705f4130bbc255a07e1b4f75f332e28315"} May 21 14:08:35.169941 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169453 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"927e16b485b358c662a80a954ba58a41eacb2395fc02bb46fac07de39d9b7d83"} May 21 14:08:35.169941 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169465 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"1887e0dc002df44b989bb0b64ef492d09dc13b1379679976721c68024397f5c6"} May 21 14:08:35.169941 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169475 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"ba4a50f5ab41b7599a57ff7be460a9af3d85d9fc7fb44eeb126e2ebffd706659"} May 21 14:08:35.169941 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.169485 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e2d766-5571-44c1-a12b-60ce2676fa31","Type":"ContainerStarted","Data":"3088a9300e5681b16e3f855c14e8cb8d4a72f29cb65a77e9057e86513463bbcd"} May 21 14:08:35.204995 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:35.204938 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.204921956 podStartE2EDuration="2.204921956s" podCreationTimestamp="2026-05-21 14:08:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:08:35.20249616 +0000 UTC m=+264.474392262" watchObservedRunningTime="2026-05-21 14:08:35.204921956 +0000 UTC m=+264.476818055" May 21 14:08:38.536093 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:08:38.536037 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:09:02.177804 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.177769 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zfbrd"] May 21 14:09:02.180972 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.180949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.184283 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.184245 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:09:02.191746 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.191718 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfbrd"] May 21 14:09:02.281902 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.281866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-original-pull-secret\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.281902 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.281904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-kubelet-config\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.282126 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.281927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-dbus\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.383346 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.383297 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-original-pull-secret\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.383346 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.383344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-kubelet-config\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.383587 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.383413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-kubelet-config\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.383587 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.383460 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-dbus\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.383714 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.383692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-dbus\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.385630 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.385599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f23d8e12-4b8e-43b3-99a9-2d75e9cc4560-original-pull-secret\") pod \"global-pull-secret-syncer-zfbrd\" (UID: \"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560\") " pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.491836 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.491751 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfbrd" May 21 14:09:02.617870 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:02.617837 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfbrd"] May 21 14:09:02.621452 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:09:02.621419 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23d8e12_4b8e_43b3_99a9_2d75e9cc4560.slice/crio-6c1ea3af7644b43bf12228a47185fd9c772dc3bdbad1da60f2014b2641d03bd6 WatchSource:0}: Error finding container 6c1ea3af7644b43bf12228a47185fd9c772dc3bdbad1da60f2014b2641d03bd6: Status 404 returned error can't find the container with id 6c1ea3af7644b43bf12228a47185fd9c772dc3bdbad1da60f2014b2641d03bd6 May 21 14:09:03.253598 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:03.253553 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfbrd" event={"ID":"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560","Type":"ContainerStarted","Data":"6c1ea3af7644b43bf12228a47185fd9c772dc3bdbad1da60f2014b2641d03bd6"} May 21 14:09:08.270185 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:08.270144 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfbrd" event={"ID":"f23d8e12-4b8e-43b3-99a9-2d75e9cc4560","Type":"ContainerStarted","Data":"9aeb8cf5177216702494e650675fd5199d84c275af027b8b06f5c54614daa0ec"} May 21 14:09:08.289323 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:08.289246 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zfbrd" podStartSLOduration=1.6292251850000001 podStartE2EDuration="6.28922964s" podCreationTimestamp="2026-05-21 14:09:02 +0000 UTC" firstStartedPulling="2026-05-21 14:09:02.62316115 +0000 UTC m=+291.895057226" lastFinishedPulling="2026-05-21 14:09:07.283165603 +0000 UTC m=+296.555061681" observedRunningTime="2026-05-21 14:09:08.288577439 +0000 UTC m=+297.560473537" watchObservedRunningTime="2026-05-21 14:09:08.28922964 +0000 UTC m=+297.561125738" May 21 14:09:11.219040 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:11.219015 2559 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:09:33.535577 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:33.535536 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:09:33.550726 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:33.550698 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:09:34.354588 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:09:34.354555 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 14:10:28.273381 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.273344 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk"] May 21 14:10:28.275516 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.275499 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.280576 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.280547 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:10:28.280576 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.280551 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:10:28.280764 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.280579 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qmb4z\"" May 21 14:10:28.280764 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.280668 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:10:28.281040 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.281023 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:10:28.310710 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.310679 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk"] May 21 14:10:28.375752 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.375716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4bl\" (UniqueName: \"kubernetes.io/projected/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-kube-api-access-zf4bl\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.375895 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.375755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.375895 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.375794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.477084 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.477053 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4bl\" (UniqueName: \"kubernetes.io/projected/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-kube-api-access-zf4bl\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.477227 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.477095 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.477227 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.477116 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.479532 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.479511 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.479606 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.479588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.490020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.489992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4bl\" (UniqueName: \"kubernetes.io/projected/fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1-kube-api-access-zf4bl\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-zdwjk\" (UID: \"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.586170 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.586081 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:28.781839 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.781793 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk"] May 21 14:10:28.784016 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:10:28.783982 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdeefe8_4026_4d18_aa0f_c2eb96f21ed1.slice/crio-bd171daa29f518c2d9597da810b08e2026fde5ba72f0ac98486a38da2ca1909f WatchSource:0}: Error finding container bd171daa29f518c2d9597da810b08e2026fde5ba72f0ac98486a38da2ca1909f: Status 404 returned error can't find the container with id bd171daa29f518c2d9597da810b08e2026fde5ba72f0ac98486a38da2ca1909f May 21 14:10:28.785678 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:28.785663 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:10:29.495135 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:29.495067 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" event={"ID":"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1","Type":"ContainerStarted","Data":"bd171daa29f518c2d9597da810b08e2026fde5ba72f0ac98486a38da2ca1909f"} May 21 14:10:32.505564 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:32.505529 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" event={"ID":"fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1","Type":"ContainerStarted","Data":"e6e826027d7f4ca19fc69f3771db387daf30a028d3f022e694a35c4b0f6c214b"} May 21 14:10:32.505982 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:32.505588 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:32.543876 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:32.543832 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" podStartSLOduration=1.881652755 podStartE2EDuration="4.54381765s" podCreationTimestamp="2026-05-21 14:10:28 +0000 UTC" firstStartedPulling="2026-05-21 14:10:28.78578208 +0000 UTC m=+378.057678157" lastFinishedPulling="2026-05-21 14:10:31.447946972 +0000 UTC m=+380.719843052" observedRunningTime="2026-05-21 14:10:32.541796025 +0000 UTC m=+381.813692126" watchObservedRunningTime="2026-05-21 14:10:32.54381765 +0000 UTC m=+381.815713745" May 21 14:10:43.511829 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:43.511796 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-zdwjk" May 21 14:10:50.074823 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.074785 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c"] May 21 14:10:50.077557 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.077536 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.080789 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.080750 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:10:50.080953 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.080927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:10:50.081752 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.081731 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:10:50.081752 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.081743 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:10:50.081930 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.081743 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jh8gp\"" May 21 14:10:50.085036 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.084997 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c"] May 21 14:10:50.160126 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.160092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec47a80-581c-486c-bde9-47fd0b41fcad-tls-certs\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.160313 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.160173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ec47a80-581c-486c-bde9-47fd0b41fcad-tmp\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.160313 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.160285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npsm5\" (UniqueName: \"kubernetes.io/projected/4ec47a80-581c-486c-bde9-47fd0b41fcad-kube-api-access-npsm5\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.261333 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.261288 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npsm5\" (UniqueName: \"kubernetes.io/projected/4ec47a80-581c-486c-bde9-47fd0b41fcad-kube-api-access-npsm5\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.261333 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.261341 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec47a80-581c-486c-bde9-47fd0b41fcad-tls-certs\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.261551 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.261373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ec47a80-581c-486c-bde9-47fd0b41fcad-tmp\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.263831 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.263794 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ec47a80-581c-486c-bde9-47fd0b41fcad-tmp\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.263973 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.263952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec47a80-581c-486c-bde9-47fd0b41fcad-tls-certs\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.269882 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.269856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npsm5\" (UniqueName: \"kubernetes.io/projected/4ec47a80-581c-486c-bde9-47fd0b41fcad-kube-api-access-npsm5\") pod \"kube-auth-proxy-bfd8cb9bb-8zw2c\" (UID: \"4ec47a80-581c-486c-bde9-47fd0b41fcad\") " pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.389235 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.389155 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" May 21 14:10:50.521415 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.521383 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c"] May 21 14:10:50.525114 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:10:50.525086 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec47a80_581c_486c_bde9_47fd0b41fcad.slice/crio-aec5d8d9ee0b7b9783ee611a61cdd4426e7207c4b3c257abc27f6d5460b50727 WatchSource:0}: Error finding container aec5d8d9ee0b7b9783ee611a61cdd4426e7207c4b3c257abc27f6d5460b50727: Status 404 returned error can't find the container with id aec5d8d9ee0b7b9783ee611a61cdd4426e7207c4b3c257abc27f6d5460b50727 May 21 14:10:50.556968 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:50.556939 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" event={"ID":"4ec47a80-581c-486c-bde9-47fd0b41fcad","Type":"ContainerStarted","Data":"aec5d8d9ee0b7b9783ee611a61cdd4426e7207c4b3c257abc27f6d5460b50727"} May 21 14:10:52.081747 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.081713 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn"] May 21 14:10:52.088003 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.087975 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.096566 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.096420 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 14:10:52.096566 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.096440 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:10:52.097013 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.096991 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 14:10:52.097416 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.097362 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 14:10:52.097605 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.097589 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:10:52.097833 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.097815 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w58zt\"" May 21 14:10:52.134336 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.134301 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn"] May 21 14:10:52.179877 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.179837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a05977a5-dd7e-4879-909d-8721e3b61b60-manager-config\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.180061 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.179889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.180061 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.179933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-metrics-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.180061 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.180001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cdtv\" (UniqueName: \"kubernetes.io/projected/a05977a5-dd7e-4879-909d-8721e3b61b60-kube-api-access-8cdtv\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.281031 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.280991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cdtv\" (UniqueName: \"kubernetes.io/projected/a05977a5-dd7e-4879-909d-8721e3b61b60-kube-api-access-8cdtv\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.281203 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.281085 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a05977a5-dd7e-4879-909d-8721e3b61b60-manager-config\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.281203 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.281120 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.281203 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.281161 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-metrics-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.282326 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.282288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a05977a5-dd7e-4879-909d-8721e3b61b60-manager-config\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.284068 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.284019 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-metrics-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.284494 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.284470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05977a5-dd7e-4879-909d-8721e3b61b60-cert\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.291273 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.291220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cdtv\" (UniqueName: \"kubernetes.io/projected/a05977a5-dd7e-4879-909d-8721e3b61b60-kube-api-access-8cdtv\") pod \"lws-controller-manager-7454667d6f-rlgbn\" (UID: \"a05977a5-dd7e-4879-909d-8721e3b61b60\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.402673 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.402615 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:52.544331 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.544153 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn"] May 21 14:10:52.546907 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:10:52.546874 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05977a5_dd7e_4879_909d_8721e3b61b60.slice/crio-95f5de63af59c01184283f3adda15a3e5d26062b9e06983bc15626a2b81b2cda WatchSource:0}: Error finding container 95f5de63af59c01184283f3adda15a3e5d26062b9e06983bc15626a2b81b2cda: Status 404 returned error can't find the container with id 95f5de63af59c01184283f3adda15a3e5d26062b9e06983bc15626a2b81b2cda May 21 14:10:52.565671 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:52.565619 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" event={"ID":"a05977a5-dd7e-4879-909d-8721e3b61b60","Type":"ContainerStarted","Data":"95f5de63af59c01184283f3adda15a3e5d26062b9e06983bc15626a2b81b2cda"} May 21 14:10:54.574000 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:54.573964 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" event={"ID":"4ec47a80-581c-486c-bde9-47fd0b41fcad","Type":"ContainerStarted","Data":"699b3bdfc249419cdf163920996904f91085c9220bc6434ed8db294fc5d20590"} May 21 14:10:54.604029 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:54.603974 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bfd8cb9bb-8zw2c" podStartSLOduration=1.349625777 podStartE2EDuration="4.60396131s" podCreationTimestamp="2026-05-21 14:10:50 +0000 UTC" firstStartedPulling="2026-05-21 14:10:50.526848527 +0000 UTC m=+399.798744605" lastFinishedPulling="2026-05-21 14:10:53.781184048 +0000 UTC m=+403.053080138" observedRunningTime="2026-05-21 14:10:54.602707386 +0000 UTC m=+403.874603486" watchObservedRunningTime="2026-05-21 14:10:54.60396131 +0000 UTC m=+403.875857408" May 21 14:10:55.578531 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:55.578504 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" event={"ID":"a05977a5-dd7e-4879-909d-8721e3b61b60","Type":"ContainerStarted","Data":"eac7a5a895a79279a7233cb2b7c4c15da16a4a8bd8403c5ade9ecb03761e5298"} May 21 14:10:55.578879 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:55.578589 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:10:55.604164 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:10:55.604119 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" podStartSLOduration=0.647256205 podStartE2EDuration="3.604103921s" podCreationTimestamp="2026-05-21 14:10:52 +0000 UTC" firstStartedPulling="2026-05-21 14:10:52.548924892 +0000 UTC m=+401.820820984" lastFinishedPulling="2026-05-21 14:10:55.505772623 +0000 UTC m=+404.777668700" observedRunningTime="2026-05-21 14:10:55.602181052 +0000 UTC m=+404.874077151" watchObservedRunningTime="2026-05-21 14:10:55.604103921 +0000 UTC m=+404.876000020" May 21 14:11:06.584480 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:11:06.584450 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-rlgbn" May 21 14:12:27.869429 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.869396 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8xxd9"] May 21 14:12:27.871907 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.871885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:27.874604 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.874559 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:12:27.874604 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.874587 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:12:27.875648 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.875609 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j7jt2\"" May 21 14:12:27.883363 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.883336 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8xxd9"] May 21 14:12:27.993732 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:27.993690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfbnx\" (UniqueName: \"kubernetes.io/projected/6a307d31-ad0e-48d4-84a2-bb70c41fde67-kube-api-access-nfbnx\") pod \"authorino-operator-657f44b778-8xxd9\" (UID: \"6a307d31-ad0e-48d4-84a2-bb70c41fde67\") " pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:28.095094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:28.095062 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfbnx\" (UniqueName: \"kubernetes.io/projected/6a307d31-ad0e-48d4-84a2-bb70c41fde67-kube-api-access-nfbnx\") pod \"authorino-operator-657f44b778-8xxd9\" (UID: \"6a307d31-ad0e-48d4-84a2-bb70c41fde67\") " pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:28.104838 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:28.104801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfbnx\" (UniqueName: \"kubernetes.io/projected/6a307d31-ad0e-48d4-84a2-bb70c41fde67-kube-api-access-nfbnx\") pod \"authorino-operator-657f44b778-8xxd9\" (UID: \"6a307d31-ad0e-48d4-84a2-bb70c41fde67\") " pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:28.182866 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:28.182827 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:28.329715 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:28.329677 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8xxd9"] May 21 14:12:28.334314 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:12:28.334277 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a307d31_ad0e_48d4_84a2_bb70c41fde67.slice/crio-335c313ef152464ea058f13ff4e8587c55aa49e448c7d8bd9df9ec0de3f72214 WatchSource:0}: Error finding container 335c313ef152464ea058f13ff4e8587c55aa49e448c7d8bd9df9ec0de3f72214: Status 404 returned error can't find the container with id 335c313ef152464ea058f13ff4e8587c55aa49e448c7d8bd9df9ec0de3f72214 May 21 14:12:28.881204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:28.881169 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" event={"ID":"6a307d31-ad0e-48d4-84a2-bb70c41fde67","Type":"ContainerStarted","Data":"335c313ef152464ea058f13ff4e8587c55aa49e448c7d8bd9df9ec0de3f72214"} May 21 14:12:30.889163 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:30.889112 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" event={"ID":"6a307d31-ad0e-48d4-84a2-bb70c41fde67","Type":"ContainerStarted","Data":"3a62eb9d8f8036aced481032286288afa6bb3320e3b3efaf067f2d9648e5d248"} May 21 14:12:30.889580 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:30.889217 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:12:30.905829 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:30.905779 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" podStartSLOduration=2.02957334 podStartE2EDuration="3.905763364s" podCreationTimestamp="2026-05-21 14:12:27 +0000 UTC" firstStartedPulling="2026-05-21 14:12:28.336139739 +0000 UTC m=+497.608035816" lastFinishedPulling="2026-05-21 14:12:30.21232976 +0000 UTC m=+499.484225840" observedRunningTime="2026-05-21 14:12:30.904960114 +0000 UTC m=+500.176856214" watchObservedRunningTime="2026-05-21 14:12:30.905763364 +0000 UTC m=+500.177659464" May 21 14:12:41.894794 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:12:41.894759 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-8xxd9" May 21 14:13:33.158125 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.158084 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:33.160459 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.160437 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:33.163719 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.163696 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n9h75\"" May 21 14:13:33.181970 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.181942 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:33.249027 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.248991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnltd\" (UniqueName: \"kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd\") pod \"authorino-f99f4b5cd-2q69l\" (UID: \"57dbe9ca-f35f-4654-b47a-b3b002cc1046\") " pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:33.350276 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.350244 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnltd\" (UniqueName: \"kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd\") pod \"authorino-f99f4b5cd-2q69l\" (UID: \"57dbe9ca-f35f-4654-b47a-b3b002cc1046\") " pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:33.370818 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.370784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnltd\" (UniqueName: \"kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd\") pod \"authorino-f99f4b5cd-2q69l\" (UID: \"57dbe9ca-f35f-4654-b47a-b3b002cc1046\") " pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:33.479754 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.479680 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:33.541893 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.541136 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:13:33.545457 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.545383 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:13:33.555169 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.555131 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:13:33.615304 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.615277 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:33.617342 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:13:33.617312 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57dbe9ca_f35f_4654_b47a_b3b002cc1046.slice/crio-6e9d73694cf7ac855000ffb07162a844bd62f235bf76cfacfb80eb9cc1f6a664 WatchSource:0}: Error finding container 6e9d73694cf7ac855000ffb07162a844bd62f235bf76cfacfb80eb9cc1f6a664: Status 404 returned error can't find the container with id 6e9d73694cf7ac855000ffb07162a844bd62f235bf76cfacfb80eb9cc1f6a664 May 21 14:13:33.652230 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.652203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzgt\" (UniqueName: \"kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt\") pod \"authorino-7498df8756-zs98s\" (UID: \"107be303-73a2-4e4d-b655-0491e04190b2\") " pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:13:33.752650 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.752554 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glzgt\" (UniqueName: \"kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt\") pod \"authorino-7498df8756-zs98s\" (UID: \"107be303-73a2-4e4d-b655-0491e04190b2\") " pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:13:33.762350 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.762319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzgt\" (UniqueName: \"kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt\") pod \"authorino-7498df8756-zs98s\" (UID: \"107be303-73a2-4e4d-b655-0491e04190b2\") " pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:13:33.865170 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.865140 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:13:33.989120 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:33.989070 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:13:33.991637 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:13:33.991597 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod107be303_73a2_4e4d_b655_0491e04190b2.slice/crio-8758cbf341ed5f7bf49decf93dabfc7adda5c9af66cfa6cf914bdfa597953c39 WatchSource:0}: Error finding container 8758cbf341ed5f7bf49decf93dabfc7adda5c9af66cfa6cf914bdfa597953c39: Status 404 returned error can't find the container with id 8758cbf341ed5f7bf49decf93dabfc7adda5c9af66cfa6cf914bdfa597953c39 May 21 14:13:34.083370 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:34.083298 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" event={"ID":"57dbe9ca-f35f-4654-b47a-b3b002cc1046","Type":"ContainerStarted","Data":"6e9d73694cf7ac855000ffb07162a844bd62f235bf76cfacfb80eb9cc1f6a664"} May 21 14:13:34.084250 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:34.084226 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zs98s" event={"ID":"107be303-73a2-4e4d-b655-0491e04190b2","Type":"ContainerStarted","Data":"8758cbf341ed5f7bf49decf93dabfc7adda5c9af66cfa6cf914bdfa597953c39"} May 21 14:13:38.100265 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:38.100223 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zs98s" event={"ID":"107be303-73a2-4e4d-b655-0491e04190b2","Type":"ContainerStarted","Data":"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b"} May 21 14:13:38.101532 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:38.101510 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" event={"ID":"57dbe9ca-f35f-4654-b47a-b3b002cc1046","Type":"ContainerStarted","Data":"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302"} May 21 14:13:38.125031 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:38.124986 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-zs98s" podStartSLOduration=1.791305739 podStartE2EDuration="5.124974437s" podCreationTimestamp="2026-05-21 14:13:33 +0000 UTC" firstStartedPulling="2026-05-21 14:13:33.992979397 +0000 UTC m=+563.264875475" lastFinishedPulling="2026-05-21 14:13:37.32664808 +0000 UTC m=+566.598544173" observedRunningTime="2026-05-21 14:13:38.12456254 +0000 UTC m=+567.396458639" watchObservedRunningTime="2026-05-21 14:13:38.124974437 +0000 UTC m=+567.396870572" May 21 14:13:38.149419 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:38.149365 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" podStartSLOduration=1.453081861 podStartE2EDuration="5.149350274s" podCreationTimestamp="2026-05-21 14:13:33 +0000 UTC" firstStartedPulling="2026-05-21 14:13:33.618640733 +0000 UTC m=+562.890536810" lastFinishedPulling="2026-05-21 14:13:37.314909139 +0000 UTC m=+566.586805223" observedRunningTime="2026-05-21 14:13:38.147262485 +0000 UTC m=+567.419158585" watchObservedRunningTime="2026-05-21 14:13:38.149350274 +0000 UTC m=+567.421246418" May 21 14:13:38.194659 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:38.194610 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:40.112076 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:40.108497 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" podUID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" containerName="authorino" containerID="cri-o://7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302" gracePeriod=30 May 21 14:13:40.356378 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:40.356354 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:40.415421 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:40.415390 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnltd\" (UniqueName: \"kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd\") pod \"57dbe9ca-f35f-4654-b47a-b3b002cc1046\" (UID: \"57dbe9ca-f35f-4654-b47a-b3b002cc1046\") " May 21 14:13:40.417590 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:40.417566 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd" (OuterVolumeSpecName: "kube-api-access-tnltd") pod "57dbe9ca-f35f-4654-b47a-b3b002cc1046" (UID: "57dbe9ca-f35f-4654-b47a-b3b002cc1046"). InnerVolumeSpecName "kube-api-access-tnltd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:13:40.516860 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:40.516825 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnltd\" (UniqueName: \"kubernetes.io/projected/57dbe9ca-f35f-4654-b47a-b3b002cc1046-kube-api-access-tnltd\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:13:41.113031 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.112990 2559 generic.go:358] "Generic (PLEG): container finished" podID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" containerID="7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302" exitCode=0 May 21 14:13:41.113471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.113046 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" event={"ID":"57dbe9ca-f35f-4654-b47a-b3b002cc1046","Type":"ContainerDied","Data":"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302"} May 21 14:13:41.113471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.113053 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" May 21 14:13:41.113471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.113078 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2q69l" event={"ID":"57dbe9ca-f35f-4654-b47a-b3b002cc1046","Type":"ContainerDied","Data":"6e9d73694cf7ac855000ffb07162a844bd62f235bf76cfacfb80eb9cc1f6a664"} May 21 14:13:41.113471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.113099 2559 scope.go:117] "RemoveContainer" containerID="7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302" May 21 14:13:41.121131 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.121101 2559 scope.go:117] "RemoveContainer" containerID="7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302" May 21 14:13:41.121426 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:13:41.121403 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302\": container with ID starting with 7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302 not found: ID does not exist" containerID="7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302" May 21 14:13:41.121538 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.121433 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302"} err="failed to get container status \"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302\": rpc error: code = NotFound desc = could not find container \"7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302\": container with ID starting with 7ba6b639efeb0e8aa9a10d662814fe1641bb450d04b9bb827ed8ab9e08a03302 not found: ID does not exist" May 21 14:13:41.146849 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.146811 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:41.155198 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.155172 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2q69l"] May 21 14:13:41.338044 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:13:41.338012 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" path="/var/lib/kubelet/pods/57dbe9ca-f35f-4654-b47a-b3b002cc1046/volumes" May 21 14:14:05.349785 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.349752 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-2hzzh"] May 21 14:14:05.350243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.350050 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" containerName="authorino" May 21 14:14:05.350243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.350062 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" containerName="authorino" May 21 14:14:05.350243 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.350115 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="57dbe9ca-f35f-4654-b47a-b3b002cc1046" containerName="authorino" May 21 14:14:05.389222 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.389193 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-2hzzh"] May 21 14:14:05.389384 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.389290 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:05.532919 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.532886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85sq\" (UniqueName: \"kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq\") pod \"authorino-8b475cf9f-2hzzh\" (UID: \"0290b378-c971-45e5-b21c-c851f79a87f6\") " pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:05.588241 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.588205 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-2hzzh"] May 21 14:14:05.588438 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:14:05.588418 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s85sq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-2hzzh" podUID="0290b378-c971-45e5-b21c-c851f79a87f6" May 21 14:14:05.617527 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.617455 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:05.619724 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.619707 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:05.632152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.632128 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:05.633777 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.633756 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s85sq\" (UniqueName: \"kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq\") pod \"authorino-8b475cf9f-2hzzh\" (UID: \"0290b378-c971-45e5-b21c-c851f79a87f6\") " pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:05.651010 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.650982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85sq\" (UniqueName: \"kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq\") pod \"authorino-8b475cf9f-2hzzh\" (UID: \"0290b378-c971-45e5-b21c-c851f79a87f6\") " pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:05.734694 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.734654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4gmz\" (UniqueName: \"kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz\") pod \"authorino-59c675f785-b4zq8\" (UID: \"447ea7b8-5656-4309-8fcd-481b71beb79d\") " pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:05.836000 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.835942 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4gmz\" (UniqueName: \"kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz\") pod \"authorino-59c675f785-b4zq8\" (UID: \"447ea7b8-5656-4309-8fcd-481b71beb79d\") " pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:05.844675 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.844644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4gmz\" (UniqueName: \"kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz\") pod \"authorino-59c675f785-b4zq8\" (UID: \"447ea7b8-5656-4309-8fcd-481b71beb79d\") " pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:05.891568 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.891542 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:05.891794 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.891782 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:05.918648 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.918604 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:14:05.921372 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.921352 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:05.932119 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.932088 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 14:14:05.934221 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:05.934195 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:14:06.038194 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.038156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8sc\" (UniqueName: \"kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.038359 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.038215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.043495 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.043472 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:06.045375 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:14:06.045349 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod447ea7b8_5656_4309_8fcd_481b71beb79d.slice/crio-53bdbb40a4b81d0e700db1bd4a70e38802414c44d05371bcbc284759c1099c06 WatchSource:0}: Error finding container 53bdbb40a4b81d0e700db1bd4a70e38802414c44d05371bcbc284759c1099c06: Status 404 returned error can't find the container with id 53bdbb40a4b81d0e700db1bd4a70e38802414c44d05371bcbc284759c1099c06 May 21 14:14:06.139089 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.139055 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8sc\" (UniqueName: \"kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.139267 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.139102 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.141410 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.141391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.148816 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.148762 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8sc\" (UniqueName: \"kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc\") pod \"authorino-7f9b7cbdf-7mld5\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.193237 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.193205 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c675f785-b4zq8" event={"ID":"447ea7b8-5656-4309-8fcd-481b71beb79d","Type":"ContainerStarted","Data":"53bdbb40a4b81d0e700db1bd4a70e38802414c44d05371bcbc284759c1099c06"} May 21 14:14:06.193237 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.193215 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:06.197770 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.197750 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:06.231359 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.231325 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:14:06.340896 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.340855 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s85sq\" (UniqueName: \"kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq\") pod \"0290b378-c971-45e5-b21c-c851f79a87f6\" (UID: \"0290b378-c971-45e5-b21c-c851f79a87f6\") " May 21 14:14:06.342839 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.342814 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq" (OuterVolumeSpecName: "kube-api-access-s85sq") pod "0290b378-c971-45e5-b21c-c851f79a87f6" (UID: "0290b378-c971-45e5-b21c-c851f79a87f6"). InnerVolumeSpecName "kube-api-access-s85sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:14:06.352953 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.352928 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:14:06.355721 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:14:06.355693 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bb5d710_08f5_480c_b841_b144b438518a.slice/crio-17f1062a211ca013d1afe24b798819d064f9dc3503fd169f84599cc9e9de0292 WatchSource:0}: Error finding container 17f1062a211ca013d1afe24b798819d064f9dc3503fd169f84599cc9e9de0292: Status 404 returned error can't find the container with id 17f1062a211ca013d1afe24b798819d064f9dc3503fd169f84599cc9e9de0292 May 21 14:14:06.441919 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:06.441900 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s85sq\" (UniqueName: \"kubernetes.io/projected/0290b378-c971-45e5-b21c-c851f79a87f6-kube-api-access-s85sq\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:14:07.197521 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.197483 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c675f785-b4zq8" event={"ID":"447ea7b8-5656-4309-8fcd-481b71beb79d","Type":"ContainerStarted","Data":"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4"} May 21 14:14:07.197740 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.197543 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-59c675f785-b4zq8" podUID="447ea7b8-5656-4309-8fcd-481b71beb79d" containerName="authorino" containerID="cri-o://f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4" gracePeriod=30 May 21 14:14:07.198851 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.198821 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" event={"ID":"5bb5d710-08f5-480c-b841-b144b438518a","Type":"ContainerStarted","Data":"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac"} May 21 14:14:07.199007 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.198854 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" event={"ID":"5bb5d710-08f5-480c-b841-b144b438518a","Type":"ContainerStarted","Data":"17f1062a211ca013d1afe24b798819d064f9dc3503fd169f84599cc9e9de0292"} May 21 14:14:07.199007 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.198897 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-2hzzh" May 21 14:14:07.216049 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.216008 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-59c675f785-b4zq8" podStartSLOduration=1.877987495 podStartE2EDuration="2.215995448s" podCreationTimestamp="2026-05-21 14:14:05 +0000 UTC" firstStartedPulling="2026-05-21 14:14:06.046495401 +0000 UTC m=+595.318391478" lastFinishedPulling="2026-05-21 14:14:06.38450335 +0000 UTC m=+595.656399431" observedRunningTime="2026-05-21 14:14:07.214110642 +0000 UTC m=+596.486006770" watchObservedRunningTime="2026-05-21 14:14:07.215995448 +0000 UTC m=+596.487891547" May 21 14:14:07.230504 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.230462 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" podStartSLOduration=1.928357061 podStartE2EDuration="2.230449662s" podCreationTimestamp="2026-05-21 14:14:05 +0000 UTC" firstStartedPulling="2026-05-21 14:14:06.356934958 +0000 UTC m=+595.628831036" lastFinishedPulling="2026-05-21 14:14:06.659027552 +0000 UTC m=+595.930923637" observedRunningTime="2026-05-21 14:14:07.229065065 +0000 UTC m=+596.500961197" watchObservedRunningTime="2026-05-21 14:14:07.230449662 +0000 UTC m=+596.502345813" May 21 14:14:07.259803 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.259761 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:14:07.260021 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.259998 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-zs98s" podUID="107be303-73a2-4e4d-b655-0491e04190b2" containerName="authorino" containerID="cri-o://89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b" gracePeriod=30 May 21 14:14:07.281676 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.281619 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-2hzzh"] May 21 14:14:07.287137 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.287111 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-2hzzh"] May 21 14:14:07.337956 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.337929 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0290b378-c971-45e5-b21c-c851f79a87f6" path="/var/lib/kubelet/pods/0290b378-c971-45e5-b21c-c851f79a87f6/volumes" May 21 14:14:07.504326 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.504300 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:07.512209 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.512182 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:14:07.653314 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.653285 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4gmz\" (UniqueName: \"kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz\") pod \"447ea7b8-5656-4309-8fcd-481b71beb79d\" (UID: \"447ea7b8-5656-4309-8fcd-481b71beb79d\") " May 21 14:14:07.653314 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.653320 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glzgt\" (UniqueName: \"kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt\") pod \"107be303-73a2-4e4d-b655-0491e04190b2\" (UID: \"107be303-73a2-4e4d-b655-0491e04190b2\") " May 21 14:14:07.655650 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.655337 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt" (OuterVolumeSpecName: "kube-api-access-glzgt") pod "107be303-73a2-4e4d-b655-0491e04190b2" (UID: "107be303-73a2-4e4d-b655-0491e04190b2"). InnerVolumeSpecName "kube-api-access-glzgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:14:07.655650 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.655388 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz" (OuterVolumeSpecName: "kube-api-access-d4gmz") pod "447ea7b8-5656-4309-8fcd-481b71beb79d" (UID: "447ea7b8-5656-4309-8fcd-481b71beb79d"). InnerVolumeSpecName "kube-api-access-d4gmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:14:07.754749 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.754668 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4gmz\" (UniqueName: \"kubernetes.io/projected/447ea7b8-5656-4309-8fcd-481b71beb79d-kube-api-access-d4gmz\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:14:07.754749 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:07.754699 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glzgt\" (UniqueName: \"kubernetes.io/projected/107be303-73a2-4e4d-b655-0491e04190b2-kube-api-access-glzgt\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:14:08.202727 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.202687 2559 generic.go:358] "Generic (PLEG): container finished" podID="447ea7b8-5656-4309-8fcd-481b71beb79d" containerID="f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4" exitCode=0 May 21 14:14:08.202926 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.202738 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c675f785-b4zq8" May 21 14:14:08.202926 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.202772 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c675f785-b4zq8" event={"ID":"447ea7b8-5656-4309-8fcd-481b71beb79d","Type":"ContainerDied","Data":"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4"} May 21 14:14:08.202926 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.202816 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c675f785-b4zq8" event={"ID":"447ea7b8-5656-4309-8fcd-481b71beb79d","Type":"ContainerDied","Data":"53bdbb40a4b81d0e700db1bd4a70e38802414c44d05371bcbc284759c1099c06"} May 21 14:14:08.202926 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.202839 2559 scope.go:117] "RemoveContainer" containerID="f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4" May 21 14:14:08.203731 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.203707 2559 generic.go:358] "Generic (PLEG): container finished" podID="107be303-73a2-4e4d-b655-0491e04190b2" containerID="89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b" exitCode=0 May 21 14:14:08.204277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.203798 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zs98s" May 21 14:14:08.204277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.203790 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zs98s" event={"ID":"107be303-73a2-4e4d-b655-0491e04190b2","Type":"ContainerDied","Data":"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b"} May 21 14:14:08.204277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.203835 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zs98s" event={"ID":"107be303-73a2-4e4d-b655-0491e04190b2","Type":"ContainerDied","Data":"8758cbf341ed5f7bf49decf93dabfc7adda5c9af66cfa6cf914bdfa597953c39"} May 21 14:14:08.211734 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.211716 2559 scope.go:117] "RemoveContainer" containerID="f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4" May 21 14:14:08.212073 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:14:08.212016 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4\": container with ID starting with f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4 not found: ID does not exist" containerID="f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4" May 21 14:14:08.212073 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.212042 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4"} err="failed to get container status \"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4\": rpc error: code = NotFound desc = could not find container \"f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4\": container with ID starting with f2299bae58fc5a7ec05f5ef83182c51d88709f3d49c86220b564e7958c80ddf4 not found: ID does not exist" May 21 14:14:08.212073 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.212057 2559 scope.go:117] "RemoveContainer" containerID="89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b" May 21 14:14:08.219194 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.219179 2559 scope.go:117] "RemoveContainer" containerID="89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b" May 21 14:14:08.219430 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:14:08.219415 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b\": container with ID starting with 89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b not found: ID does not exist" containerID="89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b" May 21 14:14:08.219478 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.219437 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b"} err="failed to get container status \"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b\": rpc error: code = NotFound desc = could not find container \"89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b\": container with ID starting with 89041d5ffa01b4595077a3ebb01b1c5e4be47f19aa805dc0eaec6ce23d2db71b not found: ID does not exist" May 21 14:14:08.230937 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.230907 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:14:08.236386 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.236362 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-zs98s"] May 21 14:14:08.252271 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.252235 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:08.254613 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:08.254584 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c675f785-b4zq8"] May 21 14:14:09.337986 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:09.337952 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="107be303-73a2-4e4d-b655-0491e04190b2" path="/var/lib/kubelet/pods/107be303-73a2-4e4d-b655-0491e04190b2/volumes" May 21 14:14:09.338358 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:14:09.338264 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447ea7b8-5656-4309-8fcd-481b71beb79d" path="/var/lib/kubelet/pods/447ea7b8-5656-4309-8fcd-481b71beb79d/volumes" May 21 14:15:00.131675 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.131637 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656215-rkl7x"] May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.131957 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447ea7b8-5656-4309-8fcd-481b71beb79d" containerName="authorino" May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.131967 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="447ea7b8-5656-4309-8fcd-481b71beb79d" containerName="authorino" May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.131976 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107be303-73a2-4e4d-b655-0491e04190b2" containerName="authorino" May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.131982 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="107be303-73a2-4e4d-b655-0491e04190b2" containerName="authorino" May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.132077 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="447ea7b8-5656-4309-8fcd-481b71beb79d" containerName="authorino" May 21 14:15:00.132127 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.132090 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="107be303-73a2-4e4d-b655-0491e04190b2" containerName="authorino" May 21 14:15:00.133958 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.133942 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:00.136923 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.136905 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gmx9h\"" May 21 14:15:00.139722 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.139697 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656215-rkl7x"] May 21 14:15:00.290585 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.290543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7fn\" (UniqueName: \"kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn\") pod \"maas-api-key-cleanup-29656215-rkl7x\" (UID: \"b1751636-74c7-4b35-936b-08dc26bd7092\") " pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:00.391215 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.391124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7fn\" (UniqueName: \"kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn\") pod \"maas-api-key-cleanup-29656215-rkl7x\" (UID: \"b1751636-74c7-4b35-936b-08dc26bd7092\") " pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:00.400331 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.400298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7fn\" (UniqueName: \"kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn\") pod \"maas-api-key-cleanup-29656215-rkl7x\" (UID: \"b1751636-74c7-4b35-936b-08dc26bd7092\") " pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:00.445280 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.445244 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:00.572201 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:00.572080 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656215-rkl7x"] May 21 14:15:00.574777 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:15:00.574751 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1751636_74c7_4b35_936b_08dc26bd7092.slice/crio-7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d WatchSource:0}: Error finding container 7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d: Status 404 returned error can't find the container with id 7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d May 21 14:15:01.371799 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:01.371754 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" event={"ID":"b1751636-74c7-4b35-936b-08dc26bd7092","Type":"ContainerStarted","Data":"7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d"} May 21 14:15:03.380738 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:03.380696 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" event={"ID":"b1751636-74c7-4b35-936b-08dc26bd7092","Type":"ContainerStarted","Data":"b36926e0a67ece0d573043d3b5a4565b2dd2b03dc6920f5f12f12f5b93525bd2"} May 21 14:15:03.399272 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:03.399218 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" podStartSLOduration=1.1084030440000001 podStartE2EDuration="3.399200653s" podCreationTimestamp="2026-05-21 14:15:00 +0000 UTC" firstStartedPulling="2026-05-21 14:15:00.576507202 +0000 UTC m=+649.848403280" lastFinishedPulling="2026-05-21 14:15:02.867304809 +0000 UTC m=+652.139200889" observedRunningTime="2026-05-21 14:15:03.39657236 +0000 UTC m=+652.668468458" watchObservedRunningTime="2026-05-21 14:15:03.399200653 +0000 UTC m=+652.671096753" May 21 14:15:04.385482 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:04.385447 2559 generic.go:358] "Generic (PLEG): container finished" podID="b1751636-74c7-4b35-936b-08dc26bd7092" containerID="b36926e0a67ece0d573043d3b5a4565b2dd2b03dc6920f5f12f12f5b93525bd2" exitCode=0 May 21 14:15:04.385898 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:04.385535 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" event={"ID":"b1751636-74c7-4b35-936b-08dc26bd7092","Type":"ContainerDied","Data":"b36926e0a67ece0d573043d3b5a4565b2dd2b03dc6920f5f12f12f5b93525bd2"} May 21 14:15:05.534003 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:05.533977 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:05.641699 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:05.638954 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml7fn\" (UniqueName: \"kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn\") pod \"b1751636-74c7-4b35-936b-08dc26bd7092\" (UID: \"b1751636-74c7-4b35-936b-08dc26bd7092\") " May 21 14:15:05.642354 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:05.642323 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn" (OuterVolumeSpecName: "kube-api-access-ml7fn") pod "b1751636-74c7-4b35-936b-08dc26bd7092" (UID: "b1751636-74c7-4b35-936b-08dc26bd7092"). InnerVolumeSpecName "kube-api-access-ml7fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:15:05.740129 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:05.740096 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml7fn\" (UniqueName: \"kubernetes.io/projected/b1751636-74c7-4b35-936b-08dc26bd7092-kube-api-access-ml7fn\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:15:06.392703 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:06.392660 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" event={"ID":"b1751636-74c7-4b35-936b-08dc26bd7092","Type":"ContainerDied","Data":"7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d"} May 21 14:15:06.392703 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:06.392695 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ecebc1015c0b8d3b8b095ae47ae03ac0b40d361024bc12f027a0101ee03da1d" May 21 14:15:06.392914 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:06.392770 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656215-rkl7x" May 21 14:15:22.631885 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.631848 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q"] May 21 14:15:22.632378 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.632180 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1751636-74c7-4b35-936b-08dc26bd7092" containerName="cleanup" May 21 14:15:22.632378 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.632193 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1751636-74c7-4b35-936b-08dc26bd7092" containerName="cleanup" May 21 14:15:22.632378 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.632263 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1751636-74c7-4b35-936b-08dc26bd7092" containerName="cleanup" May 21 14:15:22.635565 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.635543 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.639120 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.639093 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 14:15:22.639120 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.639106 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 14:15:22.639314 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.639158 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 14:15:22.639314 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.639106 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cmm5s\"" May 21 14:15:22.646369 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.646342 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q"] May 21 14:15:22.676971 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.676929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.677152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.676980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhjxk\" (UniqueName: \"kubernetes.io/projected/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kube-api-access-xhjxk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.677152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.677030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.677152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.677068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.677152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.677084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.677152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.677106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.777768 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777737 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.777768 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777772 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhjxk\" (UniqueName: \"kubernetes.io/projected/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kube-api-access-xhjxk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778033 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778033 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777825 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778033 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777841 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778033 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.777868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778192 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.778176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778277 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.778252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.778330 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.778290 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.780001 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.779971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.780263 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.780246 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.785978 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.785957 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhjxk\" (UniqueName: \"kubernetes.io/projected/19c8ab2b-9ee0-425c-993d-9c04e6e86e25-kube-api-access-xhjxk\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-76x6q\" (UID: \"19c8ab2b-9ee0-425c-993d-9c04e6e86e25\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:22.947064 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:22.947022 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:23.076441 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:23.076414 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q"] May 21 14:15:23.078775 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:15:23.078742 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c8ab2b_9ee0_425c_993d_9c04e6e86e25.slice/crio-13fdd5f6941e8a82d249b1acbaf94b8ebc0a5de2c23582a266a094d80a12fc4c WatchSource:0}: Error finding container 13fdd5f6941e8a82d249b1acbaf94b8ebc0a5de2c23582a266a094d80a12fc4c: Status 404 returned error can't find the container with id 13fdd5f6941e8a82d249b1acbaf94b8ebc0a5de2c23582a266a094d80a12fc4c May 21 14:15:23.449321 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:23.449280 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" event={"ID":"19c8ab2b-9ee0-425c-993d-9c04e6e86e25","Type":"ContainerStarted","Data":"13fdd5f6941e8a82d249b1acbaf94b8ebc0a5de2c23582a266a094d80a12fc4c"} May 21 14:15:29.469349 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:29.469311 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" event={"ID":"19c8ab2b-9ee0-425c-993d-9c04e6e86e25","Type":"ContainerStarted","Data":"2e8b282f7ee98981d8ef3ea96cf562cc5f73a2d994e7db2a54c8984d2a00837e"} May 21 14:15:35.491327 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:35.491291 2559 generic.go:358] "Generic (PLEG): container finished" podID="19c8ab2b-9ee0-425c-993d-9c04e6e86e25" containerID="2e8b282f7ee98981d8ef3ea96cf562cc5f73a2d994e7db2a54c8984d2a00837e" exitCode=0 May 21 14:15:35.491734 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:35.491364 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" event={"ID":"19c8ab2b-9ee0-425c-993d-9c04e6e86e25","Type":"ContainerDied","Data":"2e8b282f7ee98981d8ef3ea96cf562cc5f73a2d994e7db2a54c8984d2a00837e"} May 21 14:15:35.491981 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:35.491964 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:15:38.501868 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.501832 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" event={"ID":"19c8ab2b-9ee0-425c-993d-9c04e6e86e25","Type":"ContainerStarted","Data":"650bca98540aec5a7b6b00ba5ab330e4a664e3e85548ae2b3bc9853af126f0e2"} May 21 14:15:38.502348 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.502065 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:38.521590 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.521536 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" podStartSLOduration=1.954747016 podStartE2EDuration="16.521521637s" podCreationTimestamp="2026-05-21 14:15:22 +0000 UTC" firstStartedPulling="2026-05-21 14:15:23.080946202 +0000 UTC m=+672.352842282" lastFinishedPulling="2026-05-21 14:15:37.647720823 +0000 UTC m=+686.919616903" observedRunningTime="2026-05-21 14:15:38.520010287 +0000 UTC m=+687.791906411" watchObservedRunningTime="2026-05-21 14:15:38.521521637 +0000 UTC m=+687.793417736" May 21 14:15:38.949023 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.948988 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc"] May 21 14:15:38.952428 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.952409 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:38.955541 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.955524 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 14:15:38.965188 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:38.965158 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc"] May 21 14:15:39.023475 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.023475 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.023729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.023729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9b5s\" (UniqueName: \"kubernetes.io/projected/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kube-api-access-v9b5s\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.023729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.023729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.023649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124772 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124727 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124832 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124885 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9b5s\" (UniqueName: \"kubernetes.io/projected/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kube-api-access-v9b5s\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.124963 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.124908 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.125226 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.125187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.125226 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.125207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.125359 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.125340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.127301 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.127272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.127471 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.127454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.134897 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.134874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9b5s\" (UniqueName: \"kubernetes.io/projected/61bd5cb6-cd41-4b27-9c6e-1ff99a938f80-kube-api-access-v9b5s\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc\" (UID: \"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.262296 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.262211 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:39.410731 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.410701 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc"] May 21 14:15:39.411450 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:15:39.411427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bd5cb6_cd41_4b27_9c6e_1ff99a938f80.slice/crio-603c80d07da3f136d14a8b67ca6c7d11f0c05c75a07a6acbf8c8fb724bd0f846 WatchSource:0}: Error finding container 603c80d07da3f136d14a8b67ca6c7d11f0c05c75a07a6acbf8c8fb724bd0f846: Status 404 returned error can't find the container with id 603c80d07da3f136d14a8b67ca6c7d11f0c05c75a07a6acbf8c8fb724bd0f846 May 21 14:15:39.506499 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.506461 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" event={"ID":"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80","Type":"ContainerStarted","Data":"23274f9f7548f61ea5287f91904a8480941ec3887db48bfb02a573db64b47f2d"} May 21 14:15:39.506499 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:39.506501 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" event={"ID":"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80","Type":"ContainerStarted","Data":"603c80d07da3f136d14a8b67ca6c7d11f0c05c75a07a6acbf8c8fb724bd0f846"} May 21 14:15:45.528122 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:45.528088 2559 generic.go:358] "Generic (PLEG): container finished" podID="61bd5cb6-cd41-4b27-9c6e-1ff99a938f80" containerID="23274f9f7548f61ea5287f91904a8480941ec3887db48bfb02a573db64b47f2d" exitCode=0 May 21 14:15:45.528518 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:45.528147 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" event={"ID":"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80","Type":"ContainerDied","Data":"23274f9f7548f61ea5287f91904a8480941ec3887db48bfb02a573db64b47f2d"} May 21 14:15:46.533558 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:46.533523 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" event={"ID":"61bd5cb6-cd41-4b27-9c6e-1ff99a938f80","Type":"ContainerStarted","Data":"39c38236f650ebfe026b2d8fd7b6fcc4e5a12ef7c89ed5100a849dbd3472eb28"} May 21 14:15:46.534009 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:46.533880 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:46.556272 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:46.556224 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" podStartSLOduration=8.285126761 podStartE2EDuration="8.556210529s" podCreationTimestamp="2026-05-21 14:15:38 +0000 UTC" firstStartedPulling="2026-05-21 14:15:45.528815955 +0000 UTC m=+694.800712031" lastFinishedPulling="2026-05-21 14:15:45.799899722 +0000 UTC m=+695.071795799" observedRunningTime="2026-05-21 14:15:46.555125058 +0000 UTC m=+695.827021159" watchObservedRunningTime="2026-05-21 14:15:46.556210529 +0000 UTC m=+695.828106628" May 21 14:15:49.519907 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:49.519868 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-76x6q" May 21 14:15:57.550652 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:57.550605 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc" May 21 14:15:59.371459 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.371428 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dcc4fc9b8-d7nkr"] May 21 14:15:59.523094 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.523064 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dcc4fc9b8-d7nkr"] May 21 14:15:59.523263 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.523171 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.607410 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.607377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe5680bb-830d-465d-86b5-d6adcaf84b0e-tls-cert\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.607584 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.607434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxgb\" (UniqueName: \"kubernetes.io/projected/fe5680bb-830d-465d-86b5-d6adcaf84b0e-kube-api-access-2lxgb\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.708720 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.708672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe5680bb-830d-465d-86b5-d6adcaf84b0e-tls-cert\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.708720 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.708724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxgb\" (UniqueName: \"kubernetes.io/projected/fe5680bb-830d-465d-86b5-d6adcaf84b0e-kube-api-access-2lxgb\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.711204 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.711171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe5680bb-830d-465d-86b5-d6adcaf84b0e-tls-cert\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.717568 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.717547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxgb\" (UniqueName: \"kubernetes.io/projected/fe5680bb-830d-465d-86b5-d6adcaf84b0e-kube-api-access-2lxgb\") pod \"authorino-6dcc4fc9b8-d7nkr\" (UID: \"fe5680bb-830d-465d-86b5-d6adcaf84b0e\") " pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.832561 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.832520 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" May 21 14:15:59.962469 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:15:59.962445 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dcc4fc9b8-d7nkr"] May 21 14:15:59.964955 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:15:59.964916 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe5680bb_830d_465d_86b5_d6adcaf84b0e.slice/crio-00edf07cf7e569fb376f3c88b0be741f3bb70828ca0ee9531daea094150e2380 WatchSource:0}: Error finding container 00edf07cf7e569fb376f3c88b0be741f3bb70828ca0ee9531daea094150e2380: Status 404 returned error can't find the container with id 00edf07cf7e569fb376f3c88b0be741f3bb70828ca0ee9531daea094150e2380 May 21 14:16:00.582126 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.582028 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" event={"ID":"fe5680bb-830d-465d-86b5-d6adcaf84b0e","Type":"ContainerStarted","Data":"ea8c8d8f21895e1df6736aa69fcba6ee4594d0dd2bf9f8b6383039c1a36fbbc5"} May 21 14:16:00.582126 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.582080 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" event={"ID":"fe5680bb-830d-465d-86b5-d6adcaf84b0e","Type":"ContainerStarted","Data":"00edf07cf7e569fb376f3c88b0be741f3bb70828ca0ee9531daea094150e2380"} May 21 14:16:00.598641 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.598566 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6dcc4fc9b8-d7nkr" podStartSLOduration=1.103411294 podStartE2EDuration="1.598550049s" podCreationTimestamp="2026-05-21 14:15:59 +0000 UTC" firstStartedPulling="2026-05-21 14:15:59.966156106 +0000 UTC m=+709.238052184" lastFinishedPulling="2026-05-21 14:16:00.461294857 +0000 UTC m=+709.733190939" observedRunningTime="2026-05-21 14:16:00.597693068 +0000 UTC m=+709.869589168" watchObservedRunningTime="2026-05-21 14:16:00.598550049 +0000 UTC m=+709.870446149" May 21 14:16:00.630215 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.630179 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:16:00.630825 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.630747 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" podUID="5bb5d710-08f5-480c-b841-b144b438518a" containerName="authorino" containerID="cri-o://52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac" gracePeriod=30 May 21 14:16:00.893695 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.893668 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:16:00.919904 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.919873 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg8sc\" (UniqueName: \"kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc\") pod \"5bb5d710-08f5-480c-b841-b144b438518a\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " May 21 14:16:00.920074 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.920019 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert\") pod \"5bb5d710-08f5-480c-b841-b144b438518a\" (UID: \"5bb5d710-08f5-480c-b841-b144b438518a\") " May 21 14:16:00.922139 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.922104 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc" (OuterVolumeSpecName: "kube-api-access-bg8sc") pod "5bb5d710-08f5-480c-b841-b144b438518a" (UID: "5bb5d710-08f5-480c-b841-b144b438518a"). InnerVolumeSpecName "kube-api-access-bg8sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:16:00.931048 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:00.931012 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5bb5d710-08f5-480c-b841-b144b438518a" (UID: "5bb5d710-08f5-480c-b841-b144b438518a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:16:01.021100 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.021009 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg8sc\" (UniqueName: \"kubernetes.io/projected/5bb5d710-08f5-480c-b841-b144b438518a-kube-api-access-bg8sc\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:16:01.021100 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.021052 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bb5d710-08f5-480c-b841-b144b438518a-tls-cert\") on node \"ip-10-0-139-85.ec2.internal\" DevicePath \"\"" May 21 14:16:01.586196 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.586164 2559 generic.go:358] "Generic (PLEG): container finished" podID="5bb5d710-08f5-480c-b841-b144b438518a" containerID="52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac" exitCode=0 May 21 14:16:01.586654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.586207 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" May 21 14:16:01.586654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.586248 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" event={"ID":"5bb5d710-08f5-480c-b841-b144b438518a","Type":"ContainerDied","Data":"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac"} May 21 14:16:01.586654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.586288 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b7cbdf-7mld5" event={"ID":"5bb5d710-08f5-480c-b841-b144b438518a","Type":"ContainerDied","Data":"17f1062a211ca013d1afe24b798819d064f9dc3503fd169f84599cc9e9de0292"} May 21 14:16:01.586654 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.586304 2559 scope.go:117] "RemoveContainer" containerID="52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac" May 21 14:16:01.594301 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.594284 2559 scope.go:117] "RemoveContainer" containerID="52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac" May 21 14:16:01.594608 ip-10-0-139-85 kubenswrapper[2559]: E0521 14:16:01.594550 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac\": container with ID starting with 52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac not found: ID does not exist" containerID="52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac" May 21 14:16:01.594608 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.594580 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac"} err="failed to get container status \"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac\": rpc error: code = NotFound desc = could not find container \"52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac\": container with ID starting with 52223e8bf4397c08a95c01d519132bbcec67d013d17ceb5a309ac200dca0a3ac not found: ID does not exist" May 21 14:16:01.603731 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.603708 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:16:01.609994 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:01.609971 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f9b7cbdf-7mld5"] May 21 14:16:03.337698 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:03.337668 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb5d710-08f5-480c-b841-b144b438518a" path="/var/lib/kubelet/pods/5bb5d710-08f5-480c-b841-b144b438518a/volumes" May 21 14:16:09.740394 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.740357 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww"] May 21 14:16:09.740873 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.740848 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb5d710-08f5-480c-b841-b144b438518a" containerName="authorino" May 21 14:16:09.740873 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.740867 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb5d710-08f5-480c-b841-b144b438518a" containerName="authorino" May 21 14:16:09.740990 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.740974 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5bb5d710-08f5-480c-b841-b144b438518a" containerName="authorino" May 21 14:16:09.744321 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.744298 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.746887 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.746868 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 14:16:09.755327 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.755304 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww"] May 21 14:16:09.803025 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.802983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwxsr\" (UniqueName: \"kubernetes.io/projected/9f281b6b-1033-440f-afe0-77acb5388a62-kube-api-access-bwxsr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.803166 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.803056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f281b6b-1033-440f-afe0-77acb5388a62-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.803166 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.803098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.803166 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.803120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.803285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.803195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.803285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.803229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.903900 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.903861 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.903900 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.903912 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.903945 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.903975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.903999 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwxsr\" (UniqueName: \"kubernetes.io/projected/9f281b6b-1033-440f-afe0-77acb5388a62-kube-api-access-bwxsr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904207 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.904079 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f281b6b-1033-440f-afe0-77acb5388a62-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904437 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.904368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904437 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.904393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.904600 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.904439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.906303 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.906275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f281b6b-1033-440f-afe0-77acb5388a62-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.906783 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.906761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f281b6b-1033-440f-afe0-77acb5388a62-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:09.913689 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:09.913665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwxsr\" (UniqueName: \"kubernetes.io/projected/9f281b6b-1033-440f-afe0-77acb5388a62-kube-api-access-bwxsr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww\" (UID: \"9f281b6b-1033-440f-afe0-77acb5388a62\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:10.055752 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:10.055655 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:10.184928 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:10.184899 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww"] May 21 14:16:10.187398 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:16:10.187367 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f281b6b_1033_440f_afe0_77acb5388a62.slice/crio-f9df3c39f18d566b1e255308147cbb5dd8db1c1ada1a3bac001e55510de9c39a WatchSource:0}: Error finding container f9df3c39f18d566b1e255308147cbb5dd8db1c1ada1a3bac001e55510de9c39a: Status 404 returned error can't find the container with id f9df3c39f18d566b1e255308147cbb5dd8db1c1ada1a3bac001e55510de9c39a May 21 14:16:10.619112 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:10.619078 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" event={"ID":"9f281b6b-1033-440f-afe0-77acb5388a62","Type":"ContainerStarted","Data":"01aca18a99563a0cb890c43ec24a17130b3151ef51b8503929bfd7db25d226d9"} May 21 14:16:10.619112 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:10.619114 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" event={"ID":"9f281b6b-1033-440f-afe0-77acb5388a62","Type":"ContainerStarted","Data":"f9df3c39f18d566b1e255308147cbb5dd8db1c1ada1a3bac001e55510de9c39a"} May 21 14:16:16.645829 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:16.645794 2559 generic.go:358] "Generic (PLEG): container finished" podID="9f281b6b-1033-440f-afe0-77acb5388a62" containerID="01aca18a99563a0cb890c43ec24a17130b3151ef51b8503929bfd7db25d226d9" exitCode=0 May 21 14:16:16.646206 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:16.645858 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" event={"ID":"9f281b6b-1033-440f-afe0-77acb5388a62","Type":"ContainerDied","Data":"01aca18a99563a0cb890c43ec24a17130b3151ef51b8503929bfd7db25d226d9"} May 21 14:16:17.651033 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:17.650997 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" event={"ID":"9f281b6b-1033-440f-afe0-77acb5388a62","Type":"ContainerStarted","Data":"fabc962f20c69fb0bf4171866afca01a04a8544e9993fe3a4bd31888a9d080f9"} May 21 14:16:17.651431 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:17.651216 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:16:17.673297 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:17.673244 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" podStartSLOduration=8.392968046 podStartE2EDuration="8.673230527s" podCreationTimestamp="2026-05-21 14:16:09 +0000 UTC" firstStartedPulling="2026-05-21 14:16:16.646413129 +0000 UTC m=+725.918309206" lastFinishedPulling="2026-05-21 14:16:16.926675611 +0000 UTC m=+726.198571687" observedRunningTime="2026-05-21 14:16:17.672131831 +0000 UTC m=+726.944027931" watchObservedRunningTime="2026-05-21 14:16:17.673230527 +0000 UTC m=+726.945126627" May 21 14:16:28.667513 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:16:28.667479 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww" May 21 14:38:32.757249 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:32.757175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dcc4fc9b8-d7nkr_fe5680bb-830d-465d-86b5-d6adcaf84b0e/authorino/0.log" May 21 14:38:37.403853 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:37.403821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656215-rkl7x_b1751636-74c7-4b35-936b-08dc26bd7092/cleanup/0.log" May 21 14:38:38.113085 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:38.113049 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd478c6-zdwjk_fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1/manager/0.log" May 21 14:38:39.468755 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:39.468710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dcc4fc9b8-d7nkr_fe5680bb-830d-465d-86b5-d6adcaf84b0e/authorino/0.log" May 21 14:38:39.585107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:39.585072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8xxd9_6a307d31-ad0e-48d4-84a2-bb70c41fde67/manager/0.log" May 21 14:38:40.954554 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:40.954523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfd8cb9bb-8zw2c_4ec47a80-581c-486c-bde9-47fd0b41fcad/kube-auth-proxy/0.log" May 21 14:38:41.783322 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:41.783290 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww_9f281b6b-1033-440f-afe0-77acb5388a62/storage-initializer/0.log" May 21 14:38:41.792089 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:41.792061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-7rrww_9f281b6b-1033-440f-afe0-77acb5388a62/main/0.log" May 21 14:38:41.904544 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:41.904518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-76x6q_19c8ab2b-9ee0-425c-993d-9c04e6e86e25/storage-initializer/0.log" May 21 14:38:41.912351 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:41.912330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-76x6q_19c8ab2b-9ee0-425c-993d-9c04e6e86e25/main/0.log" May 21 14:38:42.139798 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:42.139725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc_61bd5cb6-cd41-4b27-9c6e-1ff99a938f80/storage-initializer/0.log" May 21 14:38:42.146936 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:42.146902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-467gc_61bd5cb6-cd41-4b27-9c6e-1ff99a938f80/main/0.log" May 21 14:38:49.139398 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:49.139363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zfbrd_f23d8e12-4b8e-43b3-99a9-2d75e9cc4560/global-pull-secret-syncer/0.log" May 21 14:38:49.297695 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:49.297659 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cchrm_30bbdf39-5504-4540-8fe8-1b5a685ea880/konnectivity-agent/0.log" May 21 14:38:49.345793 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:49.345765 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-85.ec2.internal_8224d5ca3b6bacb7ce9024efcbf250f8/haproxy/0.log" May 21 14:38:53.276514 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:53.276474 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dcc4fc9b8-d7nkr_fe5680bb-830d-465d-86b5-d6adcaf84b0e/authorino/0.log" May 21 14:38:53.315902 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:53.315871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8xxd9_6a307d31-ad0e-48d4-84a2-bb70c41fde67/manager/0.log" May 21 14:38:55.079962 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.079887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-thlnw_01b4e3f5-056f-41a0-ad73-757e118bbce1/kube-state-metrics/0.log" May 21 14:38:55.101521 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.101487 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-thlnw_01b4e3f5-056f-41a0-ad73-757e118bbce1/kube-rbac-proxy-main/0.log" May 21 14:38:55.136450 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.136420 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-thlnw_01b4e3f5-056f-41a0-ad73-757e118bbce1/kube-rbac-proxy-self/0.log" May 21 14:38:55.176265 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.176239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b45cc9c9-bc72k_7c925183-24d1-4bc0-960f-fa7ec87119b4/metrics-server/0.log" May 21 14:38:55.372413 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.372334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbkch_4e9ad073-2d8a-41b6-a5be-2d2039a3c182/node-exporter/0.log" May 21 14:38:55.399682 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.399651 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbkch_4e9ad073-2d8a-41b6-a5be-2d2039a3c182/kube-rbac-proxy/0.log" May 21 14:38:55.436695 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.436669 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbkch_4e9ad073-2d8a-41b6-a5be-2d2039a3c182/init-textfile/0.log" May 21 14:38:55.666922 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.666899 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/prometheus/0.log" May 21 14:38:55.697111 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.697081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/config-reloader/0.log" May 21 14:38:55.721553 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.721521 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/thanos-sidecar/0.log" May 21 14:38:55.746463 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.746440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/kube-rbac-proxy-web/0.log" May 21 14:38:55.773285 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.773260 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/kube-rbac-proxy/0.log" May 21 14:38:55.803440 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.803416 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/kube-rbac-proxy-thanos/0.log" May 21 14:38:55.830666 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:55.830618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24e2d766-5571-44c1-a12b-60ce2676fa31/init-config-reloader/0.log" May 21 14:38:57.671862 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.671821 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4"] May 21 14:38:57.675060 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.675043 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.679198 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.679169 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dwhp\"/\"default-dockercfg-hczc4\"" May 21 14:38:57.679340 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.679206 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dwhp\"/\"openshift-service-ca.crt\"" May 21 14:38:57.679340 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.679293 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dwhp\"/\"kube-root-ca.crt\"" May 21 14:38:57.697675 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.697643 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4"] May 21 14:38:57.778813 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.778777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-lib-modules\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.779020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.778842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-sys\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.779020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.778867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-proc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.779020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.778892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzpc\" (UniqueName: \"kubernetes.io/projected/e64e7e8c-e821-456b-84b4-8f91d6c7e537-kube-api-access-5vzpc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.779020 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.778913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-podres\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880066 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-sys\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880107 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880107 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-proc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880153 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzpc\" (UniqueName: \"kubernetes.io/projected/e64e7e8c-e821-456b-84b4-8f91d6c7e537-kube-api-access-5vzpc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-podres\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880210 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-sys\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-proc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880311 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880281 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-lib-modules\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-podres\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.880468 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.880381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64e7e8c-e821-456b-84b4-8f91d6c7e537-lib-modules\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.889729 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.889691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzpc\" (UniqueName: \"kubernetes.io/projected/e64e7e8c-e821-456b-84b4-8f91d6c7e537-kube-api-access-5vzpc\") pod \"perf-node-gather-daemonset-qt8q4\" (UID: \"e64e7e8c-e821-456b-84b4-8f91d6c7e537\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:57.984646 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:57.984535 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:58.111750 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:58.111726 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4"] May 21 14:38:58.116700 ip-10-0-139-85 kubenswrapper[2559]: W0521 14:38:58.116162 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode64e7e8c_e821_456b_84b4_8f91d6c7e537.slice/crio-817773182de05286e90af93134641b7a93a5d0dea6ebe399a4d309f2543de8a9 WatchSource:0}: Error finding container 817773182de05286e90af93134641b7a93a5d0dea6ebe399a4d309f2543de8a9: Status 404 returned error can't find the container with id 817773182de05286e90af93134641b7a93a5d0dea6ebe399a4d309f2543de8a9 May 21 14:38:58.118090 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:58.118072 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:38:59.105643 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:59.105590 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" event={"ID":"e64e7e8c-e821-456b-84b4-8f91d6c7e537","Type":"ContainerStarted","Data":"98941d2fc4c70d7a6333d79dc5944e4f4edc5da4a9b7ccb361554a3885716451"} May 21 14:38:59.105998 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:59.105650 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" event={"ID":"e64e7e8c-e821-456b-84b4-8f91d6c7e537","Type":"ContainerStarted","Data":"817773182de05286e90af93134641b7a93a5d0dea6ebe399a4d309f2543de8a9"} May 21 14:38:59.105998 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:59.105731 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:38:59.123408 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:59.123365 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" podStartSLOduration=2.123352668 podStartE2EDuration="2.123352668s" podCreationTimestamp="2026-05-21 14:38:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:59.121583476 +0000 UTC m=+2088.393479576" watchObservedRunningTime="2026-05-21 14:38:59.123352668 +0000 UTC m=+2088.395248766" May 21 14:38:59.422510 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:38:59.422475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-shrsf_2fd2b16e-16a7-44a9-82a7-d853a512fb79/volume-data-source-validator/0.log" May 21 14:39:00.291153 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:00.291118 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtdln_6df665aa-9805-4ba0-99d5-d6eeafedfb83/dns/0.log" May 21 14:39:00.345058 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:00.345019 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtdln_6df665aa-9805-4ba0-99d5-d6eeafedfb83/kube-rbac-proxy/0.log" May 21 14:39:00.506529 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:00.506490 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng76h_aab2ef30-1c22-439a-9b7d-c79c052518ff/dns-node-resolver/0.log" May 21 14:39:01.138984 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:01.138937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55647dd54c-9lq8s_90f618f4-9ab8-4718-96a5-07c1c9f2a996/registry/0.log" May 21 14:39:01.303449 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:01.303415 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mctxb_3ae0136d-1fcb-41f6-989b-3313c618d119/node-ca/0.log" May 21 14:39:02.635583 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:02.635553 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfd8cb9bb-8zw2c_4ec47a80-581c-486c-bde9-47fd0b41fcad/kube-auth-proxy/0.log" May 21 14:39:03.672152 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:03.672117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4mldb_764a2c35-44d7-4a1a-905a-5818b012f2ae/serve-healthcheck-canary/0.log" May 21 14:39:04.536258 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:04.536226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95crj_e1f9fdee-f420-4de2-b777-87fa5c6b5ded/kube-rbac-proxy/0.log" May 21 14:39:04.596111 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:04.596078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95crj_e1f9fdee-f420-4de2-b777-87fa5c6b5ded/exporter/0.log" May 21 14:39:04.677197 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:04.677164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95crj_e1f9fdee-f420-4de2-b777-87fa5c6b5ded/extractor/0.log" May 21 14:39:05.118432 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:05.118405 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-qt8q4" May 21 14:39:07.359940 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:07.359855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656215-rkl7x_b1751636-74c7-4b35-936b-08dc26bd7092/cleanup/0.log" May 21 14:39:07.879027 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:07.878996 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd478c6-zdwjk_fcdeefe8-4026-4d18-aa0f-c2eb96f21ed1/manager/0.log" May 21 14:39:09.452028 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:09.451998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7454667d6f-rlgbn_a05977a5-dd7e-4879-909d-8721e3b61b60/manager/0.log" May 21 14:39:14.418068 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:14.418035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xjwwt_9fd8942d-221e-4e04-bf42-2d35af98049e/migrator/0.log" May 21 14:39:14.437980 ip-10-0-139-85 kubenswrapper[2559]: I0521 14:39:14.437949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xjwwt_9fd8942d-221e-4e04-bf42-2d35af98049e/graceful-termination/0.log"