May 29 10:09:14.691953 ip-10-0-134-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 29 10:09:14.691966 ip-10-0-134-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 29 10:09:14.691975 ip-10-0-134-110 systemd[1]: kubelet.service: Failed with result 'resources'. May 29 10:09:14.692219 ip-10-0-134-110 systemd[1]: Failed to start Kubernetes Kubelet. May 29 10:09:24.835079 ip-10-0-134-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 29 10:09:24.835094 ip-10-0-134-110 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2ed7cdaf96464556b12cd0131773131b -- May 29 10:11:48.158621 ip-10-0-134-110 systemd[1]: Starting Kubernetes Kubelet... May 29 10:11:48.648590 ip-10-0-134-110 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:11:48.648590 ip-10-0-134-110 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 10:11:48.648590 ip-10-0-134-110 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:11:48.648590 ip-10-0-134-110 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 10:11:48.648590 ip-10-0-134-110 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 10:11:48.651333 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.651239 2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 10:11:48.655150 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655135 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:11:48.655150 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655150 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655153 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655158 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655161 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655164 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655167 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655170 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655173 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655178 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655182 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655185 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655188 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655191 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655194 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655201 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655204 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655207 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655209 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655212 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655215 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:11:48.655211 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655218 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655220 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655223 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655226 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655228 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655231 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655233 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655236 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655238 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655241 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655243 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655245 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655249 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655253 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655256 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655260 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655263 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655266 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655268 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:11:48.655699 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655271 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655273 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655276 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655278 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655280 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655283 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655285 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655287 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655290 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655292 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655295 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655297 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655299 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655302 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655305 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655308 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655310 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655313 2552 feature_gate.go:328] unrecognized feature gate: Example May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655315 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:11:48.656149 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655318 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655333 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655336 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655339 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655341 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655344 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655346 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655350 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655353 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655355 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655358 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655361 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655363 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655365 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655368 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655371 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655373 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655375 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655378 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655380 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:11:48.656706 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655383 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655386 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655388 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655391 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655394 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655396 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.655399 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656345 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656353 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656357 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656360 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656363 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656366 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656369 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656372 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656374 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656377 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656380 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656382 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:11:48.657175 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656386 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656388 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656391 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656395 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656399 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656402 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656405 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656408 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656410 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656413 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656416 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656419 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656422 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656424 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656426 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656429 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656432 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656434 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656437 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:11:48.657652 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656440 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656442 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656445 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656447 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656450 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656453 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656455 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656458 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656463 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656467 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656469 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656472 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656474 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656477 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656479 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656482 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656484 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656487 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656489 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:11:48.658119 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656491 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656494 2552 feature_gate.go:328] unrecognized feature gate: Example May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656496 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656499 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656501 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656504 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656506 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656509 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656511 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656514 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656516 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656519 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656522 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656524 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656527 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656529 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656532 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656535 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656538 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656540 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:11:48.658610 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656542 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656545 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656547 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656550 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656552 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656555 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656557 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656559 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656562 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656565 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656567 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656569 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656572 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656575 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656577 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.656580 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656655 2552 flags.go:64] FLAG: --address="0.0.0.0" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656662 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656668 2552 flags.go:64] FLAG: --anonymous-auth="true" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656673 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656678 2552 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656681 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 10:11:48.659092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656685 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656689 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656692 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656695 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656699 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656702 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656705 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656708 2552 flags.go:64] FLAG: --cgroup-root="" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656711 2552 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656714 2552 flags.go:64] FLAG: --client-ca-file="" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656717 2552 flags.go:64] FLAG: --cloud-config="" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656720 2552 flags.go:64] FLAG: --cloud-provider="external" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656723 2552 flags.go:64] FLAG: --cluster-dns="[]" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656728 2552 flags.go:64] FLAG: --cluster-domain="" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656731 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656734 2552 flags.go:64] FLAG: --config-dir="" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656737 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656740 2552 flags.go:64] FLAG: --container-log-max-files="5" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656744 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656747 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656750 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656754 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656757 2552 flags.go:64] FLAG: --contention-profiling="false" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656762 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 10:11:48.659656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656765 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656768 2552 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656771 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656775 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656777 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656780 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656783 2552 flags.go:64] FLAG: --enable-load-reader="false" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656786 2552 flags.go:64] FLAG: --enable-server="true" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656789 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656793 2552 flags.go:64] FLAG: --event-burst="100" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656796 2552 flags.go:64] FLAG: --event-qps="50" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656799 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656802 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656805 2552 flags.go:64] FLAG: --eviction-hard="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656808 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656811 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656814 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656817 2552 flags.go:64] FLAG: --eviction-soft="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656819 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656823 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656826 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656829 2552 flags.go:64] FLAG: --experimental-mounter-path="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656832 2552 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656834 2552 flags.go:64] FLAG: --fail-swap-on="true" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656837 2552 flags.go:64] FLAG: --feature-gates="" May 29 10:11:48.660243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656841 2552 flags.go:64] FLAG: --file-check-frequency="20s" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656844 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656847 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656850 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656854 2552 flags.go:64] FLAG: --healthz-port="10248" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656857 2552 flags.go:64] FLAG: --help="false" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656861 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-134-110.ec2.internal" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656864 2552 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656867 2552 flags.go:64] FLAG: --http-check-frequency="20s" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656870 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656873 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656876 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656879 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656882 2552 flags.go:64] FLAG: --image-service-endpoint="" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656884 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656887 2552 flags.go:64] FLAG: --kube-api-burst="100" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656890 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656893 2552 flags.go:64] FLAG: --kube-api-qps="50" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656896 2552 flags.go:64] FLAG: --kube-reserved="" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656898 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656901 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656904 2552 flags.go:64] FLAG: --kubelet-cgroups="" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656907 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656909 2552 flags.go:64] FLAG: --lock-file="" May 29 10:11:48.660844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656912 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656915 2552 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656919 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656925 2552 flags.go:64] FLAG: --log-json-split-stream="false" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656927 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656930 2552 flags.go:64] FLAG: --log-text-split-stream="false" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656933 2552 flags.go:64] FLAG: --logging-format="text" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656936 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656940 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656942 2552 flags.go:64] FLAG: --manifest-url="" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656945 2552 flags.go:64] FLAG: --manifest-url-header="" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656949 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656952 2552 flags.go:64] FLAG: --max-open-files="1000000" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656957 2552 flags.go:64] FLAG: --max-pods="110" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656961 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656964 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656967 2552 flags.go:64] FLAG: --memory-manager-policy="None" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656970 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656973 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656975 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656978 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656985 2552 flags.go:64] FLAG: --node-status-max-images="50" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656988 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656991 2552 flags.go:64] FLAG: --oom-score-adj="-999" May 29 10:11:48.661457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656994 2552 flags.go:64] FLAG: --pod-cidr="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.656997 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657003 2552 flags.go:64] FLAG: --pod-manifest-path="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657005 2552 flags.go:64] FLAG: --pod-max-pids="-1" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657009 2552 flags.go:64] FLAG: --pods-per-core="0" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657011 2552 flags.go:64] FLAG: --port="10250" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657014 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657017 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f0fb8cd2fd8ac7af" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657020 2552 flags.go:64] FLAG: --qos-reserved="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657023 2552 flags.go:64] FLAG: --read-only-port="10255" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657027 2552 flags.go:64] FLAG: --register-node="true" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657030 2552 flags.go:64] FLAG: --register-schedulable="true" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657033 2552 flags.go:64] FLAG: --register-with-taints="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657036 2552 flags.go:64] FLAG: --registry-burst="10" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657039 2552 flags.go:64] FLAG: --registry-qps="5" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657042 2552 flags.go:64] FLAG: --reserved-cpus="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657044 2552 flags.go:64] FLAG: --reserved-memory="" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657051 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657054 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657057 2552 flags.go:64] FLAG: --rotate-certificates="false" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657060 2552 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657063 2552 flags.go:64] FLAG: --runonce="false" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657066 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657070 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657080 2552 flags.go:64] FLAG: --seccomp-default="false" May 29 10:11:48.662011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657083 2552 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657086 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657089 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657092 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657095 2552 flags.go:64] FLAG: --storage-driver-password="root" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657098 2552 flags.go:64] FLAG: --storage-driver-secure="false" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657101 2552 flags.go:64] FLAG: --storage-driver-table="stats" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657104 2552 flags.go:64] FLAG: --storage-driver-user="root" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657107 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657109 2552 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657112 2552 flags.go:64] FLAG: --system-cgroups="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657115 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657120 2552 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657123 2552 flags.go:64] FLAG: --tls-cert-file="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657125 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657130 2552 flags.go:64] FLAG: --tls-min-version="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657132 2552 flags.go:64] FLAG: --tls-private-key-file="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657138 2552 flags.go:64] FLAG: --topology-manager-policy="none" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657140 2552 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657143 2552 flags.go:64] FLAG: --topology-manager-scope="container" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657146 2552 flags.go:64] FLAG: --v="2" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657150 2552 flags.go:64] FLAG: --version="false" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657154 2552 flags.go:64] FLAG: --vmodule="" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657158 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657161 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 10:11:48.662648 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657276 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657279 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657283 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657285 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657289 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657293 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657296 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657298 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657302 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657305 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657308 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657310 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657313 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657315 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657331 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657336 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657338 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657341 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657344 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:11:48.663254 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657346 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657348 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657351 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657354 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657356 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657360 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657362 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657365 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657367 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657370 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657372 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657375 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657377 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657379 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657382 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657384 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657387 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657389 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657393 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657396 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:11:48.663724 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657399 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657401 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657404 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657406 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657409 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657411 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657413 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657416 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657418 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657420 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657423 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657426 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657428 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657431 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657433 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657435 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657438 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657441 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657443 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657446 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:11:48.664242 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657448 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657451 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657453 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657455 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657458 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657460 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657462 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657465 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657467 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657470 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657474 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657476 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657479 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657481 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657484 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657486 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657489 2552 feature_gate.go:328] unrecognized feature gate: Example May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657491 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657494 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:11:48.664735 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657497 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657501 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657504 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657506 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657509 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657511 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657514 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.657516 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.657521 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.664361 2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.664465 2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664517 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664521 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664524 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664528 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664531 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:11:48.665195 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664534 2552 feature_gate.go:328] unrecognized feature gate: Example May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664537 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664539 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664544 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664548 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664551 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664554 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664557 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664560 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664563 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664566 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664570 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664574 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664577 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664580 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664583 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664585 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664589 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664591 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:11:48.665616 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664594 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664596 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664599 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664601 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664604 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664606 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664609 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664612 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664615 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664617 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664620 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664622 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664625 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664627 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664630 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664632 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664635 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664637 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664640 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:11:48.666066 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664642 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664645 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664647 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664656 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664659 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664661 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664664 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664666 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664669 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664671 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664673 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664676 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664678 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664681 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664683 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664685 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664688 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664691 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664693 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664695 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:11:48.666550 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664699 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664701 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664704 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664706 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664709 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664711 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664714 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664716 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664719 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664721 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664723 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664726 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664728 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664731 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664733 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664736 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664744 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664747 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664749 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664752 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:11:48.667023 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664755 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664757 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664760 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.664765 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664893 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664897 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664900 2552 feature_gate.go:328] unrecognized feature gate: Example May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664903 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664906 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664908 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664911 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664913 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664916 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664919 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664922 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664924 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 10:11:48.667528 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664927 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664929 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664932 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664934 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664937 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664939 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664942 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664944 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664946 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664949 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664951 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664954 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664957 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664967 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664969 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664972 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664974 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664976 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664979 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 10:11:48.667936 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664981 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664984 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664986 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664988 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664990 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664993 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664995 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.664998 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665000 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665003 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665005 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665008 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665011 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665013 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665016 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665018 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665021 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665023 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665026 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665028 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 10:11:48.668428 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665030 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665033 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665035 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665038 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665040 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665043 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665045 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665053 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665056 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665058 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665061 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665063 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665065 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665068 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665070 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665072 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665075 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665078 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665080 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665082 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 10:11:48.668905 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665090 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665093 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665096 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665098 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665101 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665103 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665107 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665111 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665113 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665116 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665119 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665121 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665124 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665126 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:48.665129 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 10:11:48.669421 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.665133 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 10:11:48.669792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.666112 2552 server.go:962] "Client rotation is on, will bootstrap in background" May 29 10:11:48.669792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.668144 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 10:11:48.669792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.669232 2552 server.go:1019] "Starting client certificate rotation" May 29 10:11:48.669792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.669350 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 10:11:48.670262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.670247 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 10:11:48.696722 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.696703 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 10:11:48.701716 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.701692 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 10:11:48.724542 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.724520 2552 log.go:25] "Validated CRI v1 runtime API" May 29 10:11:48.729430 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.729410 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 10:11:48.730672 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.730656 2552 log.go:25] "Validated CRI v1 image API" May 29 10:11:48.731918 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.731902 2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 10:11:48.738161 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.738141 2552 fs.go:135] Filesystem UUIDs: map[0a4e1c8e-b1ff-4c29-83e3-64b2297edb73:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8b70e143-97dc-4f3c-b1eb-c9f6e7252fc1:/dev/nvme0n1p4] May 29 10:11:48.738230 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.738160 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 10:11:48.742538 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.742435 2552 manager.go:217] Machine: {Timestamp:2026-05-29 10:11:48.7419269 +0000 UTC m=+0.453083076 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131053 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2edbae26206a93b538712a1952aa2b SystemUUID:ec2edbae-2620-6a93-b538-712a1952aa2b BootID:2ed7cdaf-9646-4556-b12c-d0131773131b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dc:d7:11:83:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dc:d7:11:83:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:83:c5:97:92:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 10:11:48.743178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.743167 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 10:11:48.743270 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.743258 2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 10:11:48.745679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745653 2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 10:11:48.745859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745682 2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 10:11:48.745940 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745868 2552 topology_manager.go:138] "Creating topology manager with none policy" May 29 10:11:48.745940 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745882 2552 container_manager_linux.go:306] "Creating device plugin manager" May 29 10:11:48.745940 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745892 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 10:11:48.745940 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.745918 2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 10:11:48.747280 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.747266 2552 state_mem.go:36] "Initialized new in-memory state store" May 29 10:11:48.747438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.747427 2552 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 10:11:48.748067 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.748050 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27d4r" May 29 10:11:48.750380 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.750367 2552 kubelet.go:491] "Attempting to sync node with API server" May 29 10:11:48.750436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.750387 2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 10:11:48.750436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.750403 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 10:11:48.750436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.750417 2552 kubelet.go:397] "Adding apiserver pod source" May 29 10:11:48.750436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.750430 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 10:11:48.751737 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.751722 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 10:11:48.751812 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.751748 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 10:11:48.756524 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.756509 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27d4r" May 29 10:11:48.765933 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.765904 2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 10:11:48.769992 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.769977 2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 10:11:48.771347 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771334 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771358 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771369 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771376 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771384 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771389 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771395 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 10:11:48.771400 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771400 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 10:11:48.771578 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771407 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 10:11:48.771578 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771413 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 10:11:48.771578 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771421 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 10:11:48.771659 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.771602 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 10:11:48.772584 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.772573 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 10:11:48.772616 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.772585 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 10:11:48.772805 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.772788 2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:48.774026 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.774009 2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:48.775910 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.775897 2552 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 10:11:48.775970 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.775931 2552 server.go:1295] "Started kubelet" May 29 10:11:48.776048 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.775995 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 10:11:48.776048 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.776015 2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 10:11:48.776139 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.776074 2552 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 10:11:48.776840 ip-10-0-134-110 systemd[1]: Started Kubernetes Kubelet. May 29 10:11:48.778043 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.778031 2552 server.go:317] "Adding debug handlers to kubelet server" May 29 10:11:48.778638 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.778622 2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 10:11:48.779540 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.779525 2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-110.ec2.internal" not found May 29 10:11:48.784603 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.784579 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 10:11:48.784697 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.784686 2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 10:11:48.785568 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785476 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 10:11:48.785648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785596 2552 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 10:11:48.785648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785608 2552 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 10:11:48.785749 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785720 2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 10:11:48.785959 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785780 2552 reconstruct.go:97] "Volume reconstruction finished" May 29 10:11:48.785959 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.785788 2552 reconciler.go:26] "Reconciler: start to sync state" May 29 10:11:48.786426 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786413 2552 factory.go:153] Registering CRI-O factory May 29 10:11:48.786497 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786429 2552 factory.go:223] Registration of the crio container factory successfully May 29 10:11:48.786497 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786481 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 10:11:48.786497 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786490 2552 factory.go:55] Registering systemd factory May 29 10:11:48.786497 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786497 2552 factory.go:223] Registration of the systemd container factory successfully May 29 10:11:48.786664 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786512 2552 factory.go:103] Registering Raw factory May 29 10:11:48.786664 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.786530 2552 manager.go:1196] Started watching for new ooms in manager May 29 10:11:48.786777 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.786754 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-110.ec2.internal\" not found" May 29 10:11:48.787438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.787424 2552 manager.go:319] Starting recovery of all containers May 29 10:11:48.788297 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.788147 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:48.790018 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.789993 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-110.ec2.internal\" not found" node="ip-10-0-134-110.ec2.internal" May 29 10:11:48.794990 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.794970 2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-110.ec2.internal" not found May 29 10:11:48.799278 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.799263 2552 manager.go:324] Recovery completed May 29 10:11:48.803077 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.803065 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:11:48.808792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.808777 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasSufficientMemory" May 29 10:11:48.808859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.808805 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:11:48.808859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.808816 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasSufficientPID" May 29 10:11:48.809311 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.809296 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 10:11:48.809311 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.809309 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 10:11:48.809414 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.809356 2552 state_mem.go:36] "Initialized new in-memory state store" May 29 10:11:48.811809 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.811797 2552 policy_none.go:49] "None policy: Start" May 29 10:11:48.811856 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.811814 2552 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 10:11:48.811856 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.811833 2552 state_mem.go:35] "Initializing new in-memory state store" May 29 10:11:48.850888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.850875 2552 manager.go:341] "Starting Device Plugin manager" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.850944 2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.850958 2552 server.go:85] "Starting device plugin registration server" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.851198 2552 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.851210 2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.851297 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.851388 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.851395 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.852168 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.852208 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-110.ec2.internal\" not found" May 29 10:11:48.863051 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.853122 2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-110.ec2.internal" not found May 29 10:11:48.925694 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.925653 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 10:11:48.926912 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.926894 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 10:11:48.926912 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.926918 2552 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 10:11:48.927059 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.926938 2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 10:11:48.927059 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.926945 2552 kubelet.go:2451] "Starting kubelet main sync loop" May 29 10:11:48.927059 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:48.927041 2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 10:11:48.929186 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.929161 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:48.951973 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.951943 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 10:11:48.952758 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.952742 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasSufficientMemory" May 29 10:11:48.952849 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.952776 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasNoDiskPressure" May 29 10:11:48.952849 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.952791 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeHasSufficientPID" May 29 10:11:48.952849 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.952823 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-110.ec2.internal" May 29 10:11:48.961318 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:48.961302 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-110.ec2.internal" May 29 10:11:49.027972 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.027937 2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal"] May 29 10:11:49.030162 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.030143 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.030250 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.030151 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.055850 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.055830 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.060115 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.060102 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.069923 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.069904 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 10:11:49.074200 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.074184 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 10:11:49.087374 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.087311 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.087374 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.087359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.087469 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.087402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7acdff2164b2d1cf2de96438f0aba288-config\") pod \"kube-apiserver-proxy-ip-10-0-134-110.ec2.internal\" (UID: \"7acdff2164b2d1cf2de96438f0aba288\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187728 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187700 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187738 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187755 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7acdff2164b2d1cf2de96438f0aba288-config\") pod \"kube-apiserver-proxy-ip-10-0-134-110.ec2.internal\" (UID: \"7acdff2164b2d1cf2de96438f0aba288\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187790 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187796 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe1e58750835e290df3b23a1943b552c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal\" (UID: \"fe1e58750835e290df3b23a1943b552c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.187859 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.187836 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7acdff2164b2d1cf2de96438f0aba288-config\") pod \"kube-apiserver-proxy-ip-10-0-134-110.ec2.internal\" (UID: \"7acdff2164b2d1cf2de96438f0aba288\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.374080 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.373994 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" May 29 10:11:49.376745 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.376728 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" May 29 10:11:49.668925 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.668833 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 10:11:49.669667 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.669042 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 10:11:49.669667 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.669044 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 10:11:49.669667 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.669044 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 10:11:49.750806 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.750770 2552 apiserver.go:52] "Watching apiserver" May 29 10:11:49.758724 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.758678 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 10:06:48 +0000 UTC" deadline="2027-12-30 11:22:52.164467598 +0000 UTC" May 29 10:11:49.758724 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.758720 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13921h11m2.405750169s" May 29 10:11:49.760494 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.760468 2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 10:11:49.760820 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.760797 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-nm424","openshift-multus/multus-additional-cni-plugins-sq6mz","openshift-multus/multus-jjrgp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7","openshift-image-registry/node-ca-tl92t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal","openshift-multus/network-metrics-daemon-4q98t","openshift-network-diagnostics/network-check-target-wl72q","openshift-network-operator/iptables-alerter-svjwr","openshift-ovn-kubernetes/ovnkube-node-7bbjr","kube-system/konnectivity-agent-8qk74","kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal","openshift-cluster-node-tuning-operator/tuned-d2zbw"] May 29 10:11:49.762399 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.762378 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.763958 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.763934 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.764907 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.764873 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 10:11:49.764907 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.764884 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 10:11:49.765066 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.764906 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 10:11:49.765066 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.764904 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 10:11:49.765066 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.764886 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 10:11:49.765211 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.765099 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 10:11:49.765211 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.765199 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5fc6w\"" May 29 10:11:49.765406 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.765388 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.766221 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.766201 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 10:11:49.766438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.766423 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 10:11:49.766611 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.766596 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k2hcf\"" May 29 10:11:49.766679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.766606 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 10:11:49.766679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.766658 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.767291 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.767268 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 10:11:49.767416 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.767342 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vhz7w\"" May 29 10:11:49.767416 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.767353 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 10:11:49.767528 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.767414 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 10:11:49.768092 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.768074 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dp7kg\"" May 29 10:11:49.768373 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.768357 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.768454 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.768386 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 10:11:49.768823 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.768806 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 10:11:49.769863 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.769586 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjrgp" May 29 10:11:49.770804 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.770768 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.770924 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.770840 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:11:49.771139 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771124 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dsj9w\"" May 29 10:11:49.771196 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771158 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 10:11:49.771196 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771182 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 10:11:49.771196 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771129 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 10:11:49.771375 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771246 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 10:11:49.771375 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771281 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 10:11:49.771506 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771483 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 10:11:49.771564 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771523 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fs4mh\"" May 29 10:11:49.771956 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.771938 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:49.772024 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.772006 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:49.773011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.772995 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.774017 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.774001 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.774734 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.774718 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 10:11:49.774862 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.774777 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 10:11:49.774963 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.774949 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.775083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.775071 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f7lh5\"" May 29 10:11:49.775969 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.775663 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 10:11:49.775969 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.775739 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 10:11:49.775969 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.775938 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hcm7n\"" May 29 10:11:49.776217 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.776199 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 10:11:49.776692 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.776674 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w79lp\"" May 29 10:11:49.776944 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.776928 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 10:11:49.777165 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.777148 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 10:11:49.785216 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.785195 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 10:11:49.786933 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.786917 2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 10:11:49.790665 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-daemon-config\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.790760 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.790760 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790689 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-log-socket\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.790760 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790708 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-env-overrides\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790765 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0b0406-7885-4472-8a63-95f9bea8e0a3-serviceca\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790788 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-sys\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-kubelet\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790835 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-lib-modules\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-tmp\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fdc5e8e-d550-498d-8cfb-13774dd48c60-agent-certs\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.790906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-netns\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790914 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-slash\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790931 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-etc-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790951 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cnibin\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790972 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.790986 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-modprobe-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-registration-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791022 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-sys-fs\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-bin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0b0406-7885-4472-8a63-95f9bea8e0a3-host\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vnb\" (UniqueName: \"kubernetes.io/projected/8814337b-dbb2-4850-8e73-cd1bed592e5c-kube-api-access-x9vnb\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791113 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-run\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.791138 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791139 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-etc-selinux\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6dc\" (UniqueName: \"kubernetes.io/projected/8b44b3b3-766c-4a53-9177-3bfd17795d16-kube-api-access-4n6dc\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791186 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-device-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791200 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjbf\" (UniqueName: \"kubernetes.io/projected/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-kube-api-access-wkjbf\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-netns\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791248 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8rh\" (UniqueName: \"kubernetes.io/projected/5dc796ea-a9da-4d75-8f1e-3174cac39fab-kube-api-access-hx8rh\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791362 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814337b-dbb2-4850-8e73-cd1bed592e5c-hosts-file\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791396 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fdc5e8e-d550-498d-8cfb-13774dd48c60-konnectivity-ca\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791428 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2rk\" (UniqueName: \"kubernetes.io/projected/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-kube-api-access-br2rk\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791452 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-var-lib-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-script-lib\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791504 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9kgx\" (UniqueName: \"kubernetes.io/projected/ba685009-27d7-43d0-875d-da65245e4a60-kube-api-access-v9kgx\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-system-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-bin\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.791787 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-os-release\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791607 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-ovn\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791623 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btsd\" (UniqueName: \"kubernetes.io/projected/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-kube-api-access-6btsd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-cnibin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791658 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-os-release\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791671 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-host-slash\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791684 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-systemd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791698 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791713 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-conf-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791752 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-multus-certs\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-kubelet\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791813 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-iptables-alerter-script\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791841 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-systemd-units\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791864 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-node-log\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovn-node-metrics-cert\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.792688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791910 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-system-cni-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791957 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-hostroot\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.791983 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814337b-dbb2-4850-8e73-cd1bed592e5c-tmp-dir\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysconfig\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-systemd\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792088 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-host\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792150 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjsbw\" (UniqueName: \"kubernetes.io/projected/6a7d7a81-082c-4f53-a189-335e829c7563-kube-api-access-gjsbw\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792175 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-multus\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792196 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-etc-kubernetes\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792221 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-config\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792244 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-conf\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-var-lib-kubelet\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792291 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-socket-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792335 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-cni-binary-copy\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-netd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792404 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-socket-dir-parent\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792448 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-k8s-cni-cncf-io\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792474 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lg96\" (UniqueName: \"kubernetes.io/projected/fd0b0406-7885-4472-8a63-95f9bea8e0a3-kube-api-access-7lg96\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792548 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792578 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-kubernetes\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.793662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.792596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-etc-tuned\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.797483 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.797463 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 10:11:49.842693 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:49.842519 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1e58750835e290df3b23a1943b552c.slice/crio-fb5bf19a2361ecc7a7cbae0ea00fa3a96c545110f7334620b925e42d3b09eb61 WatchSource:0}: Error finding container fb5bf19a2361ecc7a7cbae0ea00fa3a96c545110f7334620b925e42d3b09eb61: Status 404 returned error can't find the container with id fb5bf19a2361ecc7a7cbae0ea00fa3a96c545110f7334620b925e42d3b09eb61 May 29 10:11:49.842876 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:49.842861 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acdff2164b2d1cf2de96438f0aba288.slice/crio-a582ff7bf30f9fc2f1e4763d75d13e6de04d7ed9b97f38462eea3072dea9acfa WatchSource:0}: Error finding container a582ff7bf30f9fc2f1e4763d75d13e6de04d7ed9b97f38462eea3072dea9acfa: Status 404 returned error can't find the container with id a582ff7bf30f9fc2f1e4763d75d13e6de04d7ed9b97f38462eea3072dea9acfa May 29 10:11:49.846273 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.846257 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:11:49.851502 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.851478 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ssm2h" May 29 10:11:49.858681 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.858663 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ssm2h" May 29 10:11:49.892856 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892831 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0b0406-7885-4472-8a63-95f9bea8e0a3-host\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.892949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892860 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vnb\" (UniqueName: \"kubernetes.io/projected/8814337b-dbb2-4850-8e73-cd1bed592e5c-kube-api-access-x9vnb\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.892949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892876 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-run\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.892949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892899 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-etc-selinux\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.892949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892922 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6dc\" (UniqueName: \"kubernetes.io/projected/8b44b3b3-766c-4a53-9177-3bfd17795d16-kube-api-access-4n6dc\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.892949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892944 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-device-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892968 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjbf\" (UniqueName: \"kubernetes.io/projected/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-kube-api-access-wkjbf\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0b0406-7885-4472-8a63-95f9bea8e0a3-host\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892992 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893010 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-device-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893007 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-etc-selinux\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.892966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-run\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893015 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-netns\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893071 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-netns\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893074 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893105 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8rh\" (UniqueName: \"kubernetes.io/projected/5dc796ea-a9da-4d75-8f1e-3174cac39fab-kube-api-access-hx8rh\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893130 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814337b-dbb2-4850-8e73-cd1bed592e5c-hosts-file\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893132 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893154 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fdc5e8e-d550-498d-8cfb-13774dd48c60-konnectivity-ca\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893176 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814337b-dbb2-4850-8e73-cd1bed592e5c-hosts-file\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.893187 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893179 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br2rk\" (UniqueName: \"kubernetes.io/projected/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-kube-api-access-br2rk\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893204 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-var-lib-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893232 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-script-lib\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893257 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9kgx\" (UniqueName: \"kubernetes.io/projected/ba685009-27d7-43d0-875d-da65245e4a60-kube-api-access-v9kgx\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893281 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-system-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893305 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-bin\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893280 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-var-lib-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893352 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-os-release\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893403 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-ovn\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893425 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-system-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-bin\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893436 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6btsd\" (UniqueName: \"kubernetes.io/projected/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-kube-api-access-6btsd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-ovn\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893468 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-cnibin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893409 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-os-release\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893492 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-os-release\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893516 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-host-slash\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893523 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-cnibin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.893879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893538 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-systemd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893561 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-host-slash\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893564 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-os-release\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893562 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893592 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893601 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-run-systemd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893608 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893637 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-conf-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893661 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-multus-certs\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893684 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-kubelet\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893698 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-multus-certs\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-conf-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893707 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-iptables-alerter-script\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893732 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-systemd-units\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893758 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-node-log\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893765 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-systemd-units\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-kubelet\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.894634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893785 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovn-node-metrics-cert\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893811 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-system-cni-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893833 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-hostroot\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893838 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-script-lib\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fdc5e8e-d550-498d-8cfb-13774dd48c60-konnectivity-ca\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893812 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-node-log\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893854 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893918 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814337b-dbb2-4850-8e73-cd1bed592e5c-tmp-dir\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-hostroot\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893950 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysconfig\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.893991 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-systemd\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-system-cni-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysconfig\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894087 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-host\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894112 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-systemd\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894114 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894110 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.895397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894161 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjsbw\" (UniqueName: \"kubernetes.io/projected/6a7d7a81-082c-4f53-a189-335e829c7563-kube-api-access-gjsbw\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894155 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-host\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-multus\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894227 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-etc-kubernetes\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894231 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-multus\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894252 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-config\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894261 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814337b-dbb2-4850-8e73-cd1bed592e5c-tmp-dir\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894273 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-etc-kubernetes\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894277 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-conf\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894301 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-var-lib-kubelet\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894342 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-socket-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-iptables-alerter-script\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894368 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-cni-binary-copy\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894389 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-netd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894413 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894423 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-var-lib-kubelet\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894440 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894451 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-conf\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894466 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-socket-dir-parent\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-cni-netd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894490 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-socket-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-cni-dir\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894525 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-k8s-cni-cncf-io\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894537 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-socket-dir-parent\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lg96\" (UniqueName: \"kubernetes.io/projected/fd0b0406-7885-4472-8a63-95f9bea8e0a3-kube-api-access-7lg96\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894569 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-sysctl-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894574 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894576 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-k8s-cni-cncf-io\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894700 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-kubernetes\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894749 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-etc-tuned\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894755 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovnkube-config\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894779 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-kubernetes\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894779 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-daemon-config\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894822 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894858 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-log-socket\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894878 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-cni-binary-copy\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894882 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-env-overrides\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894904 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0b0406-7885-4472-8a63-95f9bea8e0a3-serviceca\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894928 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-sys\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894952 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-kubelet\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894975 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-lib-modules\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894999 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-tmp\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895020 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fdc5e8e-d550-498d-8cfb-13774dd48c60-agent-certs\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895042 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-netns\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895058 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895068 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-slash\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895092 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-etc-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895117 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cnibin\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895144 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895164 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-lib-modules\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895168 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-modprobe-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.896981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895208 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-registration-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895233 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-sys-fs\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895245 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-etc-modprobe-d\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895257 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-bin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-env-overrides\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895282 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0b0406-7885-4472-8a63-95f9bea8e0a3-serviceca\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895316 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-slash\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.894928 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-log-socket\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895302 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b44b3b3-766c-4a53-9177-3bfd17795d16-multus-daemon-config\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.894930 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895377 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895387 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-etc-openvswitch\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895434 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-var-lib-cni-bin\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-registration-dir\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.895447 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:11:50.395412944 +0000 UTC m=+2.106569096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b44b3b3-766c-4a53-9177-3bfd17795d16-host-run-netns\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.897461 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895473 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-cnibin\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a7d7a81-082c-4f53-a189-335e829c7563-sys-fs\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba685009-27d7-43d0-875d-da65245e4a60-sys\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895599 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dc796ea-a9da-4d75-8f1e-3174cac39fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.895704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-host-kubelet\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.897732 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-etc-tuned\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.897831 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-ovn-node-metrics-cert\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.897936 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.897853 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba685009-27d7-43d0-875d-da65245e4a60-tmp\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.898148 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.898021 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fdc5e8e-d550-498d-8cfb-13774dd48c60-agent-certs\") pod \"konnectivity-agent-8qk74\" (UID: \"4fdc5e8e-d550-498d-8cfb-13774dd48c60\") " pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:49.899159 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.899129 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:11:49.899159 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.899150 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:11:49.899159 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.899163 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:49.899501 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:49.899220 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:11:50.399203249 +0000 UTC m=+2.110359424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:49.901984 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.901669 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2rk\" (UniqueName: \"kubernetes.io/projected/d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae-kube-api-access-br2rk\") pod \"iptables-alerter-svjwr\" (UID: \"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae\") " pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:49.901984 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.901716 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjbf\" (UniqueName: \"kubernetes.io/projected/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-kube-api-access-wkjbf\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:49.901984 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.901775 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btsd\" (UniqueName: \"kubernetes.io/projected/4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6-kube-api-access-6btsd\") pod \"ovnkube-node-7bbjr\" (UID: \"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:49.901984 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.901829 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8rh\" (UniqueName: \"kubernetes.io/projected/5dc796ea-a9da-4d75-8f1e-3174cac39fab-kube-api-access-hx8rh\") pod \"multus-additional-cni-plugins-sq6mz\" (UID: \"5dc796ea-a9da-4d75-8f1e-3174cac39fab\") " pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:49.902301 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.902277 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9kgx\" (UniqueName: \"kubernetes.io/projected/ba685009-27d7-43d0-875d-da65245e4a60-kube-api-access-v9kgx\") pod \"tuned-d2zbw\" (UID: \"ba685009-27d7-43d0-875d-da65245e4a60\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:49.902418 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.902304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjsbw\" (UniqueName: \"kubernetes.io/projected/6a7d7a81-082c-4f53-a189-335e829c7563-kube-api-access-gjsbw\") pod \"aws-ebs-csi-driver-node-sw8s7\" (UID: \"6a7d7a81-082c-4f53-a189-335e829c7563\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:49.903101 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.903080 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vnb\" (UniqueName: \"kubernetes.io/projected/8814337b-dbb2-4850-8e73-cd1bed592e5c-kube-api-access-x9vnb\") pod \"node-resolver-nm424\" (UID: \"8814337b-dbb2-4850-8e73-cd1bed592e5c\") " pod="openshift-dns/node-resolver-nm424" May 29 10:11:49.903506 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.903488 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6dc\" (UniqueName: \"kubernetes.io/projected/8b44b3b3-766c-4a53-9177-3bfd17795d16-kube-api-access-4n6dc\") pod \"multus-jjrgp\" (UID: \"8b44b3b3-766c-4a53-9177-3bfd17795d16\") " pod="openshift-multus/multus-jjrgp" May 29 10:11:49.903708 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.903693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lg96\" (UniqueName: \"kubernetes.io/projected/fd0b0406-7885-4472-8a63-95f9bea8e0a3-kube-api-access-7lg96\") pod \"node-ca-tl92t\" (UID: \"fd0b0406-7885-4472-8a63-95f9bea8e0a3\") " pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:49.930125 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.930037 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" event={"ID":"fe1e58750835e290df3b23a1943b552c","Type":"ContainerStarted","Data":"fb5bf19a2361ecc7a7cbae0ea00fa3a96c545110f7334620b925e42d3b09eb61"} May 29 10:11:49.930896 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:49.930870 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" event={"ID":"7acdff2164b2d1cf2de96438f0aba288","Type":"ContainerStarted","Data":"a582ff7bf30f9fc2f1e4763d75d13e6de04d7ed9b97f38462eea3072dea9acfa"} May 29 10:11:50.084688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.084666 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:11:50.091132 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.091106 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eedb6f8_ee72_40d8_9d3f_3a3845e9cbe6.slice/crio-84e1156d738d7a217b144bbc9dc34d60210ca1f0562dcaf952a744defbd852ab WatchSource:0}: Error finding container 84e1156d738d7a217b144bbc9dc34d60210ca1f0562dcaf952a744defbd852ab: Status 404 returned error can't find the container with id 84e1156d738d7a217b144bbc9dc34d60210ca1f0562dcaf952a744defbd852ab May 29 10:11:50.099746 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.099729 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" May 29 10:11:50.105760 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.105736 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7d7a81_082c_4f53_a189_335e829c7563.slice/crio-5e741cfe5f28f5164e163978c0f5eb14bddb1eb273129420ce9242cf5e932f8e WatchSource:0}: Error finding container 5e741cfe5f28f5164e163978c0f5eb14bddb1eb273129420ce9242cf5e932f8e: Status 404 returned error can't find the container with id 5e741cfe5f28f5164e163978c0f5eb14bddb1eb273129420ce9242cf5e932f8e May 29 10:11:50.113901 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.113887 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tl92t" May 29 10:11:50.120102 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.120077 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0b0406_7885_4472_8a63_95f9bea8e0a3.slice/crio-0cdbd3a3c606c6541ee4375b7147e68dee255cfb704087ecbaf115d105ef9c5b WatchSource:0}: Error finding container 0cdbd3a3c606c6541ee4375b7147e68dee255cfb704087ecbaf115d105ef9c5b: Status 404 returned error can't find the container with id 0cdbd3a3c606c6541ee4375b7147e68dee255cfb704087ecbaf115d105ef9c5b May 29 10:11:50.123587 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.123562 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qk74" May 29 10:11:50.128679 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.128660 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fdc5e8e_d550_498d_8cfb_13774dd48c60.slice/crio-645b79537498802891a924571691564f88ce234ef35ccdcc12c42753d6fe7034 WatchSource:0}: Error finding container 645b79537498802891a924571691564f88ce234ef35ccdcc12c42753d6fe7034: Status 404 returned error can't find the container with id 645b79537498802891a924571691564f88ce234ef35ccdcc12c42753d6fe7034 May 29 10:11:50.148642 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.148624 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" May 29 10:11:50.155359 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.155341 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjrgp" May 29 10:11:50.156419 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.156389 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc796ea_a9da_4d75_8f1e_3174cac39fab.slice/crio-a4609bd08f4371525a09a955c6b980ba174bd134426814b687665e19ceff1f82 WatchSource:0}: Error finding container a4609bd08f4371525a09a955c6b980ba174bd134426814b687665e19ceff1f82: Status 404 returned error can't find the container with id a4609bd08f4371525a09a955c6b980ba174bd134426814b687665e19ceff1f82 May 29 10:11:50.161421 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.161400 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svjwr" May 29 10:11:50.162131 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.162111 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b44b3b3_766c_4a53_9177_3bfd17795d16.slice/crio-1c8970814d7f34f05b322e022358d19f4ab6f48e9091619a19b6d781eb37e6d1 WatchSource:0}: Error finding container 1c8970814d7f34f05b322e022358d19f4ab6f48e9091619a19b6d781eb37e6d1: Status 404 returned error can't find the container with id 1c8970814d7f34f05b322e022358d19f4ab6f48e9091619a19b6d781eb37e6d1 May 29 10:11:50.166930 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.166906 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm424" May 29 10:11:50.167465 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.167444 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46dd1b9_0b38_4d3f_92f6_6e249d6b60ae.slice/crio-a6b06fe823a59289ad82341c2259d4a0fe5e98139485a7dd2ded5ef41900b294 WatchSource:0}: Error finding container a6b06fe823a59289ad82341c2259d4a0fe5e98139485a7dd2ded5ef41900b294: Status 404 returned error can't find the container with id a6b06fe823a59289ad82341c2259d4a0fe5e98139485a7dd2ded5ef41900b294 May 29 10:11:50.170616 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.170597 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" May 29 10:11:50.175506 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.175483 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8814337b_dbb2_4850_8e73_cd1bed592e5c.slice/crio-a9cc998dc8cceb12769187892b19fb1eecc886e5935a3d7cb41786a39f3dee0f WatchSource:0}: Error finding container a9cc998dc8cceb12769187892b19fb1eecc886e5935a3d7cb41786a39f3dee0f: Status 404 returned error can't find the container with id a9cc998dc8cceb12769187892b19fb1eecc886e5935a3d7cb41786a39f3dee0f May 29 10:11:50.177839 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:11:50.177815 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba685009_27d7_43d0_875d_da65245e4a60.slice/crio-9788963673c7eb1d62fc03c2299cee8e009eb6d2dd5e243c1afc098484772b15 WatchSource:0}: Error finding container 9788963673c7eb1d62fc03c2299cee8e009eb6d2dd5e243c1afc098484772b15: Status 404 returned error can't find the container with id 9788963673c7eb1d62fc03c2299cee8e009eb6d2dd5e243c1afc098484772b15 May 29 10:11:50.397964 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.397930 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:50.398134 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.398093 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:50.398198 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.398166 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:11:51.3981455 +0000 UTC m=+3.109301655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:50.498626 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.498549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:50.498774 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.498733 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:11:50.498774 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.498756 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:11:50.498774 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.498770 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:50.498924 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:50.498827 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:11:51.498812111 +0000 UTC m=+3.209968263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:50.860128 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.860025 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 10:06:49 +0000 UTC" deadline="2028-02-01 18:59:49.116623681 +0000 UTC" May 29 10:11:50.860128 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.860074 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14720h47m58.256553969s" May 29 10:11:50.949402 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.949341 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qk74" event={"ID":"4fdc5e8e-d550-498d-8cfb-13774dd48c60","Type":"ContainerStarted","Data":"645b79537498802891a924571691564f88ce234ef35ccdcc12c42753d6fe7034"} May 29 10:11:50.961719 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.961685 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tl92t" event={"ID":"fd0b0406-7885-4472-8a63-95f9bea8e0a3","Type":"ContainerStarted","Data":"0cdbd3a3c606c6541ee4375b7147e68dee255cfb704087ecbaf115d105ef9c5b"} May 29 10:11:50.970048 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.970010 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" event={"ID":"6a7d7a81-082c-4f53-a189-335e829c7563","Type":"ContainerStarted","Data":"5e741cfe5f28f5164e163978c0f5eb14bddb1eb273129420ce9242cf5e932f8e"} May 29 10:11:50.981532 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.981505 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm424" event={"ID":"8814337b-dbb2-4850-8e73-cd1bed592e5c","Type":"ContainerStarted","Data":"a9cc998dc8cceb12769187892b19fb1eecc886e5935a3d7cb41786a39f3dee0f"} May 29 10:11:50.983777 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.983735 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svjwr" event={"ID":"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae","Type":"ContainerStarted","Data":"a6b06fe823a59289ad82341c2259d4a0fe5e98139485a7dd2ded5ef41900b294"} May 29 10:11:50.987217 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:50.987166 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjrgp" event={"ID":"8b44b3b3-766c-4a53-9177-3bfd17795d16","Type":"ContainerStarted","Data":"1c8970814d7f34f05b322e022358d19f4ab6f48e9091619a19b6d781eb37e6d1"} May 29 10:11:51.006017 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.005956 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerStarted","Data":"a4609bd08f4371525a09a955c6b980ba174bd134426814b687665e19ceff1f82"} May 29 10:11:51.020376 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.020252 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"84e1156d738d7a217b144bbc9dc34d60210ca1f0562dcaf952a744defbd852ab"} May 29 10:11:51.022219 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.022175 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" event={"ID":"ba685009-27d7-43d0-875d-da65245e4a60","Type":"ContainerStarted","Data":"9788963673c7eb1d62fc03c2299cee8e009eb6d2dd5e243c1afc098484772b15"} May 29 10:11:51.038011 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.037710 2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:51.055425 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.055229 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:51.094483 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.094283 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 10:11:51.406866 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.406243 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:51.406866 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.406449 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:51.406866 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.406514 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:11:53.406494648 +0000 UTC m=+5.117650799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:51.507568 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.506923 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:51.507568 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.507119 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:11:51.507568 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.507139 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:11:51.507568 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.507152 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:51.507568 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.507209 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:11:53.507190048 +0000 UTC m=+5.218346203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:51.860539 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.860495 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 10:06:49 +0000 UTC" deadline="2027-10-30 23:14:13.00078157 +0000 UTC" May 29 10:11:51.860539 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.860536 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12469h2m21.140249882s" May 29 10:11:51.927482 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.927345 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:51.927646 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.927482 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:51.928538 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:51.927948 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:51.928538 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:51.928061 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:11:53.427197 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:53.426587 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:53.427197 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.426765 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:53.427197 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.426827 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:11:57.42680831 +0000 UTC m=+9.137964479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:53.527175 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:53.527131 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:53.527376 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.527281 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:11:53.527376 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.527296 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:11:53.527376 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.527305 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:53.527376 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.527367 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:11:57.52735032 +0000 UTC m=+9.238506477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:53.928390 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:53.927701 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:53.928390 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.927840 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:53.928390 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:53.928225 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:53.928390 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:53.928344 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:11:55.927593 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:55.927559 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:55.928052 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:55.927711 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:11:55.928052 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:55.927559 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:55.928167 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:55.928137 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:57.459428 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:57.459390 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:57.459858 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.459564 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:57.459858 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.459650 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:12:05.459626493 +0000 UTC m=+17.170782661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:11:57.560590 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:57.560552 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:57.560764 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.560720 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:11:57.560764 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.560734 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:11:57.560764 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.560745 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:57.560888 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.560795 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:12:05.560781986 +0000 UTC m=+17.271938138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:11:57.928164 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:57.928126 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:57.928348 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.928261 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:11:57.928348 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:57.928338 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:57.928445 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:57.928424 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:59.927900 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:59.927866 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:11:59.928309 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:59.927980 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:11:59.928386 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:11:59.927875 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:11:59.928448 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:11:59.928422 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:01.927982 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:01.927946 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:01.927982 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:01.927961 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:01.928465 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:01.928061 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:01.928465 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:01.928170 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:03.928391 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:03.927902 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:03.928391 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:03.927911 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:03.928391 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:03.928014 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:03.928391 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:03.928116 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:05.513928 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:05.513840 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:05.514422 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.513977 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:12:05.514422 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.514036 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:12:21.51402218 +0000 UTC m=+33.225178338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:12:05.614192 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:05.614150 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:05.614373 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.614355 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:12:05.614449 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.614379 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:12:05.614449 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.614393 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:12:05.614546 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.614454 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:12:21.614435102 +0000 UTC m=+33.325591268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:12:05.927334 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:05.927281 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:05.927496 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.927428 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:05.927558 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:05.927489 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:05.927617 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:05.927598 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:07.927129 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:07.927092 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:07.927694 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:07.927103 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:07.927694 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:07.927214 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:07.927694 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:07.927303 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:09.927616 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:09.927384 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:09.928304 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:09.927392 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:09.928304 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:09.927658 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:09.928304 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:09.927759 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:10.066801 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.066750 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" event={"ID":"ba685009-27d7-43d0-875d-da65245e4a60","Type":"ContainerStarted","Data":"bbd14177af6e98efadd27474f5bbcb15a9655cdae3d5e54e72efcf3bdaf2999e"} May 29 10:12:10.068070 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.068040 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qk74" event={"ID":"4fdc5e8e-d550-498d-8cfb-13774dd48c60","Type":"ContainerStarted","Data":"8b16a2b38ffa3e090df62a565511c5e9bb085d9a31790cf05751ffeeffab9317"} May 29 10:12:10.069455 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.069419 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tl92t" event={"ID":"fd0b0406-7885-4472-8a63-95f9bea8e0a3","Type":"ContainerStarted","Data":"4419ccd6bd962cbcb4bad609f011da2e873b8be3c5d41a163087a2ca065b3462"} May 29 10:12:10.071347 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.070675 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" event={"ID":"6a7d7a81-082c-4f53-a189-335e829c7563","Type":"ContainerStarted","Data":"89b5ba9e26188d6cd9ce18011c0543f8fd8b67889fbf58faa184438b93f00288"} May 29 10:12:10.072130 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.072102 2552 generic.go:358] "Generic (PLEG): container finished" podID="fe1e58750835e290df3b23a1943b552c" containerID="8f7a59f9f70e4dcd108ccc6d139a2354c6264d2ab270fd69a66ef17a60c9a674" exitCode=0 May 29 10:12:10.072223 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.072132 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" event={"ID":"fe1e58750835e290df3b23a1943b552c","Type":"ContainerDied","Data":"8f7a59f9f70e4dcd108ccc6d139a2354c6264d2ab270fd69a66ef17a60c9a674"} May 29 10:12:10.073809 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.073780 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" event={"ID":"7acdff2164b2d1cf2de96438f0aba288","Type":"ContainerStarted","Data":"97c2a0b88d4e99260c48fd2d3efe858d70b2720e8869e0c94b15b4c2e00105fd"} May 29 10:12:10.075122 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.075099 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm424" event={"ID":"8814337b-dbb2-4850-8e73-cd1bed592e5c","Type":"ContainerStarted","Data":"eb14e81a24ed7a0c7018f5fff489e1386d5b6c6f8fe3e98ca8842cee43e1ea13"} May 29 10:12:10.076506 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.076481 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjrgp" event={"ID":"8b44b3b3-766c-4a53-9177-3bfd17795d16","Type":"ContainerStarted","Data":"ef84aa96234a39bf9997b636d297d6b964c09354f9ddfb948a0891bafd8e5218"} May 29 10:12:10.077849 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.077823 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="f2f74004506c5612d384228ee33e48a5c889812f386125a5d028eb80ed2ac5b8" exitCode=0 May 29 10:12:10.077957 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.077907 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"f2f74004506c5612d384228ee33e48a5c889812f386125a5d028eb80ed2ac5b8"} May 29 10:12:10.081165 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081147 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"26c1467d9424b6705b55e966cfa6266b3533bd255dccb6dbd5048a12d5df4e94"} May 29 10:12:10.081262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081171 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"da4a43a4e7756a4b0ce6b022626d88548e43641c1b26cba5cf6d35824ab95bdd"} May 29 10:12:10.081262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081184 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"adf65c493519568698827c22339ccf667aa58da3bd43360a68c1298e6308f8e3"} May 29 10:12:10.081262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081197 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"e7186d1573abd22096784338bc22c2fa97b0f19ce3058a140f96a622ccbb0a81"} May 29 10:12:10.081262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081208 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"6d21e0a454a632bd6986f45f6c3e8727402022e6cadaf15b0c4cd1de3ec18392"} May 29 10:12:10.081262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.081220 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"6f0dd28ebb61ba330079df9d4ec30f3991958e5726bcc70488f6efac4b3275aa"} May 29 10:12:10.095745 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.095706 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d2zbw" podStartSLOduration=2.193279891 podStartE2EDuration="21.095696139s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.179804024 +0000 UTC m=+1.890960178" lastFinishedPulling="2026-05-29 10:12:09.082220262 +0000 UTC m=+20.793376426" observedRunningTime="2026-05-29 10:12:10.082531432 +0000 UTC m=+21.793687606" watchObservedRunningTime="2026-05-29 10:12:10.095696139 +0000 UTC m=+21.806852315" May 29 10:12:10.096052 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.096025 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tl92t" podStartSLOduration=3.168350993 podStartE2EDuration="22.096019177s" podCreationTimestamp="2026-05-29 10:11:48 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.122227375 +0000 UTC m=+1.833383535" lastFinishedPulling="2026-05-29 10:12:09.049895562 +0000 UTC m=+20.761051719" observedRunningTime="2026-05-29 10:12:10.095911537 +0000 UTC m=+21.807067712" watchObservedRunningTime="2026-05-29 10:12:10.096019177 +0000 UTC m=+21.807175351" May 29 10:12:10.130384 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.130312 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jjrgp" podStartSLOduration=2.135948864 podStartE2EDuration="21.130295468s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.164430852 +0000 UTC m=+1.875587009" lastFinishedPulling="2026-05-29 10:12:09.158777462 +0000 UTC m=+20.869933613" observedRunningTime="2026-05-29 10:12:10.13027156 +0000 UTC m=+21.841427734" watchObservedRunningTime="2026-05-29 10:12:10.130295468 +0000 UTC m=+21.841451644" May 29 10:12:10.173240 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.173130 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8qk74" podStartSLOduration=3.252935635 podStartE2EDuration="22.173115548s" podCreationTimestamp="2026-05-29 10:11:48 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.129896308 +0000 UTC m=+1.841052461" lastFinishedPulling="2026-05-29 10:12:09.050076219 +0000 UTC m=+20.761232374" observedRunningTime="2026-05-29 10:12:10.159223258 +0000 UTC m=+21.870379432" watchObservedRunningTime="2026-05-29 10:12:10.173115548 +0000 UTC m=+21.884271722" May 29 10:12:10.173390 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.173339 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nm424" podStartSLOduration=2.268885523 podStartE2EDuration="21.173308908s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.17731663 +0000 UTC m=+1.888472788" lastFinishedPulling="2026-05-29 10:12:09.081740008 +0000 UTC m=+20.792896173" observedRunningTime="2026-05-29 10:12:10.172700391 +0000 UTC m=+21.883856568" watchObservedRunningTime="2026-05-29 10:12:10.173308908 +0000 UTC m=+21.884465083" May 29 10:12:10.186212 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.186141 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-110.ec2.internal" podStartSLOduration=21.186129463 podStartE2EDuration="21.186129463s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:12:10.186001718 +0000 UTC m=+21.897157893" watchObservedRunningTime="2026-05-29 10:12:10.186129463 +0000 UTC m=+21.897285637" May 29 10:12:10.637275 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.637249 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 10:12:10.859874 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.859770 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T10:12:10.637270244Z","UUID":"fde3af4a-3635-43be-8cf1-ec0a476b984f","Handler":null,"Name":"","Endpoint":""} May 29 10:12:10.861482 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.861456 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 10:12:10.861482 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:10.861488 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 10:12:11.085315 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.085272 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" event={"ID":"6a7d7a81-082c-4f53-a189-335e829c7563","Type":"ContainerStarted","Data":"124c83d2df42393775f1b42845e229516ed06da3fc61f375684395f13764368b"} May 29 10:12:11.087155 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.087130 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" event={"ID":"fe1e58750835e290df3b23a1943b552c","Type":"ContainerStarted","Data":"fb62fa4483564bf4b0b1df50944ba5776af8dc7cc7e8f53ee1cafd7b35276a5e"} May 29 10:12:11.089175 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.089145 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svjwr" event={"ID":"d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae","Type":"ContainerStarted","Data":"fea334dcae073d4503eb0e241029d949465fc25bb7d6a4a13f0295c4ff26aaf7"} May 29 10:12:11.100685 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.100644 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-110.ec2.internal" podStartSLOduration=22.100632534 podStartE2EDuration="22.100632534s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:12:11.100384808 +0000 UTC m=+22.811540983" watchObservedRunningTime="2026-05-29 10:12:11.100632534 +0000 UTC m=+22.811788707" May 29 10:12:11.112916 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.112826 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-svjwr" podStartSLOduration=3.23348321 podStartE2EDuration="22.112810814s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.170703155 +0000 UTC m=+1.881859311" lastFinishedPulling="2026-05-29 10:12:09.050030753 +0000 UTC m=+20.761186915" observedRunningTime="2026-05-29 10:12:11.112725183 +0000 UTC m=+22.823881358" watchObservedRunningTime="2026-05-29 10:12:11.112810814 +0000 UTC m=+22.823966990" May 29 10:12:11.927802 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.927622 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:11.927930 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:11.927620 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:11.927985 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:11.927917 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:11.928031 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:11.928000 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:12.093804 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:12.093767 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"bc5a3e576eef46174a2a80b18f592447c1632464692407619c0885749fbda2f6"} May 29 10:12:12.095964 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:12.095929 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" event={"ID":"6a7d7a81-082c-4f53-a189-335e829c7563","Type":"ContainerStarted","Data":"3a8e48b07e7e0ba69b923e480e3354605ab03c700e52f18fc0ee50ea32bf72f3"} May 29 10:12:12.114245 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:12.114162 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sw8s7" podStartSLOduration=2.6341607270000003 podStartE2EDuration="24.114147105s" podCreationTimestamp="2026-05-29 10:11:48 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.10751997 +0000 UTC m=+1.818676122" lastFinishedPulling="2026-05-29 10:12:11.587506342 +0000 UTC m=+23.298662500" observedRunningTime="2026-05-29 10:12:12.113907842 +0000 UTC m=+23.825064015" watchObservedRunningTime="2026-05-29 10:12:12.114147105 +0000 UTC m=+23.825303343" May 29 10:12:13.927271 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:13.927240 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:13.927879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:13.927241 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:13.927879 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:13.927387 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:13.927879 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:13.927429 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:14.866191 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:14.865943 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8qk74" May 29 10:12:14.866537 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:14.866515 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8qk74" May 29 10:12:15.103651 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.103618 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="504b0039154df24e47541d0b6b6cbef77395a3ec83ac562bffceced29ce470ad" exitCode=0 May 29 10:12:15.104263 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.103710 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"504b0039154df24e47541d0b6b6cbef77395a3ec83ac562bffceced29ce470ad"} May 29 10:12:15.107167 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.107136 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" event={"ID":"4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6","Type":"ContainerStarted","Data":"437ef307c80e0039098a4dc52d15f596c715ed3b0e6f2b54455be07ba14e83f4"} May 29 10:12:15.107438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.107409 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:15.107538 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.107443 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8qk74" May 29 10:12:15.107538 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.107457 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:15.107893 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.107875 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8qk74" May 29 10:12:15.123472 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.123406 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:15.123831 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.123806 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:15.144679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.144644 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" podStartSLOduration=8.14496313 podStartE2EDuration="27.144632801s" podCreationTimestamp="2026-05-29 10:11:48 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.092563914 +0000 UTC m=+1.803720065" lastFinishedPulling="2026-05-29 10:12:09.092233581 +0000 UTC m=+20.803389736" observedRunningTime="2026-05-29 10:12:15.143902336 +0000 UTC m=+26.855058510" watchObservedRunningTime="2026-05-29 10:12:15.144632801 +0000 UTC m=+26.855788974" May 29 10:12:15.928132 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.928106 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:15.928221 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:15.928120 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:15.928221 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:15.928198 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:15.928347 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:15.928308 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:16.111791 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.111551 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="32bbaaba412b9fd183c522018b2621eb07ef420c3515533d4d1af2886dd9763e" exitCode=0 May 29 10:12:16.112184 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.111988 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 10:12:16.112184 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.111653 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"32bbaaba412b9fd183c522018b2621eb07ef420c3515533d4d1af2886dd9763e"} May 29 10:12:16.120630 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.120611 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wl72q"] May 29 10:12:16.120736 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.120680 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:16.120791 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:16.120750 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:16.124860 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.124839 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4q98t"] May 29 10:12:16.124975 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:16.124950 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:16.125171 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:16.125140 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:17.116394 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:17.116360 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerStarted","Data":"dd4dbefdeba5ae8097440296d4254f9a373ae18a6c828c290da9d6fe2c602501"} May 29 10:12:17.116812 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:17.116791 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 10:12:17.693851 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:17.693815 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:17.928014 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:17.927981 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:17.928152 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:17.927985 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:17.928152 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:17.928078 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:17.928243 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:17.928171 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:18.119998 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:18.119968 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="dd4dbefdeba5ae8097440296d4254f9a373ae18a6c828c290da9d6fe2c602501" exitCode=0 May 29 10:12:18.120398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:18.120057 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"dd4dbefdeba5ae8097440296d4254f9a373ae18a6c828c290da9d6fe2c602501"} May 29 10:12:19.928152 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:19.928113 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:19.928855 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:19.928127 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:19.928855 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:19.928220 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:19.928855 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:19.928336 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:21.530935 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:21.530896 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:21.531486 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.531046 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:12:21.531486 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.531124 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:12:53.531103204 +0000 UTC m=+65.242259356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 10:12:21.631295 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:21.631265 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:21.631436 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.631414 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 10:12:21.631436 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.631431 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 10:12:21.631522 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.631444 2552 projected.go:194] Error preparing data for projected volume kube-api-access-958n4 for pod openshift-network-diagnostics/network-check-target-wl72q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:12:21.631522 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.631505 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4 podName:b3e36f6f-46c9-406e-b7dd-413fa36de661 nodeName:}" failed. No retries permitted until 2026-05-29 10:12:53.631490485 +0000 UTC m=+65.342646641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-958n4" (UniqueName: "kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4") pod "network-check-target-wl72q" (UID: "b3e36f6f-46c9-406e-b7dd-413fa36de661") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 10:12:21.927940 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:21.927865 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:21.928086 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.927992 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wl72q" podUID="b3e36f6f-46c9-406e-b7dd-413fa36de661" May 29 10:12:21.928086 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:21.928053 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:21.928207 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:21.928190 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:12:22.118927 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.118892 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-110.ec2.internal" event="NodeReady" May 29 10:12:22.119094 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.119045 2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 10:12:22.161671 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.161639 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wh5rh"] May 29 10:12:22.189772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.189691 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d45mq"] May 29 10:12:22.189928 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.189823 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.192276 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.192064 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 10:12:22.192276 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.192090 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 10:12:22.192276 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.192177 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rtb8p\"" May 29 10:12:22.207703 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.207680 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wh5rh"] May 29 10:12:22.207703 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.207706 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d45mq"] May 29 10:12:22.207854 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.207829 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.209846 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.209827 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 10:12:22.209846 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.209840 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5kwr\"" May 29 10:12:22.209995 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.209869 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 10:12:22.209995 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.209868 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 10:12:22.335874 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.335836 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.336065 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.335966 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8346e92d-a549-4a9a-8ec6-e897ea222e4d-config-volume\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.336065 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.336004 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.336159 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.336065 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8346e92d-a549-4a9a-8ec6-e897ea222e4d-tmp-dir\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.336159 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.336130 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvllf\" (UniqueName: \"kubernetes.io/projected/8346e92d-a549-4a9a-8ec6-e897ea222e4d-kube-api-access-qvllf\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.336159 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.336147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpjh\" (UniqueName: \"kubernetes.io/projected/19dda671-e10e-48f4-9602-0ab7047dd8cc-kube-api-access-qfpjh\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.437156 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437119 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvllf\" (UniqueName: \"kubernetes.io/projected/8346e92d-a549-4a9a-8ec6-e897ea222e4d-kube-api-access-qvllf\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.437156 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437160 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpjh\" (UniqueName: \"kubernetes.io/projected/19dda671-e10e-48f4-9602-0ab7047dd8cc-kube-api-access-qfpjh\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.437436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437197 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.437436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437239 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8346e92d-a549-4a9a-8ec6-e897ea222e4d-config-volume\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.437436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437268 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.437436 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437315 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8346e92d-a549-4a9a-8ec6-e897ea222e4d-tmp-dir\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.437436 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.437372 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:22.437668 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.437456 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:22.937434125 +0000 UTC m=+34.648590281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:22.437668 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.437614 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:22.437668 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437637 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8346e92d-a549-4a9a-8ec6-e897ea222e4d-tmp-dir\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.437807 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.437650 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:22.937638065 +0000 UTC m=+34.648794246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:22.437993 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.437971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8346e92d-a549-4a9a-8ec6-e897ea222e4d-config-volume\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.447742 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.447680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvllf\" (UniqueName: \"kubernetes.io/projected/8346e92d-a549-4a9a-8ec6-e897ea222e4d-kube-api-access-qvllf\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.447742 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.447692 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpjh\" (UniqueName: \"kubernetes.io/projected/19dda671-e10e-48f4-9602-0ab7047dd8cc-kube-api-access-qfpjh\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.941786 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.941572 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:22.942216 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:22.941819 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:22.942216 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.941721 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:22.942216 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.941941 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:23.941917413 +0000 UTC m=+35.653073580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:22.942216 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.941951 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:22.942216 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:22.942009 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:23.941993133 +0000 UTC m=+35.653149290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:23.927812 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.927776 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:23.927983 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.927775 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:23.930114 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.930086 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 10:12:23.930114 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.930107 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 10:12:23.930608 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.930592 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m7vfn\"" May 29 10:12:23.930681 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.930672 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 10:12:23.930725 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.930699 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz7bl\"" May 29 10:12:23.950803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.950782 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:23.951106 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:23.950833 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:23.951106 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:23.950910 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:23.951106 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:23.950946 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:23.951106 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:23.950971 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:25.950957291 +0000 UTC m=+37.662113443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:23.951106 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:23.951006 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:25.950988417 +0000 UTC m=+37.662144585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:25.134357 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:25.134292 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="2e091a110970f85dc750e774d84eb79c5550bfe10d7f7624d36c2f3901a386bf" exitCode=0 May 29 10:12:25.134789 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:25.134368 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"2e091a110970f85dc750e774d84eb79c5550bfe10d7f7624d36c2f3901a386bf"} May 29 10:12:25.967409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:25.967303 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:25.967409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:25.967379 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:25.967574 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:25.967459 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:25.967574 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:25.967475 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:25.967574 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:25.967526 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:29.967509796 +0000 UTC m=+41.678665948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:25.967574 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:25.967540 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:29.967533895 +0000 UTC m=+41.678690047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:26.138858 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:26.138817 2552 generic.go:358] "Generic (PLEG): container finished" podID="5dc796ea-a9da-4d75-8f1e-3174cac39fab" containerID="3e56934be527ec932b6e910c82c857ae8aba99bd7346e29e64de441c3c6df631" exitCode=0 May 29 10:12:26.139218 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:26.138876 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerDied","Data":"3e56934be527ec932b6e910c82c857ae8aba99bd7346e29e64de441c3c6df631"} May 29 10:12:27.143792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:27.143759 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" event={"ID":"5dc796ea-a9da-4d75-8f1e-3174cac39fab","Type":"ContainerStarted","Data":"e6d53ac8defb052823f65a44353a921fb1dc8cb3d15ea3d5923df3c73d7e07be"} May 29 10:12:27.170081 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:27.170043 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sq6mz" podStartSLOduration=4.299588131 podStartE2EDuration="38.170030337s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:11:50.158816981 +0000 UTC m=+1.869973138" lastFinishedPulling="2026-05-29 10:12:24.02925919 +0000 UTC m=+35.740415344" observedRunningTime="2026-05-29 10:12:27.169277668 +0000 UTC m=+38.880433859" watchObservedRunningTime="2026-05-29 10:12:27.170030337 +0000 UTC m=+38.881186511" May 29 10:12:28.745674 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.745642 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7"] May 29 10:12:28.762864 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.762827 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7"] May 29 10:12:28.763002 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.762953 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.765510 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.765488 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 29 10:12:28.765662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.765518 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 10:12:28.765662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.765567 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 10:12:28.765662 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.765517 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 10:12:28.887629 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.887600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c3ece6-b906-4592-b433-a239dfa65063-tmp\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.887822 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.887652 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw4z\" (UniqueName: \"kubernetes.io/projected/68c3ece6-b906-4592-b433-a239dfa65063-kube-api-access-rrw4z\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.887822 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.887680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68c3ece6-b906-4592-b433-a239dfa65063-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.989021 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.988985 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c3ece6-b906-4592-b433-a239dfa65063-tmp\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.989209 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.989055 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw4z\" (UniqueName: \"kubernetes.io/projected/68c3ece6-b906-4592-b433-a239dfa65063-kube-api-access-rrw4z\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.989209 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.989092 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68c3ece6-b906-4592-b433-a239dfa65063-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.989481 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.989444 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c3ece6-b906-4592-b433-a239dfa65063-tmp\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.992861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.992834 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68c3ece6-b906-4592-b433-a239dfa65063-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:28.996763 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:28.996704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw4z\" (UniqueName: \"kubernetes.io/projected/68c3ece6-b906-4592-b433-a239dfa65063-kube-api-access-rrw4z\") pod \"klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7\" (UID: \"68c3ece6-b906-4592-b433-a239dfa65063\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:29.072813 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:29.072779 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:29.268110 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:29.268035 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7"] May 29 10:12:29.271956 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:12:29.271921 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c3ece6_b906_4592_b433_a239dfa65063.slice/crio-479f09ceed41072fe00ac7b08f85d06f59b54842c237f4b7978e017ce7374eb0 WatchSource:0}: Error finding container 479f09ceed41072fe00ac7b08f85d06f59b54842c237f4b7978e017ce7374eb0: Status 404 returned error can't find the container with id 479f09ceed41072fe00ac7b08f85d06f59b54842c237f4b7978e017ce7374eb0 May 29 10:12:29.996214 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:29.996179 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:29.996609 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:29.996225 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:29.996609 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:29.996345 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:29.996609 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:29.996345 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:29.996609 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:29.996403 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:37.996387722 +0000 UTC m=+49.707543875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:29.996609 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:29.996418 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:37.996410907 +0000 UTC m=+49.707567058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:30.151644 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:30.151608 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" event={"ID":"68c3ece6-b906-4592-b433-a239dfa65063","Type":"ContainerStarted","Data":"479f09ceed41072fe00ac7b08f85d06f59b54842c237f4b7978e017ce7374eb0"} May 29 10:12:36.166701 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:36.166667 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" event={"ID":"68c3ece6-b906-4592-b433-a239dfa65063","Type":"ContainerStarted","Data":"c443c4915f288b0b3a1d4dbd1c0b7db468180268b3423bf3abc7534183d84540"} May 29 10:12:36.167069 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:36.166874 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:36.168505 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:36.168484 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:12:36.180109 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:36.180033 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" podStartSLOduration=2.286689981 podStartE2EDuration="8.18002228s" podCreationTimestamp="2026-05-29 10:12:28 +0000 UTC" firstStartedPulling="2026-05-29 10:12:29.273815612 +0000 UTC m=+40.984971765" lastFinishedPulling="2026-05-29 10:12:35.167147912 +0000 UTC m=+46.878304064" observedRunningTime="2026-05-29 10:12:36.179731524 +0000 UTC m=+47.890887699" watchObservedRunningTime="2026-05-29 10:12:36.18002228 +0000 UTC m=+47.891178473" May 29 10:12:38.050284 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:38.050237 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:38.050803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:38.050301 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:38.050803 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:38.050422 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:38.050803 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:38.050497 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:12:54.050481725 +0000 UTC m=+65.761637877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:38.050803 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:38.050422 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:38.050803 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:38.050564 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:12:54.050552042 +0000 UTC m=+65.761708194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:48.130576 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:48.130541 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7bbjr" May 29 10:12:53.552054 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.551997 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:12:53.554239 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.554220 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 10:12:53.562616 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:53.562596 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 10:12:53.562704 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:53.562665 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:13:57.562642796 +0000 UTC m=+129.273798974 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : secret "metrics-daemon-secret" not found May 29 10:12:53.652312 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.652287 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:53.654408 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.654391 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 10:12:53.664574 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.664549 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 10:12:53.676401 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.676374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-958n4\" (UniqueName: \"kubernetes.io/projected/b3e36f6f-46c9-406e-b7dd-413fa36de661-kube-api-access-958n4\") pod \"network-check-target-wl72q\" (UID: \"b3e36f6f-46c9-406e-b7dd-413fa36de661\") " pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:53.944494 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.944417 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz7bl\"" May 29 10:12:53.952779 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:53.952764 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:54.054763 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:54.054733 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:12:54.054944 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:54.054789 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:12:54.054944 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:54.054867 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:12:54.054944 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:54.054904 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:12:54.054944 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:54.054930 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:13:26.054914798 +0000 UTC m=+97.766070950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:12:54.055099 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:12:54.054953 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:13:26.054937504 +0000 UTC m=+97.766093670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:12:54.069281 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:54.069258 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wl72q"] May 29 10:12:54.072298 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:12:54.072271 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e36f6f_46c9_406e_b7dd_413fa36de661.slice/crio-69029ea658aef78c5a57c6061e9fd5325c9af928577988fb32fb4798d784bd59 WatchSource:0}: Error finding container 69029ea658aef78c5a57c6061e9fd5325c9af928577988fb32fb4798d784bd59: Status 404 returned error can't find the container with id 69029ea658aef78c5a57c6061e9fd5325c9af928577988fb32fb4798d784bd59 May 29 10:12:54.200811 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:54.200721 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wl72q" event={"ID":"b3e36f6f-46c9-406e-b7dd-413fa36de661","Type":"ContainerStarted","Data":"69029ea658aef78c5a57c6061e9fd5325c9af928577988fb32fb4798d784bd59"} May 29 10:12:57.207930 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:57.207892 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wl72q" event={"ID":"b3e36f6f-46c9-406e-b7dd-413fa36de661","Type":"ContainerStarted","Data":"343e2095f931a71ad211ffd60ce086a810899db5814846e59f897ee276dd06c0"} May 29 10:12:57.208305 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:57.208055 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:12:57.221244 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:12:57.221194 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wl72q" podStartSLOduration=65.62958509 podStartE2EDuration="1m8.221178643s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:12:54.074392432 +0000 UTC m=+65.785548603" lastFinishedPulling="2026-05-29 10:12:56.665986004 +0000 UTC m=+68.377142156" observedRunningTime="2026-05-29 10:12:57.220971413 +0000 UTC m=+68.932127590" watchObservedRunningTime="2026-05-29 10:12:57.221178643 +0000 UTC m=+68.932334818" May 29 10:13:26.068047 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:13:26.068008 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:13:26.068455 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:13:26.068061 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:13:26.068455 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:26.068145 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 10:13:26.068455 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:26.068163 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 10:13:26.068455 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:26.068223 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls podName:8346e92d-a549-4a9a-8ec6-e897ea222e4d nodeName:}" failed. No retries permitted until 2026-05-29 10:14:30.068208085 +0000 UTC m=+161.779364238 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls") pod "dns-default-wh5rh" (UID: "8346e92d-a549-4a9a-8ec6-e897ea222e4d") : secret "dns-default-metrics-tls" not found May 29 10:13:26.068455 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:26.068237 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert podName:19dda671-e10e-48f4-9602-0ab7047dd8cc nodeName:}" failed. No retries permitted until 2026-05-29 10:14:30.068231635 +0000 UTC m=+161.779387786 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert") pod "ingress-canary-d45mq" (UID: "19dda671-e10e-48f4-9602-0ab7047dd8cc") : secret "canary-serving-cert" not found May 29 10:13:28.211640 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:13:28.211611 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wl72q" May 29 10:13:57.582732 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:13:57.582689 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:13:57.583198 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:57.582813 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 10:13:57.583198 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:13:57.582869 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs podName:bacb7211-2886-45c3-88b8-c64d8e9a3c8c nodeName:}" failed. No retries permitted until 2026-05-29 10:15:59.58285456 +0000 UTC m=+251.294010711 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs") pod "network-metrics-daemon-4q98t" (UID: "bacb7211-2886-45c3-88b8-c64d8e9a3c8c") : secret "metrics-daemon-secret" not found May 29 10:14:01.301952 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.301921 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9"] May 29 10:14:01.304144 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.304124 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" May 29 10:14:01.306077 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.306049 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nktnf\"" May 29 10:14:01.306245 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.306227 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 29 10:14:01.306465 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.306449 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 29 10:14:01.317836 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.317809 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9"] May 29 10:14:01.318455 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.318437 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:01.320061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.320043 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.322107 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.322087 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 10:14:01.322226 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.322156 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 10:14:01.322685 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.322664 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pgcnk\"" May 29 10:14:01.322842 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.322828 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 10:14:01.328581 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.328559 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 10:14:01.336357 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.336315 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:01.406043 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.406016 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t"] May 29 10:14:01.407949 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.407922 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.408082 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408146 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408105 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408146 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408125 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408146 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408141 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b69n\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408166 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.408409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.408403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb54g\" (UniqueName: \"kubernetes.io/projected/28af9c2d-77e6-4d15-a182-8570fdede8ba-kube-api-access-qb54g\") pod \"volume-data-source-validator-5cf8c89d64-9szh9\" (UID: \"28af9c2d-77e6-4d15-a182-8570fdede8ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" May 29 10:14:01.411070 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.411056 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 29 10:14:01.411158 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.411094 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fb22h\"" May 29 10:14:01.411300 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.411287 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 29 10:14:01.425736 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.425713 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t"] May 29 10:14:01.499253 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.499220 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm"] May 29 10:14:01.501029 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.501014 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" May 29 10:14:01.502555 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.502529 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69d8ffb984-rmmnq"] May 29 10:14:01.503301 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.503282 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cxxpq\"" May 29 10:14:01.504228 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.504211 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.506080 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506058 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 29 10:14:01.506203 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506104 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 29 10:14:01.506203 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506146 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 29 10:14:01.506438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506384 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7xmqm\"" May 29 10:14:01.506438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506422 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 10:14:01.506678 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506639 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 10:14:01.506802 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.506749 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 29 10:14:01.509045 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509026 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509162 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509061 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509162 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509093 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509262 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509211 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de43d725-524d-4771-8e57-f7103e049a34-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.509370 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509352 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb54g\" (UniqueName: \"kubernetes.io/projected/28af9c2d-77e6-4d15-a182-8570fdede8ba-kube-api-access-qb54g\") pod \"volume-data-source-validator-5cf8c89d64-9szh9\" (UID: \"28af9c2d-77e6-4d15-a182-8570fdede8ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" May 29 10:14:01.509446 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509428 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509503 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509467 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.509560 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509511 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509560 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509538 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509657 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509560 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509657 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509564 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b69n\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509755 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.509648 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.509755 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.509719 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:14:01.509755 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.509736 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b9649f99-sgtcb: secret "image-registry-tls" not found May 29 10:14:01.509956 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.509943 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls podName:a22e3571-c9da-44a8-87e4-b017dd8c3a5e nodeName:}" failed. No retries permitted until 2026-05-29 10:14:02.009920334 +0000 UTC m=+133.721076506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls") pod "image-registry-8b9649f99-sgtcb" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e") : secret "image-registry-tls" not found May 29 10:14:01.510039 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.510021 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm"] May 29 10:14:01.510288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.510241 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.510560 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.510543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.512863 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.512839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.512957 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.512839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.516192 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.516168 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d8ffb984-rmmnq"] May 29 10:14:01.523810 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.523787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.524240 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.524222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb54g\" (UniqueName: \"kubernetes.io/projected/28af9c2d-77e6-4d15-a182-8570fdede8ba-kube-api-access-qb54g\") pod \"volume-data-source-validator-5cf8c89d64-9szh9\" (UID: \"28af9c2d-77e6-4d15-a182-8570fdede8ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" May 29 10:14:01.524288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.524221 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b69n\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:01.610976 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.610900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-default-certificate\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.611099 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.610973 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.611099 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.610996 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.611099 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.611099 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-stats-auth\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.611099 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjn8\" (UniqueName: \"kubernetes.io/projected/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-kube-api-access-cbjn8\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.611293 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611117 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4m8\" (UniqueName: \"kubernetes.io/projected/e195077c-6c49-46ac-8614-07ba07d6ffbf-kube-api-access-dj4m8\") pod \"network-check-source-7f44b6dd87-87txm\" (UID: \"e195077c-6c49-46ac-8614-07ba07d6ffbf\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" May 29 10:14:01.611293 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.611123 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:01.611293 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611142 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de43d725-524d-4771-8e57-f7103e049a34-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.611293 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.611187 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:02.111172209 +0000 UTC m=+133.822328361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:01.611670 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.611653 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de43d725-524d-4771-8e57-f7103e049a34-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:01.612865 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.612852 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" May 29 10:14:01.711844 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711798 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-default-certificate\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.711979 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711883 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.711979 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711904 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.711979 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711933 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-stats-auth\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.711979 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711953 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjn8\" (UniqueName: \"kubernetes.io/projected/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-kube-api-access-cbjn8\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.711979 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.711975 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4m8\" (UniqueName: \"kubernetes.io/projected/e195077c-6c49-46ac-8614-07ba07d6ffbf-kube-api-access-dj4m8\") pod \"network-check-source-7f44b6dd87-87txm\" (UID: \"e195077c-6c49-46ac-8614-07ba07d6ffbf\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" May 29 10:14:01.712295 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.712231 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:01.712295 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.712289 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:02.212271742 +0000 UTC m=+133.923427894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:01.712485 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:01.712313 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:02.212304984 +0000 UTC m=+133.923461136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:01.714725 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.714701 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-stats-auth\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.714834 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.714816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-default-certificate\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.720306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.720285 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjn8\" (UniqueName: \"kubernetes.io/projected/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-kube-api-access-cbjn8\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:01.720717 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.720700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4m8\" (UniqueName: \"kubernetes.io/projected/e195077c-6c49-46ac-8614-07ba07d6ffbf-kube-api-access-dj4m8\") pod \"network-check-source-7f44b6dd87-87txm\" (UID: \"e195077c-6c49-46ac-8614-07ba07d6ffbf\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" May 29 10:14:01.730101 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.730080 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9"] May 29 10:14:01.733032 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:01.733002 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28af9c2d_77e6_4d15_a182_8570fdede8ba.slice/crio-ce54df0723c15a64c22ba0427dda08644c33130946864c3e22eb1b2e667b66ae WatchSource:0}: Error finding container ce54df0723c15a64c22ba0427dda08644c33130946864c3e22eb1b2e667b66ae: Status 404 returned error can't find the container with id ce54df0723c15a64c22ba0427dda08644c33130946864c3e22eb1b2e667b66ae May 29 10:14:01.811535 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.811488 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" May 29 10:14:01.927974 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:01.927942 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm"] May 29 10:14:01.930961 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:01.930936 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode195077c_6c49_46ac_8614_07ba07d6ffbf.slice/crio-7ecafe90f66ad53cf1ae3e4157124c44ddbab6e89005a3a857e94240a4db7177 WatchSource:0}: Error finding container 7ecafe90f66ad53cf1ae3e4157124c44ddbab6e89005a3a857e94240a4db7177: Status 404 returned error can't find the container with id 7ecafe90f66ad53cf1ae3e4157124c44ddbab6e89005a3a857e94240a4db7177 May 29 10:14:02.015191 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.015157 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:02.015381 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.015268 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:14:02.015381 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.015287 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b9649f99-sgtcb: secret "image-registry-tls" not found May 29 10:14:02.015381 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.015351 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls podName:a22e3571-c9da-44a8-87e4-b017dd8c3a5e nodeName:}" failed. No retries permitted until 2026-05-29 10:14:03.01533672 +0000 UTC m=+134.726492872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls") pod "image-registry-8b9649f99-sgtcb" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e") : secret "image-registry-tls" not found May 29 10:14:02.115762 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.115720 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:02.115939 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.115900 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:02.115999 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.115987 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:03.115965231 +0000 UTC m=+134.827121396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:02.216599 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.216512 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:02.216599 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.216567 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:02.216853 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.216705 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:03.216681481 +0000 UTC m=+134.927837667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:02.216853 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.216755 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:02.216853 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:02.216822 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:03.216803841 +0000 UTC m=+134.927959998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:02.330639 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.330594 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" event={"ID":"28af9c2d-77e6-4d15-a182-8570fdede8ba","Type":"ContainerStarted","Data":"ce54df0723c15a64c22ba0427dda08644c33130946864c3e22eb1b2e667b66ae"} May 29 10:14:02.331993 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.331962 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" event={"ID":"e195077c-6c49-46ac-8614-07ba07d6ffbf","Type":"ContainerStarted","Data":"ce7f0a696f8358302dd8826cdbde73ee106e9169daaccc40e273334a889a6b0e"} May 29 10:14:02.332124 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.332002 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" event={"ID":"e195077c-6c49-46ac-8614-07ba07d6ffbf","Type":"ContainerStarted","Data":"7ecafe90f66ad53cf1ae3e4157124c44ddbab6e89005a3a857e94240a4db7177"} May 29 10:14:02.346488 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:02.346435 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-87txm" podStartSLOduration=1.346417845 podStartE2EDuration="1.346417845s" podCreationTimestamp="2026-05-29 10:14:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:14:02.345288559 +0000 UTC m=+134.056444734" watchObservedRunningTime="2026-05-29 10:14:02.346417845 +0000 UTC m=+134.057574020" May 29 10:14:03.023664 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.023616 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:03.023875 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.023766 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:14:03.023875 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.023788 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b9649f99-sgtcb: secret "image-registry-tls" not found May 29 10:14:03.023875 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.023847 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls podName:a22e3571-c9da-44a8-87e4-b017dd8c3a5e nodeName:}" failed. No retries permitted until 2026-05-29 10:14:05.023830128 +0000 UTC m=+136.734986280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls") pod "image-registry-8b9649f99-sgtcb" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e") : secret "image-registry-tls" not found May 29 10:14:03.124636 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.124541 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:03.124770 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.124686 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:03.124770 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.124753 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:05.124738432 +0000 UTC m=+136.835894584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:03.225205 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.225151 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:03.225205 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.225212 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:03.225478 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.225354 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:05.225308336 +0000 UTC m=+136.936464493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:03.225478 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.225360 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:03.225478 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:03.225397 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:05.225390049 +0000 UTC m=+136.936546201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:03.335645 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.335608 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" event={"ID":"28af9c2d-77e6-4d15-a182-8570fdede8ba","Type":"ContainerStarted","Data":"a4de26d3a9237b7e850e5b2d6c5219496ccef9d0701bb7dd453fe9614a476d84"} May 29 10:14:03.349685 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:03.349636 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-9szh9" podStartSLOduration=1.215359138 podStartE2EDuration="2.349624608s" podCreationTimestamp="2026-05-29 10:14:01 +0000 UTC" firstStartedPulling="2026-05-29 10:14:01.734696229 +0000 UTC m=+133.445852384" lastFinishedPulling="2026-05-29 10:14:02.868961689 +0000 UTC m=+134.580117854" observedRunningTime="2026-05-29 10:14:03.348483773 +0000 UTC m=+135.059639949" watchObservedRunningTime="2026-05-29 10:14:03.349624608 +0000 UTC m=+135.060780781" May 29 10:14:05.039586 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:05.039549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:05.040012 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.039695 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:14:05.040012 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.039713 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b9649f99-sgtcb: secret "image-registry-tls" not found May 29 10:14:05.040012 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.039768 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls podName:a22e3571-c9da-44a8-87e4-b017dd8c3a5e nodeName:}" failed. No retries permitted until 2026-05-29 10:14:09.039750513 +0000 UTC m=+140.750906664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls") pod "image-registry-8b9649f99-sgtcb" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e") : secret "image-registry-tls" not found May 29 10:14:05.140636 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:05.140608 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:05.140785 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.140746 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:05.140826 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.140808 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:09.140792048 +0000 UTC m=+140.851948201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:05.241424 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:05.241396 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:05.241424 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:05.241428 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:05.241563 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.241546 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:05.241596 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.241561 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:09.241543445 +0000 UTC m=+140.952699598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:05.241596 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:05.241585 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:09.241574201 +0000 UTC m=+140.952730352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:08.572717 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:08.572687 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm424_8814337b-dbb2-4850-8e73-cd1bed592e5c/dns-node-resolver/0.log" May 29 10:14:09.071212 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.071170 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:09.071394 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.071316 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 10:14:09.071394 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.071349 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b9649f99-sgtcb: secret "image-registry-tls" not found May 29 10:14:09.071471 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.071402 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls podName:a22e3571-c9da-44a8-87e4-b017dd8c3a5e nodeName:}" failed. No retries permitted until 2026-05-29 10:14:17.071386382 +0000 UTC m=+148.782542538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls") pod "image-registry-8b9649f99-sgtcb" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e") : secret "image-registry-tls" not found May 29 10:14:09.171598 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.171557 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:09.171761 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.171705 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:09.171801 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.171777 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:17.171756419 +0000 UTC m=+148.882912572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:09.272148 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.272117 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:09.272148 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.272152 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:09.272315 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.272262 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:09.272315 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.272282 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:17.272264454 +0000 UTC m=+148.983420609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:09.272315 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:09.272301 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:17.272291149 +0000 UTC m=+148.983447322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:09.274549 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.274527 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cnrqr"] May 29 10:14:09.277634 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.277619 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.279749 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.279697 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vqv5j\"" May 29 10:14:09.279881 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.279739 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 29 10:14:09.280175 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.280160 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 29 10:14:09.280413 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.280395 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 29 10:14:09.280481 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.280404 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 29 10:14:09.285792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.285761 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cnrqr"] May 29 10:14:09.372749 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.372681 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-key\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.372749 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.372730 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-cabundle\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.372749 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.372749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6kxn\" (UniqueName: \"kubernetes.io/projected/d3244b76-63fb-4192-8da1-708ea4d7ab43-kube-api-access-l6kxn\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.473676 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.473630 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-cabundle\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.473676 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.473681 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kxn\" (UniqueName: \"kubernetes.io/projected/d3244b76-63fb-4192-8da1-708ea4d7ab43-kube-api-access-l6kxn\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.473896 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.473801 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-key\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.474244 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.474225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-cabundle\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.476387 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.476368 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3244b76-63fb-4192-8da1-708ea4d7ab43-signing-key\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.481457 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.481440 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6kxn\" (UniqueName: \"kubernetes.io/projected/d3244b76-63fb-4192-8da1-708ea4d7ab43-kube-api-access-l6kxn\") pod \"service-ca-67d667c7d-cnrqr\" (UID: \"d3244b76-63fb-4192-8da1-708ea4d7ab43\") " pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.576165 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.576140 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tl92t_fd0b0406-7885-4472-8a63-95f9bea8e0a3/node-ca/0.log" May 29 10:14:09.586303 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.586283 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" May 29 10:14:09.706904 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:09.706875 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-cnrqr"] May 29 10:14:09.712663 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:09.712621 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3244b76_63fb_4192_8da1_708ea4d7ab43.slice/crio-dfb4e08173f31d3a0b85fc9b694e1d69b253d2d48e8831bd5b9c5feb0dc7e41f WatchSource:0}: Error finding container dfb4e08173f31d3a0b85fc9b694e1d69b253d2d48e8831bd5b9c5feb0dc7e41f: Status 404 returned error can't find the container with id dfb4e08173f31d3a0b85fc9b694e1d69b253d2d48e8831bd5b9c5feb0dc7e41f May 29 10:14:10.349291 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:10.349249 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" event={"ID":"d3244b76-63fb-4192-8da1-708ea4d7ab43","Type":"ContainerStarted","Data":"dfb4e08173f31d3a0b85fc9b694e1d69b253d2d48e8831bd5b9c5feb0dc7e41f"} May 29 10:14:12.354224 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:12.354189 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" event={"ID":"d3244b76-63fb-4192-8da1-708ea4d7ab43","Type":"ContainerStarted","Data":"b8ae945e14e5cf5d8be33418d574c6c270c3bda61bea0b26bfd2a2889c0b4471"} May 29 10:14:12.370509 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:12.370453 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-cnrqr" podStartSLOduration=1.097928047 podStartE2EDuration="3.370436597s" podCreationTimestamp="2026-05-29 10:14:09 +0000 UTC" firstStartedPulling="2026-05-29 10:14:09.714189794 +0000 UTC m=+141.425345946" lastFinishedPulling="2026-05-29 10:14:11.98669834 +0000 UTC m=+143.697854496" observedRunningTime="2026-05-29 10:14:12.36944917 +0000 UTC m=+144.080605344" watchObservedRunningTime="2026-05-29 10:14:12.370436597 +0000 UTC m=+144.081592773" May 29 10:14:17.137043 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.137003 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:17.139640 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.139616 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"image-registry-8b9649f99-sgtcb\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:17.229650 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.229618 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:17.238433 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.238408 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:17.238559 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:17.238539 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 29 10:14:17.238629 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:17.238618 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert podName:de43d725-524d-4771-8e57-f7103e049a34 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:33.23859555 +0000 UTC m=+164.949751704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ltx6t" (UID: "de43d725-524d-4771-8e57-f7103e049a34") : secret "networking-console-plugin-cert" not found May 29 10:14:17.338889 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.338860 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:17.339040 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.338905 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:17.339040 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:17.339008 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:33.338989832 +0000 UTC m=+165.050146003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : configmap references non-existent config key: service-ca.crt May 29 10:14:17.339040 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:17.339019 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 10:14:17.339256 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:17.339062 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs podName:4de611fc-eb70-4b80-b92a-2c8e80ea60d1 nodeName:}" failed. No retries permitted until 2026-05-29 10:14:33.339049569 +0000 UTC m=+165.050205721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs") pod "router-default-69d8ffb984-rmmnq" (UID: "4de611fc-eb70-4b80-b92a-2c8e80ea60d1") : secret "router-metrics-certs-default" not found May 29 10:14:17.358737 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:17.358709 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:17.362219 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:17.362185 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22e3571_c9da_44a8_87e4_b017dd8c3a5e.slice/crio-310333822e4f2cc434ee5d1797c8e1e897317b0ab1eb26ce1bd7026fabb3177b WatchSource:0}: Error finding container 310333822e4f2cc434ee5d1797c8e1e897317b0ab1eb26ce1bd7026fabb3177b: Status 404 returned error can't find the container with id 310333822e4f2cc434ee5d1797c8e1e897317b0ab1eb26ce1bd7026fabb3177b May 29 10:14:18.367157 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:18.367116 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" event={"ID":"a22e3571-c9da-44a8-87e4-b017dd8c3a5e","Type":"ContainerStarted","Data":"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149"} May 29 10:14:18.367157 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:18.367162 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" event={"ID":"a22e3571-c9da-44a8-87e4-b017dd8c3a5e","Type":"ContainerStarted","Data":"310333822e4f2cc434ee5d1797c8e1e897317b0ab1eb26ce1bd7026fabb3177b"} May 29 10:14:18.367572 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:18.367249 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:18.383942 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:18.383905 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" podStartSLOduration=17.38389343 podStartE2EDuration="17.38389343s" podCreationTimestamp="2026-05-29 10:14:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:14:18.383009738 +0000 UTC m=+150.094165912" watchObservedRunningTime="2026-05-29 10:14:18.38389343 +0000 UTC m=+150.095049597" May 29 10:14:25.201164 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:25.201121 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wh5rh" podUID="8346e92d-a549-4a9a-8ec6-e897ea222e4d" May 29 10:14:25.217204 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:25.217184 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-d45mq" podUID="19dda671-e10e-48f4-9602-0ab7047dd8cc" May 29 10:14:25.383680 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:25.383653 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh5rh" May 29 10:14:26.937432 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:26.937396 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4q98t" podUID="bacb7211-2886-45c3-88b8-c64d8e9a3c8c" May 29 10:14:30.020094 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.020058 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vcjcg"] May 29 10:14:30.025862 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.025843 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.028406 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.028383 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 10:14:30.028536 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.028436 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 10:14:30.028536 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.028451 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc7gp\"" May 29 10:14:30.028536 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.028459 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 10:14:30.028536 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.028490 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 10:14:30.035745 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.035724 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:30.036951 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.036928 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcjcg"] May 29 10:14:30.081059 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.081029 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cdcd9f759-w5hbf"] May 29 10:14:30.084276 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.084256 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.096879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.096859 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cdcd9f759-w5hbf"] May 29 10:14:30.132871 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.132852 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dbh\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-kube-api-access-j7dbh\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.132981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.132881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-trusted-ca\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.132981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.132911 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:14:30.132981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.132929 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.133105 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133082 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fb8d864-953e-4392-8c28-83730505e69d-ca-trust-extracted\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.133146 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-bound-sa-token\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.133186 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133162 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-data-volume\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.133218 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133189 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-registry-tls\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.133218 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.133288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133239 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-crio-socket\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.133288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133262 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpbg\" (UniqueName: \"kubernetes.io/projected/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-api-access-fbpbg\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.133398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133301 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:14:30.133398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133342 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-registry-certificates\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.133398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-installation-pull-secrets\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.133398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.133385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-image-registry-private-configuration\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.135523 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.135504 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dda671-e10e-48f4-9602-0ab7047dd8cc-cert\") pod \"ingress-canary-d45mq\" (UID: \"19dda671-e10e-48f4-9602-0ab7047dd8cc\") " pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:14:30.135804 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.135787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8346e92d-a549-4a9a-8ec6-e897ea222e4d-metrics-tls\") pod \"dns-default-wh5rh\" (UID: \"8346e92d-a549-4a9a-8ec6-e897ea222e4d\") " pod="openshift-dns/dns-default-wh5rh" May 29 10:14:30.187060 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.187040 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rtb8p\"" May 29 10:14:30.195879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.195854 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh5rh" May 29 10:14:30.234102 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234067 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-registry-certificates\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234102 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234106 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-installation-pull-secrets\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234307 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234131 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-image-registry-private-configuration\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234307 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234163 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dbh\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-kube-api-access-j7dbh\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234694 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234497 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-trusted-ca\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234694 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234550 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.234694 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234599 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fb8d864-953e-4392-8c28-83730505e69d-ca-trust-extracted\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234693 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-bound-sa-token\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234723 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-data-volume\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234755 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-registry-tls\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234795 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234831 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-crio-socket\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.234861 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.234857 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpbg\" (UniqueName: \"kubernetes.io/projected/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-api-access-fbpbg\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.235135 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235036 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-registry-certificates\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.235135 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235094 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.235225 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235163 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-crio-socket\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.235381 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235360 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-data-volume\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.235446 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235408 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fb8d864-953e-4392-8c28-83730505e69d-ca-trust-extracted\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.235523 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.235477 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8d864-953e-4392-8c28-83730505e69d-trusted-ca\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.237409 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.237388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.237493 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.237418 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-image-registry-private-configuration\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.237980 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.237964 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fb8d864-953e-4392-8c28-83730505e69d-installation-pull-secrets\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.238411 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.238395 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-registry-tls\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.241831 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.241798 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dbh\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-kube-api-access-j7dbh\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.247288 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.247264 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb8d864-953e-4392-8c28-83730505e69d-bound-sa-token\") pod \"image-registry-7cdcd9f759-w5hbf\" (UID: \"6fb8d864-953e-4392-8c28-83730505e69d\") " pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.247671 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.247648 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpbg\" (UniqueName: \"kubernetes.io/projected/8f12c1a2-9ea0-43a0-a114-35a089bf2cfd-kube-api-access-fbpbg\") pod \"insights-runtime-extractor-vcjcg\" (UID: \"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd\") " pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.322128 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.322097 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wh5rh"] May 29 10:14:30.325827 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:30.325795 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8346e92d_a549_4a9a_8ec6_e897ea222e4d.slice/crio-df40879a70426c2c2f37ee2fccc5a45e3d9e2147e375c44d8ccdb41d0b757322 WatchSource:0}: Error finding container df40879a70426c2c2f37ee2fccc5a45e3d9e2147e375c44d8ccdb41d0b757322: Status 404 returned error can't find the container with id df40879a70426c2c2f37ee2fccc5a45e3d9e2147e375c44d8ccdb41d0b757322 May 29 10:14:30.334535 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.334513 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcjcg" May 29 10:14:30.392197 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.392163 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:30.395532 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.395499 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh5rh" event={"ID":"8346e92d-a549-4a9a-8ec6-e897ea222e4d","Type":"ContainerStarted","Data":"df40879a70426c2c2f37ee2fccc5a45e3d9e2147e375c44d8ccdb41d0b757322"} May 29 10:14:30.464774 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.464744 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcjcg"] May 29 10:14:30.467517 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:30.467466 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f12c1a2_9ea0_43a0_a114_35a089bf2cfd.slice/crio-91d4cc89fb8410b2ee385c11ea3980a285165f6c63449499a8094d56e8d0bd02 WatchSource:0}: Error finding container 91d4cc89fb8410b2ee385c11ea3980a285165f6c63449499a8094d56e8d0bd02: Status 404 returned error can't find the container with id 91d4cc89fb8410b2ee385c11ea3980a285165f6c63449499a8094d56e8d0bd02 May 29 10:14:30.523981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:30.523952 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cdcd9f759-w5hbf"] May 29 10:14:31.399437 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.399357 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcjcg" event={"ID":"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd","Type":"ContainerStarted","Data":"8dfef187e5c923964da52b1d547dce87dbe1b8262537f433a47399f88b1fe692"} May 29 10:14:31.399437 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.399400 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcjcg" event={"ID":"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd","Type":"ContainerStarted","Data":"b5a16a4d7dc8c6c20dc2b9246b596c7eb281e5618edc8538a593f2416c125826"} May 29 10:14:31.399437 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.399415 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcjcg" event={"ID":"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd","Type":"ContainerStarted","Data":"91d4cc89fb8410b2ee385c11ea3980a285165f6c63449499a8094d56e8d0bd02"} May 29 10:14:31.400583 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.400554 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" event={"ID":"6fb8d864-953e-4392-8c28-83730505e69d","Type":"ContainerStarted","Data":"77c1dd9033b74e6068250b2e2a641fa58fc8f428ea607d5d6703186f45f5ca01"} May 29 10:14:31.400698 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.400589 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" event={"ID":"6fb8d864-953e-4392-8c28-83730505e69d","Type":"ContainerStarted","Data":"964e215fe611ac4ff1011036054a3a9aa8168fd2aae1ada412266265c85b8b86"} May 29 10:14:31.400752 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.400741 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:31.418362 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:31.418298 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" podStartSLOduration=1.418285133 podStartE2EDuration="1.418285133s" podCreationTimestamp="2026-05-29 10:14:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:14:31.417035625 +0000 UTC m=+163.128191799" watchObservedRunningTime="2026-05-29 10:14:31.418285133 +0000 UTC m=+163.129441314" May 29 10:14:32.405171 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:32.405125 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh5rh" event={"ID":"8346e92d-a549-4a9a-8ec6-e897ea222e4d","Type":"ContainerStarted","Data":"93e273af779b492bbda7a80c91f07c8012d60f0c99d0d49e0f773a7d034981a8"} May 29 10:14:32.405588 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:32.405178 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh5rh" event={"ID":"8346e92d-a549-4a9a-8ec6-e897ea222e4d","Type":"ContainerStarted","Data":"253ed51ed9d622e18339120d49fd47847ca8b3ea205e8db7767d8f869ef1c2d0"} May 29 10:14:32.421728 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:32.421669 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-wh5rh" podStartSLOduration=128.951822399 podStartE2EDuration="2m10.421656915s" podCreationTimestamp="2026-05-29 10:12:22 +0000 UTC" firstStartedPulling="2026-05-29 10:14:30.329503161 +0000 UTC m=+162.040659313" lastFinishedPulling="2026-05-29 10:14:31.79933766 +0000 UTC m=+163.510493829" observedRunningTime="2026-05-29 10:14:32.420507833 +0000 UTC m=+164.131664010" watchObservedRunningTime="2026-05-29 10:14:32.421656915 +0000 UTC m=+164.132813107" May 29 10:14:33.258277 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.258238 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:33.260768 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.260749 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de43d725-524d-4771-8e57-f7103e049a34-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ltx6t\" (UID: \"de43d725-524d-4771-8e57-f7103e049a34\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:33.359078 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.359046 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:33.359221 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.359093 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:33.359683 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.359645 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-service-ca-bundle\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:33.361456 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.361439 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4de611fc-eb70-4b80-b92a-2c8e80ea60d1-metrics-certs\") pod \"router-default-69d8ffb984-rmmnq\" (UID: \"4de611fc-eb70-4b80-b92a-2c8e80ea60d1\") " pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:33.408924 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.408900 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcjcg" event={"ID":"8f12c1a2-9ea0-43a0-a114-35a089bf2cfd","Type":"ContainerStarted","Data":"6af397a1e6f5295d8be1e3321f262640adf01885e11de34e00e7b7a5e964ad6f"} May 29 10:14:33.409311 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.409146 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wh5rh" May 29 10:14:33.424759 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.424719 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vcjcg" podStartSLOduration=1.282708193 podStartE2EDuration="3.424708072s" podCreationTimestamp="2026-05-29 10:14:30 +0000 UTC" firstStartedPulling="2026-05-29 10:14:30.527089983 +0000 UTC m=+162.238246151" lastFinishedPulling="2026-05-29 10:14:32.669089875 +0000 UTC m=+164.380246030" observedRunningTime="2026-05-29 10:14:33.424024636 +0000 UTC m=+165.135180811" watchObservedRunningTime="2026-05-29 10:14:33.424708072 +0000 UTC m=+165.135864246" May 29 10:14:33.516472 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.516400 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" May 29 10:14:33.622821 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.622792 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:33.638415 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.638388 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t"] May 29 10:14:33.641058 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:33.641029 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde43d725_524d_4771_8e57_f7103e049a34.slice/crio-3d7dd199c829f0ff13566f59113c4cf5bca84daeceeca0dc7660c9a762215b80 WatchSource:0}: Error finding container 3d7dd199c829f0ff13566f59113c4cf5bca84daeceeca0dc7660c9a762215b80: Status 404 returned error can't find the container with id 3d7dd199c829f0ff13566f59113c4cf5bca84daeceeca0dc7660c9a762215b80 May 29 10:14:33.747540 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:33.747510 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d8ffb984-rmmnq"] May 29 10:14:33.750520 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:33.750492 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de611fc_eb70_4b80_b92a_2c8e80ea60d1.slice/crio-e2491d432296b5ea34a07bce51be05edf18a2419630223b54a587f062327ec42 WatchSource:0}: Error finding container e2491d432296b5ea34a07bce51be05edf18a2419630223b54a587f062327ec42: Status 404 returned error can't find the container with id e2491d432296b5ea34a07bce51be05edf18a2419630223b54a587f062327ec42 May 29 10:14:34.413571 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.413531 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" event={"ID":"4de611fc-eb70-4b80-b92a-2c8e80ea60d1","Type":"ContainerStarted","Data":"736fb2e40929bd208c29af3642642b51983434b37cdfb2b957f63f1d80bc1346"} May 29 10:14:34.414001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.413580 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" event={"ID":"4de611fc-eb70-4b80-b92a-2c8e80ea60d1","Type":"ContainerStarted","Data":"e2491d432296b5ea34a07bce51be05edf18a2419630223b54a587f062327ec42"} May 29 10:14:34.414574 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.414537 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" event={"ID":"de43d725-524d-4771-8e57-f7103e049a34","Type":"ContainerStarted","Data":"3d7dd199c829f0ff13566f59113c4cf5bca84daeceeca0dc7660c9a762215b80"} May 29 10:14:34.432271 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.432226 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" podStartSLOduration=33.432213885 podStartE2EDuration="33.432213885s" podCreationTimestamp="2026-05-29 10:14:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:14:34.432060923 +0000 UTC m=+166.143217109" watchObservedRunningTime="2026-05-29 10:14:34.432213885 +0000 UTC m=+166.143370059" May 29 10:14:34.623708 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.623681 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:34.626267 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:34.626246 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:35.418001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.417956 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" event={"ID":"de43d725-524d-4771-8e57-f7103e049a34","Type":"ContainerStarted","Data":"dc6b760e350715f69316b50d25a882bdf98fedea8b2b469b62f6293afbd78af6"} May 29 10:14:35.419211 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.419188 2552 generic.go:358] "Generic (PLEG): container finished" podID="68c3ece6-b906-4592-b433-a239dfa65063" containerID="c443c4915f288b0b3a1d4dbd1c0b7db468180268b3423bf3abc7534183d84540" exitCode=1 May 29 10:14:35.419305 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.419258 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" event={"ID":"68c3ece6-b906-4592-b433-a239dfa65063","Type":"ContainerDied","Data":"c443c4915f288b0b3a1d4dbd1c0b7db468180268b3423bf3abc7534183d84540"} May 29 10:14:35.419453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.419440 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:35.419648 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.419629 2552 scope.go:117] "RemoveContainer" containerID="c443c4915f288b0b3a1d4dbd1c0b7db468180268b3423bf3abc7534183d84540" May 29 10:14:35.420759 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.420741 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69d8ffb984-rmmnq" May 29 10:14:35.431878 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:35.431833 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ltx6t" podStartSLOduration=33.532788759 podStartE2EDuration="34.431821644s" podCreationTimestamp="2026-05-29 10:14:01 +0000 UTC" firstStartedPulling="2026-05-29 10:14:33.642961768 +0000 UTC m=+165.354117922" lastFinishedPulling="2026-05-29 10:14:34.541994651 +0000 UTC m=+166.253150807" observedRunningTime="2026-05-29 10:14:35.431070277 +0000 UTC m=+167.142226462" watchObservedRunningTime="2026-05-29 10:14:35.431821644 +0000 UTC m=+167.142977855" May 29 10:14:36.167104 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:36.167026 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:14:36.423040 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:36.422953 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" event={"ID":"68c3ece6-b906-4592-b433-a239dfa65063","Type":"ContainerStarted","Data":"f88a56ff18dbe2e739291f5bcf4c83a594130fa97da67aff47e42c46251aac50"} May 29 10:14:37.425813 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:37.425779 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:14:37.426388 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:37.426367 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdfd8fcfc-f4zh7" May 29 10:14:39.927798 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:39.927766 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:14:39.929933 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:39.929915 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5kwr\"" May 29 10:14:39.938313 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:39.938295 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d45mq" May 29 10:14:40.041334 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:40.041294 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:40.067435 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:40.067406 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d45mq"] May 29 10:14:40.075073 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:40.075047 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dda671_e10e_48f4_9602_0ab7047dd8cc.slice/crio-00cf1ca79e2f00fc5450881572257b150e6304aa07ba173a3cc2c208b357c4dc WatchSource:0}: Error finding container 00cf1ca79e2f00fc5450881572257b150e6304aa07ba173a3cc2c208b357c4dc: Status 404 returned error can't find the container with id 00cf1ca79e2f00fc5450881572257b150e6304aa07ba173a3cc2c208b357c4dc May 29 10:14:40.434636 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:40.434599 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d45mq" event={"ID":"19dda671-e10e-48f4-9602-0ab7047dd8cc","Type":"ContainerStarted","Data":"00cf1ca79e2f00fc5450881572257b150e6304aa07ba173a3cc2c208b357c4dc"} May 29 10:14:40.927784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:40.927751 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:14:42.441466 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:42.441433 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d45mq" event={"ID":"19dda671-e10e-48f4-9602-0ab7047dd8cc","Type":"ContainerStarted","Data":"ee3177447381a09cff6378b1f7253981e66ffb607686f8777fe66610dc507cad"} May 29 10:14:42.455526 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:42.455483 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d45mq" podStartSLOduration=138.802164637 podStartE2EDuration="2m20.455469402s" podCreationTimestamp="2026-05-29 10:12:22 +0000 UTC" firstStartedPulling="2026-05-29 10:14:40.076961427 +0000 UTC m=+171.788117583" lastFinishedPulling="2026-05-29 10:14:41.730266182 +0000 UTC m=+173.441422348" observedRunningTime="2026-05-29 10:14:42.454918527 +0000 UTC m=+174.166074701" watchObservedRunningTime="2026-05-29 10:14:42.455469402 +0000 UTC m=+174.166625577" May 29 10:14:43.417730 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:43.417700 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wh5rh" May 29 10:14:50.248336 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.248289 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f4njn"] May 29 10:14:50.253131 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.253107 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.254907 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.254886 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sbbw9\"" May 29 10:14:50.255188 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.255156 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 10:14:50.255278 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.255242 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 10:14:50.255559 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.255541 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 10:14:50.255701 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.255631 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 10:14:50.255780 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.255761 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 10:14:50.256069 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.256054 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 10:14:50.382376 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5lgb\" (UniqueName: \"kubernetes.io/projected/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-kube-api-access-s5lgb\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382527 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382382 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-wtmp\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382527 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-textfile\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382527 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382451 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-metrics-client-ca\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382527 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382496 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382527 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382752 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382546 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-root\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382752 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-tls\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.382752 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.382619 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-sys\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483653 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483617 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-sys\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483667 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5lgb\" (UniqueName: \"kubernetes.io/projected/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-kube-api-access-s5lgb\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483698 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-wtmp\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483724 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-textfile\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-sys\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.483803 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483770 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-metrics-client-ca\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484068 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483823 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484068 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483853 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484068 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483893 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-root\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484068 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483917 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-tls\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484253 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.484141 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-textfile\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484253 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.484213 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-root\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484365 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.483892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-wtmp\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484638 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.484600 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-metrics-client-ca\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.484745 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.484698 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.486629 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.486611 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.486813 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.486794 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-node-exporter-tls\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.491744 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.491719 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5lgb\" (UniqueName: \"kubernetes.io/projected/07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210-kube-api-access-s5lgb\") pod \"node-exporter-f4njn\" (UID: \"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210\") " pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.563912 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:50.563888 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4njn" May 29 10:14:50.571924 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:50.571894 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f5f1f1_0e2d_4d42_a8e7_f7a311f9d210.slice/crio-0dc15ef5952a77c2b09011b5160a3d91369a639ff9944de2b46b37f348aa9ab6 WatchSource:0}: Error finding container 0dc15ef5952a77c2b09011b5160a3d91369a639ff9944de2b46b37f348aa9ab6: Status 404 returned error can't find the container with id 0dc15ef5952a77c2b09011b5160a3d91369a639ff9944de2b46b37f348aa9ab6 May 29 10:14:51.469974 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:51.469934 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4njn" event={"ID":"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210","Type":"ContainerStarted","Data":"0dc15ef5952a77c2b09011b5160a3d91369a639ff9944de2b46b37f348aa9ab6"} May 29 10:14:52.409676 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:52.409651 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cdcd9f759-w5hbf" May 29 10:14:52.474073 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:52.474042 2552 generic.go:358] "Generic (PLEG): container finished" podID="07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210" containerID="5fa10a9d3f104d17af6ce1f687c7040f457e4e662c30bf7b8367299aa5ce81c6" exitCode=0 May 29 10:14:52.474455 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:52.474085 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4njn" event={"ID":"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210","Type":"ContainerDied","Data":"5fa10a9d3f104d17af6ce1f687c7040f457e4e662c30bf7b8367299aa5ce81c6"} May 29 10:14:53.478835 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:53.478799 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4njn" event={"ID":"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210","Type":"ContainerStarted","Data":"5848558baec66f8c917666a877252c704f86aea5d1ff41d9c9f44b9f20d7c678"} May 29 10:14:53.478835 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:53.478834 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4njn" event={"ID":"07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210","Type":"ContainerStarted","Data":"8d9d082105b117128bfe5ff2f291608a3cf74b23e38c1485a1fb4c0cf7d21a6d"} May 29 10:14:53.496103 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:53.496061 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f4njn" podStartSLOduration=2.512325132 podStartE2EDuration="3.49604703s" podCreationTimestamp="2026-05-29 10:14:50 +0000 UTC" firstStartedPulling="2026-05-29 10:14:50.573763905 +0000 UTC m=+182.284920056" lastFinishedPulling="2026-05-29 10:14:51.5574858 +0000 UTC m=+183.268641954" observedRunningTime="2026-05-29 10:14:53.494570547 +0000 UTC m=+185.205726721" watchObservedRunningTime="2026-05-29 10:14:53.49604703 +0000 UTC m=+185.207203203" May 29 10:14:55.055314 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.055232 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" podUID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" containerName="registry" containerID="cri-o://566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149" gracePeriod=30 May 29 10:14:55.284630 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.284607 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:55.422636 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422556 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422636 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422593 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422842 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422715 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422842 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422770 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422842 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422809 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b69n\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422995 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422848 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422995 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422889 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.422995 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.422939 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca\") pod \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\" (UID: \"a22e3571-c9da-44a8-87e4-b017dd8c3a5e\") " May 29 10:14:55.423349 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.423265 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:14:55.423792 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.423757 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:14:55.425181 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.425146 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:14:55.425271 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.425217 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:14:55.425271 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.425242 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:14:55.425491 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.425470 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:14:55.425717 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.425695 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n" (OuterVolumeSpecName: "kube-api-access-4b69n") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "kube-api-access-4b69n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:14:55.432059 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.432032 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a22e3571-c9da-44a8-87e4-b017dd8c3a5e" (UID: "a22e3571-c9da-44a8-87e4-b017dd8c3a5e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:14:55.445773 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.445750 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-756b5b7bd-xtrql"] May 29 10:14:55.446023 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.446008 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" containerName="registry" May 29 10:14:55.446082 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.446027 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" containerName="registry" May 29 10:14:55.446131 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.446086 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" containerName="registry" May 29 10:14:55.448930 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.448914 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.450948 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.450926 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 29 10:14:55.451028 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.450932 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 29 10:14:55.451028 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.450995 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 29 10:14:55.451147 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.451024 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 29 10:14:55.451261 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.451245 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 29 10:14:55.451388 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.451372 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gw9ww\"" May 29 10:14:55.456669 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.456645 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 29 10:14:55.463468 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.463447 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756b5b7bd-xtrql"] May 29 10:14:55.484688 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.484661 2552 generic.go:358] "Generic (PLEG): container finished" podID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" containerID="566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149" exitCode=0 May 29 10:14:55.484779 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.484716 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" May 29 10:14:55.484779 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.484746 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" event={"ID":"a22e3571-c9da-44a8-87e4-b017dd8c3a5e","Type":"ContainerDied","Data":"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149"} May 29 10:14:55.484779 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.484777 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b9649f99-sgtcb" event={"ID":"a22e3571-c9da-44a8-87e4-b017dd8c3a5e","Type":"ContainerDied","Data":"310333822e4f2cc434ee5d1797c8e1e897317b0ab1eb26ce1bd7026fabb3177b"} May 29 10:14:55.484893 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.484795 2552 scope.go:117] "RemoveContainer" containerID="566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149" May 29 10:14:55.492567 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.492551 2552 scope.go:117] "RemoveContainer" containerID="566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149" May 29 10:14:55.492910 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:14:55.492881 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149\": container with ID starting with 566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149 not found: ID does not exist" containerID="566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149" May 29 10:14:55.492993 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.492912 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149"} err="failed to get container status \"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149\": rpc error: code = NotFound desc = could not find container \"566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149\": container with ID starting with 566e55f0d039f4e37c4873c358c2c39b3d4212b4bd3aca81333b5f231a320149 not found: ID does not exist" May 29 10:14:55.523618 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523712 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523620 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-metrics-client-ca\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523712 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-serving-certs-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523712 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523712 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxw4\" (UniqueName: \"kubernetes.io/projected/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-kube-api-access-7bxw4\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523905 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523755 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-federate-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523905 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523799 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.523905 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523887 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523924 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-tls\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523934 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-registry-certificates\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523944 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b69n\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-kube-api-access-4b69n\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523962 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-image-registry-private-configuration\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523972 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-ca-trust-extracted\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523982 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-trusted-ca\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523990 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-installation-pull-secrets\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.524013 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.523999 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a22e3571-c9da-44a8-87e4-b017dd8c3a5e-bound-sa-token\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:14:55.527213 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.527193 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:55.531522 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.531503 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8b9649f99-sgtcb"] May 29 10:14:55.624951 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.624930 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625040 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.624969 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625040 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.624999 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-metrics-client-ca\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625040 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625024 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-serving-certs-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625226 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625202 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625347 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625249 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxw4\" (UniqueName: \"kubernetes.io/projected/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-kube-api-access-7bxw4\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625347 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625286 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-federate-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625454 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625349 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625726 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625705 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-serving-certs-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625809 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625762 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-metrics-client-ca\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.625941 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.625921 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.627745 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.627715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-telemeter-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.627829 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.627813 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-federate-client-tls\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.627894 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.627854 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.627964 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.627938 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.633078 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.633060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxw4\" (UniqueName: \"kubernetes.io/projected/2d936d64-d747-4cd4-95f7-4e6d7401ecc1-kube-api-access-7bxw4\") pod \"telemeter-client-756b5b7bd-xtrql\" (UID: \"2d936d64-d747-4cd4-95f7-4e6d7401ecc1\") " pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.759547 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.759477 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" May 29 10:14:55.883529 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:55.883498 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756b5b7bd-xtrql"] May 29 10:14:55.887147 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:55.887118 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d936d64_d747_4cd4_95f7_4e6d7401ecc1.slice/crio-596a0493fa0e8b30f53a85907bf8c6004edd8b15a1ae64e2127d549a2c0dc1d4 WatchSource:0}: Error finding container 596a0493fa0e8b30f53a85907bf8c6004edd8b15a1ae64e2127d549a2c0dc1d4: Status 404 returned error can't find the container with id 596a0493fa0e8b30f53a85907bf8c6004edd8b15a1ae64e2127d549a2c0dc1d4 May 29 10:14:56.489027 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.488991 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:14:56.492771 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.492744 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" event={"ID":"2d936d64-d747-4cd4-95f7-4e6d7401ecc1","Type":"ContainerStarted","Data":"596a0493fa0e8b30f53a85907bf8c6004edd8b15a1ae64e2127d549a2c0dc1d4"} May 29 10:14:56.492928 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.492911 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.495267 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495242 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 10:14:56.495397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495246 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 10:14:56.495397 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495357 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 10:14:56.495518 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495492 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lbzm2\"" May 29 10:14:56.495577 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495527 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 10:14:56.495635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495592 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 10:14:56.495635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495604 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 10:14:56.495913 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495809 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 10:14:56.495913 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.495840 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 10:14:56.496547 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.496305 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 10:14:56.496547 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.496375 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 10:14:56.496547 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.496445 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cibglsqu6maf9\"" May 29 10:14:56.496800 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.496555 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 10:14:56.496800 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.496309 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 10:14:56.498921 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.498903 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 10:14:56.507050 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.507025 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:14:56.634756 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634726 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.634931 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634768 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.634931 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634793 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.634931 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.634931 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.634997 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635031 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635069 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635121 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635109 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635136 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4tt5\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635179 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635195 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.635453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.635301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735708 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735666 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735712 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735748 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735771 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735796 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735818 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.735852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735843 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735868 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735894 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735922 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4tt5\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735963 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.735988 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736016 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736103 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736133 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736163 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736671 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736190 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.736671 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.736216 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.737560 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.737220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.737876 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.737846 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.738482 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.738455 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.739738 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.739686 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.740005 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.739979 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.740746 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.740726 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.741965 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.740954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.741965 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.741250 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.742924 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.742016 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.742924 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.742525 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.742924 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.742602 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.743072 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.742996 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.743638 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.743389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.743638 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.743416 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.743744 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.743635 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.743744 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.743723 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.745119 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.745099 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.751181 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.751164 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4tt5\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5\") pod \"prometheus-k8s-0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.804337 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.804291 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:14:56.932338 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.932297 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a22e3571-c9da-44a8-87e4-b017dd8c3a5e" path="/var/lib/kubelet/pods/a22e3571-c9da-44a8-87e4-b017dd8c3a5e/volumes" May 29 10:14:56.938781 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:56.938753 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:14:56.942226 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:14:56.942198 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcaf325_6b72_44ec_96d2_388058be46e0.slice/crio-ad2346d1ed186dd6dfd1d4c41fc91f17e22d4ec98d988768c23e9332a652bb07 WatchSource:0}: Error finding container ad2346d1ed186dd6dfd1d4c41fc91f17e22d4ec98d988768c23e9332a652bb07: Status 404 returned error can't find the container with id ad2346d1ed186dd6dfd1d4c41fc91f17e22d4ec98d988768c23e9332a652bb07 May 29 10:14:57.494962 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:57.494923 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"ad2346d1ed186dd6dfd1d4c41fc91f17e22d4ec98d988768c23e9332a652bb07"} May 29 10:14:58.498927 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.498842 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" exitCode=0 May 29 10:14:58.499385 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.498927 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} May 29 10:14:58.500798 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.500778 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" event={"ID":"2d936d64-d747-4cd4-95f7-4e6d7401ecc1","Type":"ContainerStarted","Data":"243492f17c8910c2db700d02f4a18ac2a37c8e225265c183dee860c30070392f"} May 29 10:14:58.500887 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.500804 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" event={"ID":"2d936d64-d747-4cd4-95f7-4e6d7401ecc1","Type":"ContainerStarted","Data":"6efeae2c9051b50fb8ec70bf0c479e437971e07143c06880d526a77e83a09b2d"} May 29 10:14:58.500887 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.500813 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" event={"ID":"2d936d64-d747-4cd4-95f7-4e6d7401ecc1","Type":"ContainerStarted","Data":"23fac616d98a9cd1c22e35299576431cf31c917425c32a82d88495414b0669c8"} May 29 10:14:58.554175 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:14:58.554125 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-756b5b7bd-xtrql" podStartSLOduration=1.292357781 podStartE2EDuration="3.554112227s" podCreationTimestamp="2026-05-29 10:14:55 +0000 UTC" firstStartedPulling="2026-05-29 10:14:55.888870917 +0000 UTC m=+187.600027068" lastFinishedPulling="2026-05-29 10:14:58.150625358 +0000 UTC m=+189.861781514" observedRunningTime="2026-05-29 10:14:58.553202233 +0000 UTC m=+190.264358404" watchObservedRunningTime="2026-05-29 10:14:58.554112227 +0000 UTC m=+190.265268401" May 29 10:15:01.511427 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:01.511385 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} May 29 10:15:01.511427 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:01.511428 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} May 29 10:15:03.520588 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:03.520553 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} May 29 10:15:03.520588 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:03.520592 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} May 29 10:15:03.520981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:03.520605 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} May 29 10:15:03.520981 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:03.520614 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerStarted","Data":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} May 29 10:15:03.550901 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:03.550858 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.303149541 podStartE2EDuration="7.550842966s" podCreationTimestamp="2026-05-29 10:14:56 +0000 UTC" firstStartedPulling="2026-05-29 10:14:56.944543743 +0000 UTC m=+188.655699896" lastFinishedPulling="2026-05-29 10:15:03.19223717 +0000 UTC m=+194.903393321" observedRunningTime="2026-05-29 10:15:03.549553175 +0000 UTC m=+195.260709348" watchObservedRunningTime="2026-05-29 10:15:03.550842966 +0000 UTC m=+195.261999170" May 29 10:15:06.804531 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:06.804500 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:15:32.127920 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:32.127890 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d8ffb984-rmmnq_4de611fc-eb70-4b80-b92a-2c8e80ea60d1/router/0.log" May 29 10:15:32.133533 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:32.133504 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d45mq_19dda671-e10e-48f4-9602-0ab7047dd8cc/serve-healthcheck-canary/0.log" May 29 10:15:56.805124 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:56.805075 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:15:56.821213 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:56.821185 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:15:57.687523 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:57.687494 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:15:59.671476 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:59.671440 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:15:59.673926 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:59.673903 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bacb7211-2886-45c3-88b8-c64d8e9a3c8c-metrics-certs\") pod \"network-metrics-daemon-4q98t\" (UID: \"bacb7211-2886-45c3-88b8-c64d8e9a3c8c\") " pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:15:59.830711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:59.830679 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m7vfn\"" May 29 10:15:59.839295 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:59.839270 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4q98t" May 29 10:15:59.986642 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:15:59.986566 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4q98t"] May 29 10:15:59.989797 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:15:59.989769 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacb7211_2886_45c3_88b8_c64d8e9a3c8c.slice/crio-16fab484c015838dd7a73abc0d9350eb40fcaa98550f99fc11ce922fd09895a2 WatchSource:0}: Error finding container 16fab484c015838dd7a73abc0d9350eb40fcaa98550f99fc11ce922fd09895a2: Status 404 returned error can't find the container with id 16fab484c015838dd7a73abc0d9350eb40fcaa98550f99fc11ce922fd09895a2 May 29 10:16:00.681243 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:00.681209 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4q98t" event={"ID":"bacb7211-2886-45c3-88b8-c64d8e9a3c8c","Type":"ContainerStarted","Data":"16fab484c015838dd7a73abc0d9350eb40fcaa98550f99fc11ce922fd09895a2"} May 29 10:16:01.685164 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:01.685127 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4q98t" event={"ID":"bacb7211-2886-45c3-88b8-c64d8e9a3c8c","Type":"ContainerStarted","Data":"7533bc4ad5ef501f3b82a14c41e893815f18368b536afece7051e7640ab1e587"} May 29 10:16:01.685164 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:01.685166 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4q98t" event={"ID":"bacb7211-2886-45c3-88b8-c64d8e9a3c8c","Type":"ContainerStarted","Data":"10ccc426e16bc999c19c81ead4028374ff1e26d51b8e332f6517f77e9ca80069"} May 29 10:16:01.702412 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:01.702366 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4q98t" podStartSLOduration=251.756826963 podStartE2EDuration="4m12.702352354s" podCreationTimestamp="2026-05-29 10:11:49 +0000 UTC" firstStartedPulling="2026-05-29 10:15:59.991682631 +0000 UTC m=+251.702838782" lastFinishedPulling="2026-05-29 10:16:00.937208021 +0000 UTC m=+252.648364173" observedRunningTime="2026-05-29 10:16:01.700050113 +0000 UTC m=+253.411206299" watchObservedRunningTime="2026-05-29 10:16:01.702352354 +0000 UTC m=+253.413508525" May 29 10:16:14.823576 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.823499 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:14.824155 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824098 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="prometheus" containerID="cri-o://789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" gracePeriod=600 May 29 10:16:14.824254 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824133 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="thanos-sidecar" containerID="cri-o://39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" gracePeriod=600 May 29 10:16:14.824254 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824157 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" gracePeriod=600 May 29 10:16:14.824254 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824165 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-web" containerID="cri-o://66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" gracePeriod=600 May 29 10:16:14.824254 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824118 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy" containerID="cri-o://6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" gracePeriod=600 May 29 10:16:14.824254 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:14.824167 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="config-reloader" containerID="cri-o://98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" gracePeriod=600 May 29 10:16:15.066369 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.066346 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.100173 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100099 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.100306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100173 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.100306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100211 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.100306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100231 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.100306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100250 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.100306 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100275 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100650 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100698 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100701 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100748 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100775 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100826 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100856 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100881 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100905 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.100933 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.101635 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.101056 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:16:15.102207 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.101771 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:16:15.102207 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.102187 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.102308 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.102210 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.102308 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.102225 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.102983 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.102955 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.103601 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.103571 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.104763 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.104733 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out" (OuterVolumeSpecName: "config-out") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:16:15.105189 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.105150 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.105558 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.105517 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.105772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.105748 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.106679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.106643 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:16:15.106679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.106671 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config" (OuterVolumeSpecName: "config") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.107526 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.107407 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.108535 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.108489 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.108727 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.108561 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:16:15.118277 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.118251 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config" (OuterVolumeSpecName: "web-config") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 10:16:15.203462 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203438 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.203613 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203467 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.203613 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203486 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4tt5\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5\") pod \"8dcaf325-6b72-44ec-96d2-388058be46e0\" (UID: \"8dcaf325-6b72-44ec-96d2-388058be46e0\") " May 29 10:16:15.203613 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203606 2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-kube-rbac-proxy\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203618 2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203627 2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-grpc-tls\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203635 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-tls-assets\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203644 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203653 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203663 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-config-out\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203672 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203680 2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-config\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203688 2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-metrics-client-certs\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203697 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-web-config\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.203784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203706 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8dcaf325-6b72-44ec-96d2-388058be46e0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.204298 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.203808 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 10:16:15.204521 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.204492 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 10:16:15.205438 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.205416 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5" (OuterVolumeSpecName: "kube-api-access-p4tt5") pod "8dcaf325-6b72-44ec-96d2-388058be46e0" (UID: "8dcaf325-6b72-44ec-96d2-388058be46e0"). InnerVolumeSpecName "kube-api-access-p4tt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 10:16:15.304028 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.303982 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcaf325-6b72-44ec-96d2-388058be46e0-configmap-metrics-client-ca\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.304028 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.304027 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcaf325-6b72-44ec-96d2-388058be46e0-prometheus-k8s-db\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.304028 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.304038 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4tt5\" (UniqueName: \"kubernetes.io/projected/8dcaf325-6b72-44ec-96d2-388058be46e0-kube-api-access-p4tt5\") on node \"ip-10-0-134-110.ec2.internal\" DevicePath \"\"" May 29 10:16:15.725784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725753 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" exitCode=0 May 29 10:16:15.725784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725777 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" exitCode=0 May 29 10:16:15.725784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725783 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" exitCode=0 May 29 10:16:15.725784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725788 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" exitCode=0 May 29 10:16:15.725784 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725793 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" exitCode=0 May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725799 2552 generic.go:358] "Generic (PLEG): container finished" podID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" exitCode=0 May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725847 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725865 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725891 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725903 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725912 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725924 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725933 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725941 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8dcaf325-6b72-44ec-96d2-388058be46e0","Type":"ContainerDied","Data":"ad2346d1ed186dd6dfd1d4c41fc91f17e22d4ec98d988768c23e9332a652bb07"} May 29 10:16:15.726061 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.725957 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.734197 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.734180 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.740922 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.740908 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.747696 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.747670 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.748523 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.748498 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:15.754472 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.754452 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:15.754546 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.754464 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.760487 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.760471 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.766614 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.766598 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.772561 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.772547 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.772811 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.772794 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.772850 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.772820 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.772850 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.772840 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.773064 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.773051 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.773097 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773069 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.773097 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773084 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.773302 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.773286 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.773367 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773308 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.773367 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773338 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.773539 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.773521 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.773604 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773548 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.773604 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773569 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.773803 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.773789 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.773840 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773806 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.773840 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.773818 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.774003 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.773988 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.774041 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774007 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.774041 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774020 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.774193 ip-10-0-134-110 kubenswrapper[2552]: E0529 10:16:15.774178 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.774229 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774198 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.774229 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774212 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.774464 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774447 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.774514 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774464 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.774653 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774638 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.774695 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774652 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.774853 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774835 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.774890 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.774855 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.775076 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775058 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.775149 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775079 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.775290 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775274 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.775407 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775291 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.775535 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775518 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.775583 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775536 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.775744 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775724 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.775785 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775745 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.775943 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775918 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.775986 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.775944 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.776116 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776094 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.776185 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776118 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.776340 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776304 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.776396 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776340 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.776562 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776543 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.776625 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776565 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.776807 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776777 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.776937 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.776808 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.777083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777060 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.777168 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777087 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.777398 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777369 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.777506 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777401 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.777712 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777690 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.777791 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777715 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.777999 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777961 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.777999 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.777983 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.778200 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778183 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:15.778246 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778207 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.778246 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778224 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.778514 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778500 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="thanos-sidecar" May 29 10:16:15.778577 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778507 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.778577 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778532 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.778577 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778516 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="thanos-sidecar" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778588 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="config-reloader" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778595 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="config-reloader" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778602 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-thanos" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778608 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-thanos" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778624 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="init-config-reloader" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778629 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="init-config-reloader" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778636 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="prometheus" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778642 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="prometheus" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778656 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-web" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778661 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-web" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778669 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy" May 29 10:16:15.778711 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778673 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778739 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-thanos" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778748 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="config-reloader" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778755 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="thanos-sidecar" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778761 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778771 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="prometheus" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778781 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" containerName="kube-rbac-proxy-web" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778783 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.778804 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779008 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.779083 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779038 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.779453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779250 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.779453 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779272 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.779561 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779529 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.779599 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779565 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.779805 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779784 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.779880 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.779806 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.780033 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780011 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.780082 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780034 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.780225 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780208 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.780274 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780226 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.780434 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780414 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.780499 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780435 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.780677 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780659 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.780726 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780678 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.780885 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780866 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.780952 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.780887 2552 scope.go:117] "RemoveContainer" containerID="4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057" May 29 10:16:15.781105 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781079 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057"} err="failed to get container status \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": rpc error: code = NotFound desc = could not find container \"4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057\": container with ID starting with 4617a148d5ee7fa43a6993be80f70056f099fba70d0030874cba1dc630061057 not found: ID does not exist" May 29 10:16:15.781154 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781106 2552 scope.go:117] "RemoveContainer" containerID="6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101" May 29 10:16:15.781292 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781276 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101"} err="failed to get container status \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": rpc error: code = NotFound desc = could not find container \"6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101\": container with ID starting with 6282dfd0624a49c0f22135a572450d5135bb50a2a4403b125716f6ae6ba19101 not found: ID does not exist" May 29 10:16:15.781292 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781290 2552 scope.go:117] "RemoveContainer" containerID="66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd" May 29 10:16:15.781517 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781499 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd"} err="failed to get container status \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": rpc error: code = NotFound desc = could not find container \"66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd\": container with ID starting with 66e710024039cbca3cb22016a4649d4518443c6a1a735ddcdeaf4565e828d7dd not found: ID does not exist" May 29 10:16:15.781561 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781518 2552 scope.go:117] "RemoveContainer" containerID="39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e" May 29 10:16:15.781730 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781712 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e"} err="failed to get container status \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": rpc error: code = NotFound desc = could not find container \"39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e\": container with ID starting with 39a13754ee97a6f4129920f745cace899f63a1a072512017fb66e9c54504280e not found: ID does not exist" May 29 10:16:15.781771 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781733 2552 scope.go:117] "RemoveContainer" containerID="98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2" May 29 10:16:15.781946 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781930 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2"} err="failed to get container status \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": rpc error: code = NotFound desc = could not find container \"98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2\": container with ID starting with 98f9eb0357cf6f0e81066821ea1cd31fb0adee75a135ba364955bed6c67fd8f2 not found: ID does not exist" May 29 10:16:15.781991 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.781947 2552 scope.go:117] "RemoveContainer" containerID="789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641" May 29 10:16:15.782172 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.782153 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641"} err="failed to get container status \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": rpc error: code = NotFound desc = could not find container \"789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641\": container with ID starting with 789da53ecb2cfc16fc87670b37ffbf1289dc136ab9921f957f9859480f6b0641 not found: ID does not exist" May 29 10:16:15.782222 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.782174 2552 scope.go:117] "RemoveContainer" containerID="ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325" May 29 10:16:15.782375 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.782360 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.782460 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.782440 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325"} err="failed to get container status \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": rpc error: code = NotFound desc = could not find container \"ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325\": container with ID starting with ea1d6921b43e6506a81151e98425b204af1181df6f88e8b31d1940c420676325 not found: ID does not exist" May 29 10:16:15.784906 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.784888 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 10:16:15.785038 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785022 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 10:16:15.785112 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785064 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 10:16:15.785289 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785274 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 10:16:15.785377 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785359 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 10:16:15.786024 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785881 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 10:16:15.786024 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785894 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lbzm2\"" May 29 10:16:15.786024 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785926 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 10:16:15.786024 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.785964 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cibglsqu6maf9\"" May 29 10:16:15.786349 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.786310 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 10:16:15.786430 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.786362 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 10:16:15.786430 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.786356 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 10:16:15.786568 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.786552 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 10:16:15.793730 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.792689 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 10:16:15.794656 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.793960 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 10:16:15.796883 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.796863 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:15.807433 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807503 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807442 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807503 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807462 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807503 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807641 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807641 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807594 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807641 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807613 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807641 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807632 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807650 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807667 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807729 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807772 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6772f\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-kube-api-access-6772f\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807788 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807867 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.807888 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807885 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.808033 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.807901 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.908746 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908708 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.908746 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908750 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908778 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908914 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908950 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.908981 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909021 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909052 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909083 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909088 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909133 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909178 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909164 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909188 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909224 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909258 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909286 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909339 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909367 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6772f\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-kube-api-access-6772f\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909402 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.909679 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.909628 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.910115 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.910048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.910115 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.910068 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.911511 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.911482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.912683 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.912637 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.913431 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.913386 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.913879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.913680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d211fce-ea10-4270-bf63-4653988d62f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.913879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.913680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.913879 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.913836 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.914067 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.913951 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.914125 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.914107 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.914740 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.914709 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.914811 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.914790 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d211fce-ea10-4270-bf63-4653988d62f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.915160 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.915134 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.915430 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.915378 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.915503 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.915469 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d211fce-ea10-4270-bf63-4653988d62f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:15.917951 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:15.917934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6772f\" (UniqueName: \"kubernetes.io/projected/9d211fce-ea10-4270-bf63-4653988d62f0-kube-api-access-6772f\") pod \"prometheus-k8s-0\" (UID: \"9d211fce-ea10-4270-bf63-4653988d62f0\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:16.092476 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.092449 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:16.221281 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.221177 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 10:16:16.223929 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:16:16.223894 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d211fce_ea10_4270_bf63_4653988d62f0.slice/crio-4968c208c03f6655c9685e21f32d4f30ede938ae28f790026affed8d67b19190 WatchSource:0}: Error finding container 4968c208c03f6655c9685e21f32d4f30ede938ae28f790026affed8d67b19190: Status 404 returned error can't find the container with id 4968c208c03f6655c9685e21f32d4f30ede938ae28f790026affed8d67b19190 May 29 10:16:16.730452 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.730423 2552 generic.go:358] "Generic (PLEG): container finished" podID="9d211fce-ea10-4270-bf63-4653988d62f0" containerID="08cadcc311a41054de0b1216a9b761a1a30ecebe8435e6b31183ecb4e645e122" exitCode=0 May 29 10:16:16.730615 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.730481 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerDied","Data":"08cadcc311a41054de0b1216a9b761a1a30ecebe8435e6b31183ecb4e645e122"} May 29 10:16:16.730615 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.730500 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"4968c208c03f6655c9685e21f32d4f30ede938ae28f790026affed8d67b19190"} May 29 10:16:16.937000 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:16.936925 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcaf325-6b72-44ec-96d2-388058be46e0" path="/var/lib/kubelet/pods/8dcaf325-6b72-44ec-96d2-388058be46e0/volumes" May 29 10:16:17.736300 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736263 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"87b1ca7d27e20ef147a82fdc2832a6bd4b43b64709ca3bd72e8a0546e3cf1fc7"} May 29 10:16:17.736300 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736305 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"eb651ec0da5503e33e119d1f78501be8f4ae5436e66325172565ee0ff7e08518"} May 29 10:16:17.736517 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736316 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"2b285bf2dcaa96015b9f68b666bb1e57f55f69dc767590e3715165fd2b9896c8"} May 29 10:16:17.736517 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736337 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"c977ee9a0d99bf369995ff766ae7c46f1fc05f4f70cea1b6b9db2b738e57af78"} May 29 10:16:17.736517 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736348 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"daacf2ff3571d921f8b538018fc68f0f784ae84622295885f9020eadebbc98d6"} May 29 10:16:17.736517 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.736355 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d211fce-ea10-4270-bf63-4653988d62f0","Type":"ContainerStarted","Data":"9516c8ba34fd7b4ff7f391ff05d222eccccd02956410b513d4391d4f67e68edc"} May 29 10:16:17.764522 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:17.764475 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7644614389999997 podStartE2EDuration="2.764461439s" podCreationTimestamp="2026-05-29 10:16:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:16:17.761775237 +0000 UTC m=+269.472931412" watchObservedRunningTime="2026-05-29 10:16:17.764461439 +0000 UTC m=+269.475617614" May 29 10:16:21.093582 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:21.093549 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:16:48.804823 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:16:48.804798 2552 kubelet.go:1628] "Image garbage collection succeeded" May 29 10:17:04.450150 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.450114 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-c7lrb"] May 29 10:17:04.452358 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.452317 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.454205 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.454176 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 10:17:04.460359 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.460314 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7lrb"] May 29 10:17:04.591913 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.591882 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-kubelet-config\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.592075 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.591938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-dbus\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.592075 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.591990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-original-pull-secret\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.693188 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.693151 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-kubelet-config\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.693292 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.693198 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-dbus\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.693292 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.693226 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-original-pull-secret\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.693292 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.693271 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-kubelet-config\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.693419 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.693409 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-dbus\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.695624 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.695602 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c13ceac-4d3a-4e1b-8879-be492db4fbf3-original-pull-secret\") pod \"global-pull-secret-syncer-c7lrb\" (UID: \"1c13ceac-4d3a-4e1b-8879-be492db4fbf3\") " pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.763623 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.763568 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7lrb" May 29 10:17:04.884665 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.884635 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7lrb"] May 29 10:17:04.887746 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:17:04.887718 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c13ceac_4d3a_4e1b_8879_be492db4fbf3.slice/crio-20a71b70cb30eeed9ab05c48a8503c0fc31cb18155bbc38dd545066886669d7b WatchSource:0}: Error finding container 20a71b70cb30eeed9ab05c48a8503c0fc31cb18155bbc38dd545066886669d7b: Status 404 returned error can't find the container with id 20a71b70cb30eeed9ab05c48a8503c0fc31cb18155bbc38dd545066886669d7b May 29 10:17:04.889126 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:04.889109 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:17:05.876054 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:05.876010 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7lrb" event={"ID":"1c13ceac-4d3a-4e1b-8879-be492db4fbf3","Type":"ContainerStarted","Data":"20a71b70cb30eeed9ab05c48a8503c0fc31cb18155bbc38dd545066886669d7b"} May 29 10:17:09.893087 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:09.893044 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7lrb" event={"ID":"1c13ceac-4d3a-4e1b-8879-be492db4fbf3","Type":"ContainerStarted","Data":"6fefd3f05eb00912f593f56c4a7e085c6aeea54ea377c9bc8389a1077bfb8f2c"} May 29 10:17:09.907456 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:09.907399 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c7lrb" podStartSLOduration=1.714638713 podStartE2EDuration="5.90738117s" podCreationTimestamp="2026-05-29 10:17:04 +0000 UTC" firstStartedPulling="2026-05-29 10:17:04.889234011 +0000 UTC m=+316.600390167" lastFinishedPulling="2026-05-29 10:17:09.081976469 +0000 UTC m=+320.793132624" observedRunningTime="2026-05-29 10:17:09.905950878 +0000 UTC m=+321.617107054" watchObservedRunningTime="2026-05-29 10:17:09.90738117 +0000 UTC m=+321.618537345" May 29 10:17:16.092674 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:16.092633 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:17:16.108701 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:16.108664 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:17:16.930686 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:17:16.930657 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 10:42:19.978993 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:19.978962 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c7lrb_1c13ceac-4d3a-4e1b-8879-be492db4fbf3/global-pull-secret-syncer/0.log" May 29 10:42:20.123481 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:20.123448 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8qk74_4fdc5e8e-d550-498d-8cfb-13774dd48c60/konnectivity-agent/0.log" May 29 10:42:20.186977 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:20.186941 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-110.ec2.internal_7acdff2164b2d1cf2de96438f0aba288/haproxy/0.log" May 29 10:42:23.809248 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:23.809165 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4njn_07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210/node-exporter/0.log" May 29 10:42:23.832492 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:23.832468 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4njn_07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210/kube-rbac-proxy/0.log" May 29 10:42:23.850103 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:23.850076 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4njn_07f5f1f1-0e2d-4d42-a8e7-f7a311f9d210/init-textfile/0.log" May 29 10:42:24.013720 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.013686 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/prometheus/0.log" May 29 10:42:24.030869 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.030845 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/config-reloader/0.log" May 29 10:42:24.049129 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.049109 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/thanos-sidecar/0.log" May 29 10:42:24.068080 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.068027 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/kube-rbac-proxy-web/0.log" May 29 10:42:24.087166 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.087146 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/kube-rbac-proxy/0.log" May 29 10:42:24.104567 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.104547 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/kube-rbac-proxy-thanos/0.log" May 29 10:42:24.122562 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.122543 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d211fce-ea10-4270-bf63-4653988d62f0/init-config-reloader/0.log" May 29 10:42:24.204415 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.204396 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b5b7bd-xtrql_2d936d64-d747-4cd4-95f7-4e6d7401ecc1/telemeter-client/0.log" May 29 10:42:24.224049 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.224033 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b5b7bd-xtrql_2d936d64-d747-4cd4-95f7-4e6d7401ecc1/reload/0.log" May 29 10:42:24.241377 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:24.241357 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b5b7bd-xtrql_2d936d64-d747-4cd4-95f7-4e6d7401ecc1/kube-rbac-proxy/0.log" May 29 10:42:25.478411 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:25.478388 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-ltx6t_de43d725-524d-4771-8e57-f7103e049a34/networking-console-plugin/0.log" May 29 10:42:26.597490 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.597463 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-9szh9_28af9c2d-77e6-4d15-a182-8570fdede8ba/volume-data-source-validator/0.log" May 29 10:42:26.888163 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.888073 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4"] May 29 10:42:26.893478 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.893454 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:26.895462 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.895438 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-swdkv\"/\"openshift-service-ca.crt\"" May 29 10:42:26.895556 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.895464 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-swdkv\"/\"default-dockercfg-97b2m\"" May 29 10:42:26.896525 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.896272 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-swdkv\"/\"kube-root-ca.crt\"" May 29 10:42:26.898020 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.897991 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4"] May 29 10:42:26.951608 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.951568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-podres\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:26.951750 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.951653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-lib-modules\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:26.951750 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.951691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8wx\" (UniqueName: \"kubernetes.io/projected/a794b6d5-b32a-4e24-ad59-7266dcd5863e-kube-api-access-js8wx\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:26.951750 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.951736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-sys\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:26.951852 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:26.951769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-proc\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.052811 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052768 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-podres\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.052811 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052818 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-lib-modules\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052843 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js8wx\" (UniqueName: \"kubernetes.io/projected/a794b6d5-b32a-4e24-ad59-7266dcd5863e-kube-api-access-js8wx\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052863 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-sys\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052881 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-proc\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052944 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-proc\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052943 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-podres\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053001 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.052965 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-sys\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.053220 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.053057 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794b6d5-b32a-4e24-ad59-7266dcd5863e-lib-modules\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.060597 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.060570 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8wx\" (UniqueName: \"kubernetes.io/projected/a794b6d5-b32a-4e24-ad59-7266dcd5863e-kube-api-access-js8wx\") pod \"perf-node-gather-daemonset-sthn4\" (UID: \"a794b6d5-b32a-4e24-ad59-7266dcd5863e\") " pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.204645 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.204571 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:27.224946 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.224918 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wh5rh_8346e92d-a549-4a9a-8ec6-e897ea222e4d/dns/0.log" May 29 10:42:27.242746 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.242719 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wh5rh_8346e92d-a549-4a9a-8ec6-e897ea222e4d/kube-rbac-proxy/0.log" May 29 10:42:27.284130 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.284083 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm424_8814337b-dbb2-4850-8e73-cd1bed592e5c/dns-node-resolver/0.log" May 29 10:42:27.326490 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.326460 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4"] May 29 10:42:27.329479 ip-10-0-134-110 kubenswrapper[2552]: W0529 10:42:27.329449 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda794b6d5_b32a_4e24_ad59_7266dcd5863e.slice/crio-01488f695473a29c36cfd8bab41ac42d6ab5243061c8f6e226e37d59ef19cf67 WatchSource:0}: Error finding container 01488f695473a29c36cfd8bab41ac42d6ab5243061c8f6e226e37d59ef19cf67: Status 404 returned error can't find the container with id 01488f695473a29c36cfd8bab41ac42d6ab5243061c8f6e226e37d59ef19cf67 May 29 10:42:27.330967 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.330947 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 10:42:27.654107 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.654077 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cdcd9f759-w5hbf_6fb8d864-953e-4392-8c28-83730505e69d/registry/0.log" May 29 10:42:27.687443 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:27.687410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tl92t_fd0b0406-7885-4472-8a63-95f9bea8e0a3/node-ca/0.log" May 29 10:42:28.024693 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.024665 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" event={"ID":"a794b6d5-b32a-4e24-ad59-7266dcd5863e","Type":"ContainerStarted","Data":"18a484fca684162db0b2960de877c09bdde75da655c0846df84f724202bbdb06"} May 29 10:42:28.024693 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.024701 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" event={"ID":"a794b6d5-b32a-4e24-ad59-7266dcd5863e","Type":"ContainerStarted","Data":"01488f695473a29c36cfd8bab41ac42d6ab5243061c8f6e226e37d59ef19cf67"} May 29 10:42:28.024891 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.024805 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:28.039006 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.038969 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" podStartSLOduration=2.038958089 podStartE2EDuration="2.038958089s" podCreationTimestamp="2026-05-29 10:42:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 10:42:28.037493889 +0000 UTC m=+1839.748650063" watchObservedRunningTime="2026-05-29 10:42:28.038958089 +0000 UTC m=+1839.750114262" May 29 10:42:28.291762 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.291688 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d8ffb984-rmmnq_4de611fc-eb70-4b80-b92a-2c8e80ea60d1/router/0.log" May 29 10:42:28.563459 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:28.563387 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d45mq_19dda671-e10e-48f4-9602-0ab7047dd8cc/serve-healthcheck-canary/0.log" May 29 10:42:29.002318 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:29.002239 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcjcg_8f12c1a2-9ea0-43a0-a114-35a089bf2cfd/kube-rbac-proxy/0.log" May 29 10:42:29.018116 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:29.018095 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcjcg_8f12c1a2-9ea0-43a0-a114-35a089bf2cfd/exporter/0.log" May 29 10:42:29.033871 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:29.033852 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcjcg_8f12c1a2-9ea0-43a0-a114-35a089bf2cfd/extractor/0.log" May 29 10:42:33.946047 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:33.946016 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/kube-multus-additional-cni-plugins/0.log" May 29 10:42:33.965518 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:33.965495 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/egress-router-binary-copy/0.log" May 29 10:42:33.983970 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:33.983950 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/cni-plugins/0.log" May 29 10:42:34.000916 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.000896 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/bond-cni-plugin/0.log" May 29 10:42:34.017597 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.017578 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/routeoverride-cni/0.log" May 29 10:42:34.035082 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.035066 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/whereabouts-cni-bincopy/0.log" May 29 10:42:34.037551 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.037533 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-swdkv/perf-node-gather-daemonset-sthn4" May 29 10:42:34.053054 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.053036 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sq6mz_5dc796ea-a9da-4d75-8f1e-3174cac39fab/whereabouts-cni/0.log" May 29 10:42:34.078805 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.078781 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jjrgp_8b44b3b3-766c-4a53-9177-3bfd17795d16/kube-multus/0.log" May 29 10:42:34.141633 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.141607 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4q98t_bacb7211-2886-45c3-88b8-c64d8e9a3c8c/network-metrics-daemon/0.log" May 29 10:42:34.157160 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.157139 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4q98t_bacb7211-2886-45c3-88b8-c64d8e9a3c8c/kube-rbac-proxy/0.log" May 29 10:42:34.848086 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.848059 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/ovn-controller/0.log" May 29 10:42:34.872836 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.872808 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/ovn-acl-logging/0.log" May 29 10:42:34.887402 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.887378 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/kube-rbac-proxy-node/0.log" May 29 10:42:34.904208 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.904164 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/kube-rbac-proxy-ovn-metrics/0.log" May 29 10:42:34.918245 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.918228 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/northd/0.log" May 29 10:42:34.934374 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.934352 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/nbdb/0.log" May 29 10:42:34.950163 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:34.950149 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/sbdb/0.log" May 29 10:42:35.037120 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:35.037090 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7bbjr_4eedb6f8-ee72-40d8-9d3f-3a3845e9cbe6/ovnkube-controller/0.log" May 29 10:42:36.546167 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:36.546142 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-87txm_e195077c-6c49-46ac-8614-07ba07d6ffbf/check-endpoints/0.log" May 29 10:42:36.600654 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:36.600594 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wl72q_b3e36f6f-46c9-406e-b7dd-413fa36de661/network-check-target-container/0.log" May 29 10:42:37.401994 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:37.401918 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-svjwr_d46dd1b9-0b38-4d3f-92f6-6e249d6b60ae/iptables-alerter/0.log" May 29 10:42:37.971553 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:37.971523 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-d2zbw_ba685009-27d7-43d0-875d-da65245e4a60/tuned/0.log" May 29 10:42:40.527740 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:40.527710 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-cnrqr_d3244b76-63fb-4192-8da1-708ea4d7ab43/service-ca-controller/0.log" May 29 10:42:40.970289 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:40.970214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sw8s7_6a7d7a81-082c-4f53-a189-335e829c7563/csi-driver/0.log" May 29 10:42:40.992650 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:40.992629 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sw8s7_6a7d7a81-082c-4f53-a189-335e829c7563/csi-node-driver-registrar/0.log" May 29 10:42:41.012752 ip-10-0-134-110 kubenswrapper[2552]: I0529 10:42:41.012730 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sw8s7_6a7d7a81-082c-4f53-a189-335e829c7563/csi-liveness-probe/0.log"