May 21 17:29:39.713847 ip-10-0-139-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 17:29:39.713860 ip-10-0-139-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 17:29:39.713868 ip-10-0-139-73 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 17:29:39.714090 ip-10-0-139-73 systemd[1]: Failed to start Kubernetes Kubelet. May 21 17:29:49.796809 ip-10-0-139-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 17:29:49.796831 ip-10-0-139-73 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a0fb34abc43a4f3eb29f007b229896ec -- May 21 17:32:32.665332 ip-10-0-139-73 systemd[1]: Starting Kubernetes Kubelet... May 21 17:32:33.154656 ip-10-0-139-73 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:33.154656 ip-10-0-139-73 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 17:32:33.154656 ip-10-0-139-73 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:33.154656 ip-10-0-139-73 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 17:32:33.154656 ip-10-0-139-73 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:33.156448 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.156356 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 17:32:33.160225 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160207 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:33.160225 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160224 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160229 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160232 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160237 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160241 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160244 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160248 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160251 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160253 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160256 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160259 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160261 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160264 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160267 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160270 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160272 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160275 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160277 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160280 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160283 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:33.160293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160285 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160288 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160290 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160293 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160296 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160299 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160302 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160308 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160311 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160314 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160316 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160319 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160322 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160324 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160327 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160329 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160332 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160334 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160337 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160340 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:33.160773 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160342 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160345 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160347 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160350 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160352 2568 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160355 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160357 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160360 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160362 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160365 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160367 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160370 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160372 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160377 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160381 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160385 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160388 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160391 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160394 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160396 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:33.161321 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160399 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160401 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160403 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160406 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160409 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160411 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160414 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160416 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160419 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160421 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160424 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160428 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160432 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160435 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160438 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160441 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160444 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160447 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160449 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:33.161832 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160453 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160458 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160462 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160466 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160469 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160471 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160925 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160933 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160937 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160940 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160943 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160946 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160949 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160952 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160954 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160957 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160959 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160962 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160964 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160967 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:33.162304 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160970 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160972 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160975 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160977 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160981 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160984 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160986 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160989 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160992 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160994 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160997 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.160999 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161002 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161005 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161008 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161010 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161013 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161016 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161018 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161021 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:33.162786 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161024 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161026 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161029 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161032 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161034 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161037 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161039 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161041 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161044 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161046 2568 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161049 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161051 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161054 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161059 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161063 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161066 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161068 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161071 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161074 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:33.163307 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161076 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161079 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161081 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161083 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161086 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161090 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161098 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161101 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161104 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161107 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161110 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161112 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161115 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161118 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161121 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161123 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161126 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161129 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161131 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:33.163804 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161135 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161137 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161139 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161142 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161145 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161148 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161150 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161153 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161155 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161157 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161160 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161162 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161165 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161168 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161252 2568 flags.go:64] FLAG: --address="0.0.0.0" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161261 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161272 2568 flags.go:64] FLAG: --anonymous-auth="true" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161278 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161285 2568 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161290 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161294 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 17:32:33.164303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161299 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161303 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161306 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161310 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161313 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161316 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161319 2568 flags.go:64] FLAG: --cgroup-root="" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161322 2568 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161326 2568 flags.go:64] FLAG: --client-ca-file="" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161329 2568 flags.go:64] FLAG: --cloud-config="" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161332 2568 flags.go:64] FLAG: --cloud-provider="external" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161335 2568 flags.go:64] FLAG: --cluster-dns="[]" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161343 2568 flags.go:64] FLAG: --cluster-domain="" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161346 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161349 2568 flags.go:64] FLAG: --config-dir="" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161352 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161355 2568 flags.go:64] FLAG: --container-log-max-files="5" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161359 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161363 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161366 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161369 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161372 2568 flags.go:64] FLAG: --contention-profiling="false" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161376 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161380 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161390 2568 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 17:32:33.164808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161393 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161398 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161401 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161404 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161407 2568 flags.go:64] FLAG: --enable-load-reader="false" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161412 2568 flags.go:64] FLAG: --enable-server="true" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161415 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161420 2568 flags.go:64] FLAG: --event-burst="100" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161423 2568 flags.go:64] FLAG: --event-qps="50" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161426 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161429 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161432 2568 flags.go:64] FLAG: --eviction-hard="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161436 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161440 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161443 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161445 2568 flags.go:64] FLAG: --eviction-soft="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161448 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161451 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161454 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161457 2568 flags.go:64] FLAG: --experimental-mounter-path="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161460 2568 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161464 2568 flags.go:64] FLAG: --fail-swap-on="true" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161467 2568 flags.go:64] FLAG: --feature-gates="" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161471 2568 flags.go:64] FLAG: --file-check-frequency="20s" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161473 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 17:32:33.165430 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161476 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161479 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161482 2568 flags.go:64] FLAG: --healthz-port="10248" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161485 2568 flags.go:64] FLAG: --help="false" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161488 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-139-73.ec2.internal" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161493 2568 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161496 2568 flags.go:64] FLAG: --http-check-frequency="20s" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161499 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161503 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161507 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161510 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161513 2568 flags.go:64] FLAG: --image-service-endpoint="" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161517 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161521 2568 flags.go:64] FLAG: --kube-api-burst="100" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161524 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161527 2568 flags.go:64] FLAG: --kube-api-qps="50" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161530 2568 flags.go:64] FLAG: --kube-reserved="" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161533 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161535 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161538 2568 flags.go:64] FLAG: --kubelet-cgroups="" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161541 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161544 2568 flags.go:64] FLAG: --lock-file="" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161547 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161550 2568 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 17:32:33.166074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161553 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161559 2568 flags.go:64] FLAG: --log-json-split-stream="false" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161562 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161564 2568 flags.go:64] FLAG: --log-text-split-stream="false" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161567 2568 flags.go:64] FLAG: --logging-format="text" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161570 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161574 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161576 2568 flags.go:64] FLAG: --manifest-url="" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161580 2568 flags.go:64] FLAG: --manifest-url-header="" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161584 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161587 2568 flags.go:64] FLAG: --max-open-files="1000000" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161592 2568 flags.go:64] FLAG: --max-pods="110" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161595 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161599 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161602 2568 flags.go:64] FLAG: --memory-manager-policy="None" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161605 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161609 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161612 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161615 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161624 2568 flags.go:64] FLAG: --node-status-max-images="50" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161629 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161632 2568 flags.go:64] FLAG: --oom-score-adj="-999" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161648 2568 flags.go:64] FLAG: --pod-cidr="" May 21 17:32:33.166665 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161651 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161657 2568 flags.go:64] FLAG: --pod-manifest-path="" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161660 2568 flags.go:64] FLAG: --pod-max-pids="-1" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161663 2568 flags.go:64] FLAG: --pods-per-core="0" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161667 2568 flags.go:64] FLAG: --port="10250" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161670 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161673 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-094a449659a2f7045" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161676 2568 flags.go:64] FLAG: --qos-reserved="" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161679 2568 flags.go:64] FLAG: --read-only-port="10255" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161682 2568 flags.go:64] FLAG: --register-node="true" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161685 2568 flags.go:64] FLAG: --register-schedulable="true" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161688 2568 flags.go:64] FLAG: --register-with-taints="" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161692 2568 flags.go:64] FLAG: --registry-burst="10" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161694 2568 flags.go:64] FLAG: --registry-qps="5" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161697 2568 flags.go:64] FLAG: --reserved-cpus="" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161700 2568 flags.go:64] FLAG: --reserved-memory="" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161704 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161707 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161710 2568 flags.go:64] FLAG: --rotate-certificates="false" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161713 2568 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161716 2568 flags.go:64] FLAG: --runonce="false" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161718 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161724 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161727 2568 flags.go:64] FLAG: --seccomp-default="false" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161730 2568 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161732 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 17:32:33.167237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161736 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161739 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161742 2568 flags.go:64] FLAG: --storage-driver-password="root" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161745 2568 flags.go:64] FLAG: --storage-driver-secure="false" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161749 2568 flags.go:64] FLAG: --storage-driver-table="stats" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161752 2568 flags.go:64] FLAG: --storage-driver-user="root" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161755 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161758 2568 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161761 2568 flags.go:64] FLAG: --system-cgroups="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161764 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161770 2568 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161773 2568 flags.go:64] FLAG: --tls-cert-file="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161776 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161780 2568 flags.go:64] FLAG: --tls-min-version="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161783 2568 flags.go:64] FLAG: --tls-private-key-file="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161786 2568 flags.go:64] FLAG: --topology-manager-policy="none" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161789 2568 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161792 2568 flags.go:64] FLAG: --topology-manager-scope="container" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161795 2568 flags.go:64] FLAG: --v="2" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161799 2568 flags.go:64] FLAG: --version="false" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161803 2568 flags.go:64] FLAG: --vmodule="" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161808 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.161811 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161924 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:33.167859 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161929 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161932 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161936 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161940 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161944 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161947 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161950 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161953 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161956 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161959 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161962 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161965 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161968 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161971 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161973 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161976 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161979 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161981 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161984 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:33.168698 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161986 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161989 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161991 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161994 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161996 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.161999 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162001 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162004 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162006 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162009 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162012 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162014 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162017 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162019 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162022 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162024 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162028 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162032 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162034 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162037 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:33.169707 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162040 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162042 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162045 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162061 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162064 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162067 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162069 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162072 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162074 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162077 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162080 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162082 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162085 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162089 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162093 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162096 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162099 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162102 2568 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162105 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:33.170588 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162108 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162110 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162113 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162115 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162118 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162120 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162123 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162125 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162127 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162130 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162134 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162137 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162140 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162143 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162146 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162149 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162151 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162159 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162162 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162165 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:33.171435 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162167 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162170 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162172 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162175 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162177 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162180 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.162182 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.162842 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.170215 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.170240 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170318 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170326 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170331 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170337 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170342 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:33.172020 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170348 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170355 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170361 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170366 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170370 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170375 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170380 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170384 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170388 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170393 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170397 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170401 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170405 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170409 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170413 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170418 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170422 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170426 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170430 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:33.172495 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170435 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170439 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170444 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170448 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170452 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170456 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170481 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170489 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170495 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170500 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170505 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170510 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170514 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170518 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170522 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170527 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170531 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170535 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170540 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170544 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:33.173064 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170548 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170552 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170559 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170566 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170571 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170575 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170580 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170584 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170588 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170593 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170598 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170603 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170607 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170611 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170615 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170620 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170624 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170629 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170633 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:33.173884 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170638 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170643 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170648 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170652 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170656 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170660 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170664 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170669 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170673 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170677 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170681 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170685 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170689 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170693 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170697 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170701 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170705 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170709 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170714 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170718 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:33.174763 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170722 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170727 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170731 2568 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.170739 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170928 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170939 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170945 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170949 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170954 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170959 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170964 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170971 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170980 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170984 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170990 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170994 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:33.175353 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.170998 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171003 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171007 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171011 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171015 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171019 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171023 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171027 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171031 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171035 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171039 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171043 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171047 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171051 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171056 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171063 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171069 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171074 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171078 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:33.175898 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171083 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171088 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171092 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171097 2568 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171101 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171106 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171112 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171117 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171121 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171126 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171132 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171136 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171142 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171146 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171151 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171155 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171159 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171163 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171168 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171172 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:33.176519 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171176 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171180 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171184 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171189 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171193 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171197 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171201 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171205 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171209 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171213 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171217 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171221 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171225 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171230 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171234 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171238 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171242 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171247 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171251 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171255 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:33.177085 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171260 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171265 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171269 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171273 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171277 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171287 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171292 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171296 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171300 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171305 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171309 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171313 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171317 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171321 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:33.171325 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.171334 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:33.177575 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.172166 2568 server.go:962] "Client rotation is on, will bootstrap in background" May 21 17:32:33.178009 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.175496 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 17:32:33.178009 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.176588 2568 server.go:1019] "Starting client certificate rotation" May 21 17:32:33.178009 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.176684 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:32:33.178009 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.177422 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:32:33.204964 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.204932 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:32:33.207971 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.207943 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:32:33.225379 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.225348 2568 log.go:25] "Validated CRI v1 runtime API" May 21 17:32:33.230644 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.230625 2568 log.go:25] "Validated CRI v1 image API" May 21 17:32:33.231935 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.231899 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 17:32:33.236669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.236593 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 887b21e7-d6e5-41f0-b2dd-824f1e8c5d98:/dev/nvme0n1p3 895e674b-8b26-47b4-933a-babed0ad4567:/dev/nvme0n1p4] May 21 17:32:33.236669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.236659 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:32:33.236775 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.236669 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 17:32:33.241243 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.241124 2568 manager.go:217] Machine: {Timestamp:2026-05-21 17:32:33.240571143 +0000 UTC m=+0.439189912 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099513 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2305cc631ce0cd75a66f22d0706ab7 SystemUUID:ec2305cc-631c-e0cd-75a6-6f22d0706ab7 BootID:a0fb34ab-c43a-4f3e-b29f-007b229896ec Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:47:7f:ca:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:47:7f:ca:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:dc:0c:27:75:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 17:32:33.243147 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.243133 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 17:32:33.243284 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.243270 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 17:32:33.245522 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.245475 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 17:32:33.245672 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.245525 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 17:32:33.245724 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.245682 2568 topology_manager.go:138] "Creating topology manager with none policy" May 21 17:32:33.245724 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.245691 2568 container_manager_linux.go:306] "Creating device plugin manager" May 21 17:32:33.245724 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.245698 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:32:33.246525 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.246514 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:32:33.247936 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.247924 2568 state_mem.go:36] "Initialized new in-memory state store" May 21 17:32:33.248068 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.248059 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 17:32:33.250371 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.250359 2568 kubelet.go:491] "Attempting to sync node with API server" May 21 17:32:33.250415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.250376 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 17:32:33.250415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.250389 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 17:32:33.250415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.250399 2568 kubelet.go:397] "Adding apiserver pod source" May 21 17:32:33.250415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.250408 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 17:32:33.251592 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.251577 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:32:33.251641 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.251599 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:32:33.253250 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.253227 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bzbq" May 21 17:32:33.254844 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.254826 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 17:32:33.256801 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.256787 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 17:32:33.257752 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257733 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 17:32:33.257752 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257748 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257754 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257760 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257769 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257775 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257781 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257786 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257795 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257801 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 17:32:33.257828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.257823 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 17:32:33.258109 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.258071 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 17:32:33.259900 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.259886 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 17:32:33.259962 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.259904 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 17:32:33.260230 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.260213 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bzbq" May 21 17:32:33.261726 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.261708 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 17:32:33.261726 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.261717 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 17:32:33.262023 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.261739 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 17:32:33.263992 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.263972 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 17:32:33.264070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.264020 2568 server.go:1295] "Started kubelet" May 21 17:32:33.264160 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.264074 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 17:32:33.264223 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.264133 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 17:32:33.264223 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.264203 2568 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 17:32:33.264710 ip-10-0-139-73 systemd[1]: Started Kubernetes Kubelet. May 21 17:32:33.265358 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.265167 2568 server.go:317] "Adding debug handlers to kubelet server" May 21 17:32:33.268065 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.268048 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 17:32:33.273162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.273138 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 17:32:33.273718 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.273705 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 17:32:33.273884 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.273868 2568 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 17:32:33.273884 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.273882 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 17:32:33.274001 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.273986 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 17:32:33.274080 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274060 2568 reconstruct.go:97] "Volume reconstruction finished" May 21 17:32:33.274080 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274072 2568 reconciler.go:26] "Reconciler: start to sync state" May 21 17:32:33.274495 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274478 2568 factory.go:55] Registering systemd factory May 21 17:32:33.274563 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274500 2568 factory.go:223] Registration of the systemd container factory successfully May 21 17:32:33.274563 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.274521 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 17:32:33.274711 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.274696 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.274758 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274704 2568 factory.go:153] Registering CRI-O factory May 21 17:32:33.274758 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274724 2568 factory.go:223] Registration of the crio container factory successfully May 21 17:32:33.274815 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274806 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 17:32:33.274846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274823 2568 factory.go:103] Registering Raw factory May 21 17:32:33.274846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.274833 2568 manager.go:1196] Started watching for new ooms in manager May 21 17:32:33.275364 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.275251 2568 manager.go:319] Starting recovery of all containers May 21 17:32:33.280341 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.280313 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:33.282513 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.282489 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-73.ec2.internal\" not found" node="ip-10-0-139-73.ec2.internal" May 21 17:32:33.283417 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.283383 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 17:32:33.284116 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.284101 2568 manager.go:324] Recovery completed May 21 17:32:33.290454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.290441 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.292871 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.292854 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.292982 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.292882 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.292982 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.292893 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.293465 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.293451 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 17:32:33.293465 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.293463 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 17:32:33.293551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.293483 2568 state_mem.go:36] "Initialized new in-memory state store" May 21 17:32:33.295956 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.295945 2568 policy_none.go:49] "None policy: Start" May 21 17:32:33.295992 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.295961 2568 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 17:32:33.295992 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.295971 2568 state_mem.go:35] "Initializing new in-memory state store" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.336806 2568 manager.go:341] "Starting Device Plugin manager" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.336837 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.336847 2568 server.go:85] "Starting device plugin registration server" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.337128 2568 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.337142 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.337283 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.337392 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.337401 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.337936 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 17:32:33.351690 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.337974 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.431704 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.431630 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 17:32:33.431704 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.431662 2568 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 17:32:33.431704 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.431684 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 17:32:33.431704 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.431692 2568 kubelet.go:2451] "Starting kubelet main sync loop" May 21 17:32:33.431989 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.431737 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 17:32:33.436488 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.436459 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:33.437480 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.437465 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.438785 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.438767 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.438866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.438801 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.438866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.438813 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.438866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.438836 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-73.ec2.internal" May 21 17:32:33.447471 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.447452 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-73.ec2.internal" May 21 17:32:33.447537 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.447480 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-73.ec2.internal\": node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.460105 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.460082 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.532175 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.532134 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal"] May 21 17:32:33.532268 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.532239 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.533315 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.533299 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.533365 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.533328 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.533365 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.533339 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.534699 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.534687 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.534873 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.534859 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.534925 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.534887 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.535455 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535436 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.535455 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535453 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.535604 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535467 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.535604 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535475 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.535604 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535480 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.535604 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.535485 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.536627 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.536613 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:33.536677 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.536639 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:33.537446 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.537429 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:33.537522 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.537460 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:33.537522 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.537483 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:33.560207 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.560179 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.569803 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.569780 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-73.ec2.internal\" not found" node="ip-10-0-139-73.ec2.internal" May 21 17:32:33.574419 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.574398 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-73.ec2.internal\" not found" node="ip-10-0-139-73.ec2.internal" May 21 17:32:33.575391 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.575373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a33f18e40315f11e89b9080e4b2917f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-73.ec2.internal\" (UID: \"0a33f18e40315f11e89b9080e4b2917f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:33.575451 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.575400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.575451 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.575419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.660893 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.660839 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.676223 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676190 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a33f18e40315f11e89b9080e4b2917f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-73.ec2.internal\" (UID: \"0a33f18e40315f11e89b9080e4b2917f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:33.676223 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676225 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.676404 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676250 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.676404 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676294 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a33f18e40315f11e89b9080e4b2917f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-73.ec2.internal\" (UID: \"0a33f18e40315f11e89b9080e4b2917f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:33.676404 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.676404 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.676327 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12914dd05933086c1cd221c73887ab2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal\" (UID: \"b12914dd05933086c1cd221c73887ab2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.761609 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.761531 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.862026 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.861988 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:33.872162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.872134 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:33.877057 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:33.877040 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:33.962788 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:33.962740 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.063268 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:34.063237 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.163764 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:34.163731 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.177066 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.177034 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 17:32:34.177210 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.177193 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:32:34.177260 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.177224 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:32:34.261866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.261826 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 17:27:33 +0000 UTC" deadline="2028-02-26 16:58:16.207083796 +0000 UTC" May 21 17:32:34.261866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.261859 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15503h25m41.945226889s" May 21 17:32:34.264632 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:34.264604 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.273513 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.273490 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 17:32:34.284366 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.284345 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:32:34.303627 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.303586 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xt6z" May 21 17:32:34.311048 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.311028 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xt6z" May 21 17:32:34.328293 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:34.328262 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a33f18e40315f11e89b9080e4b2917f.slice/crio-631f5622c03df59a5cf1a78480d599b65cdcf832ecfc29001fe4262b0d27a54c WatchSource:0}: Error finding container 631f5622c03df59a5cf1a78480d599b65cdcf832ecfc29001fe4262b0d27a54c: Status 404 returned error can't find the container with id 631f5622c03df59a5cf1a78480d599b65cdcf832ecfc29001fe4262b0d27a54c May 21 17:32:34.328730 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:34.328716 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12914dd05933086c1cd221c73887ab2.slice/crio-d0128599fdb40c464f1e02dd4c17938fa5721934ee169184691155d2f816e469 WatchSource:0}: Error finding container d0128599fdb40c464f1e02dd4c17938fa5721934ee169184691155d2f816e469: Status 404 returned error can't find the container with id d0128599fdb40c464f1e02dd4c17938fa5721934ee169184691155d2f816e469 May 21 17:32:34.331964 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.331945 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:32:34.365256 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:34.365212 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.434538 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.434491 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" event={"ID":"b12914dd05933086c1cd221c73887ab2","Type":"ContainerStarted","Data":"d0128599fdb40c464f1e02dd4c17938fa5721934ee169184691155d2f816e469"} May 21 17:32:34.435342 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.435309 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" event={"ID":"0a33f18e40315f11e89b9080e4b2917f","Type":"ContainerStarted","Data":"631f5622c03df59a5cf1a78480d599b65cdcf832ecfc29001fe4262b0d27a54c"} May 21 17:32:34.465595 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:34.465552 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-73.ec2.internal\" not found" May 21 17:32:34.500397 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.500372 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:34.517816 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.517786 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:34.575003 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.574905 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" May 21 17:32:34.586481 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.586456 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:32:34.587510 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.587494 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" May 21 17:32:34.595452 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:34.595434 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:32:35.159972 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.159940 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:35.252248 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.252216 2568 apiserver.go:52] "Watching apiserver" May 21 17:32:35.260363 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.260336 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 17:32:35.261700 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.261668 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-nqxms","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k","openshift-multus/multus-additional-cni-plugins-tmvf9","openshift-multus/network-metrics-daemon-9km89","openshift-network-diagnostics/network-check-target-546lq","openshift-ovn-kubernetes/ovnkube-node-2vwrc","kube-system/konnectivity-agent-sbcwc","kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal","openshift-cluster-node-tuning-operator/tuned-glz67","openshift-image-registry/node-ca-hr4db","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal","openshift-multus/multus-rwcwp"] May 21 17:32:35.263962 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.263940 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.265663 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.265644 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.266188 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.266170 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gzd5v\"" May 21 17:32:35.266286 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.266167 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 17:32:35.266286 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.266171 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 17:32:35.266286 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.266171 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 17:32:35.267063 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.267042 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.267926 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.267854 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vhxn\"" May 21 17:32:35.267926 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.267874 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 17:32:35.268075 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.268032 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 17:32:35.268529 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.268366 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 17:32:35.269090 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.268873 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.269090 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.268962 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:35.269090 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.268984 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhg8x\"" May 21 17:32:35.269310 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.269142 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 17:32:35.269310 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.269153 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 17:32:35.269310 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.269162 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 17:32:35.269310 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.269223 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 17:32:35.269802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.269785 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 17:32:35.270240 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.270220 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:35.270342 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.270286 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:35.271642 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.271623 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.272859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.272841 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.273516 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273498 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t9dz4\"" May 21 17:32:35.273617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273571 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 17:32:35.273679 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273661 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 17:32:35.273828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273790 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 17:32:35.274093 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273948 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 17:32:35.274093 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.273953 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 17:32:35.274258 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.274200 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 17:32:35.274258 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.274229 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.274794 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.274755 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7p5mb\"" May 21 17:32:35.275062 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.275044 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 17:32:35.275135 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.275074 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 17:32:35.275517 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.275482 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.276308 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.276289 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bbcz\"" May 21 17:32:35.276679 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.276590 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 17:32:35.276679 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.276658 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rwcwp" May 21 17:32:35.276830 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.276790 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 17:32:35.277547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.277527 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 17:32:35.277547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.277541 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 17:32:35.277723 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.277631 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltkqm\"" May 21 17:32:35.278031 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.277969 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 17:32:35.278524 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.278501 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tjtbf\"" May 21 17:32:35.279015 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.278996 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 17:32:35.285205 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-sys\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285301 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-modprobe-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285301 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-tmp\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285423 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c584c61-7539-4017-b452-08359175abbc-iptables-alerter-script\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.285423 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-etc-selinux\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.285423 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-bin\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.285571 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285423 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-os-release\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.285571 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285571 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-var-lib-kubelet\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285571 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26hs\" (UniqueName: \"kubernetes.io/projected/993bd913-60ad-4cff-b80b-37d1195a0c9b-kube-api-access-d26hs\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-sys-fs\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-kubelet\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-ovn\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285688 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmlf\" (UniqueName: \"kubernetes.io/projected/4b69b81d-a157-4276-98e6-3a830cde5ec9-kube-api-access-stmlf\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-etc-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.285763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlj97\" (UniqueName: \"kubernetes.io/projected/ae0d6acd-4132-4403-b00d-d0b6c896c222-kube-api-access-nlj97\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b488979-2260-40ad-b845-0b4a44f214fc-agent-certs\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94aca6d5-e843-4039-83e1-bbf0638799cd-host\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-run\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysconfig\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-conf\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.285986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94aca6d5-e843-4039-83e1-bbf0638799cd-serviceca\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.286043 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqqpm\" (UniqueName: \"kubernetes.io/projected/94aca6d5-e843-4039-83e1-bbf0638799cd-kube-api-access-gqqpm\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cnibin\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jh2\" (UniqueName: \"kubernetes.io/projected/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-kube-api-access-s6jh2\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-systemd\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286148 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-tuned\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-device-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-host\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-node-log\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-log-socket\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovn-node-metrics-cert\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c584c61-7539-4017-b452-08359175abbc-host-slash\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-systemd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286477 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-netd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd8rh\" (UniqueName: \"kubernetes.io/projected/9c584c61-7539-4017-b452-08359175abbc-kube-api-access-jd8rh\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-config\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-registration-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-netns\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-systemd-units\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-kubernetes\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-lib-modules\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-slash\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b488979-2260-40ad-b845-0b4a44f214fc-konnectivity-ca\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.286896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.287627 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.286891 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-env-overrides\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.288121 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.287997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-script-lib\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.288121 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.288053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-system-cni-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.288235 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.288117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.288235 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.288170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jqx\" (UniqueName: \"kubernetes.io/projected/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-kube-api-access-76jqx\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.288235 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.288219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-socket-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.288367 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.288254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-var-lib-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.311840 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.311810 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:34 +0000 UTC" deadline="2027-12-05 01:56:36.905395011 +0000 UTC" May 21 17:32:35.311840 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.311839 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13496h24m1.593559863s" May 21 17:32:35.374957 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.374930 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 17:32:35.390271 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390214 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.390271 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390262 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-env-overrides\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.390483 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390287 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-script-lib\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.390483 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-system-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.390577 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-cnibin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.390577 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-k8s-cni-cncf-io\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.390670 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-multus\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.390670 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390654 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-system-cni-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.390771 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390710 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.390771 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390741 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76jqx\" (UniqueName: \"kubernetes.io/projected/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-kube-api-access-76jqx\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.390771 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390749 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-system-cni-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390770 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-socket-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390797 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-var-lib-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390820 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-sys\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390866 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-modprobe-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390891 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-tmp\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390929 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c584c61-7539-4017-b452-08359175abbc-iptables-alerter-script\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390952 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-etc-selinux\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.390975 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-bin\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391000 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-env-overrides\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391021 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-script-lib\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-cni-binary-copy\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-netns\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-multus-daemon-config\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-sys\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391128 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-os-release\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-modprobe-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-bin\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391152 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-var-lib-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391189 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-os-release\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-socket-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391219 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-var-lib-kubelet\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391248 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d26hs\" (UniqueName: \"kubernetes.io/projected/993bd913-60ad-4cff-b80b-37d1195a0c9b-kube-api-access-d26hs\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391265 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-sys-fs\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.391416 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-var-lib-kubelet\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391267 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-etc-selinux\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-sys-fs\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-d\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391412 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-kubelet\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391438 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-ovn\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-kubelet\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391432 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391465 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stmlf\" (UniqueName: \"kubernetes.io/projected/4b69b81d-a157-4276-98e6-3a830cde5ec9-kube-api-access-stmlf\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-ovn\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391502 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-etc-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-bin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391574 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c584c61-7539-4017-b452-08359175abbc-iptables-alerter-script\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391579 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj97\" (UniqueName: \"kubernetes.io/projected/ae0d6acd-4132-4403-b00d-d0b6c896c222-kube-api-access-nlj97\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391626 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b488979-2260-40ad-b845-0b4a44f214fc-agent-certs\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-etc-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392139 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-multus-certs\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391695 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94aca6d5-e843-4039-83e1-bbf0638799cd-host\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391725 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-run\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391777 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391781 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94aca6d5-e843-4039-83e1-bbf0638799cd-host\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391803 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysconfig\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391809 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-run\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391827 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-conf\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391851 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysconfig\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-openvswitch\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-kubelet\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391897 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-hostroot\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391954 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94aca6d5-e843-4039-83e1-bbf0638799cd-serviceca\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391953 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-sysctl-conf\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.391970 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqqpm\" (UniqueName: \"kubernetes.io/projected/94aca6d5-e843-4039-83e1-bbf0638799cd-kube-api-access-gqqpm\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392001 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cnibin\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.392869 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392032 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jh2\" (UniqueName: \"kubernetes.io/projected/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-kube-api-access-s6jh2\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392058 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-systemd\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392082 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-tuned\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cnibin\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392106 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392143 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-device-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392167 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-host\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392190 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-node-log\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392190 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-systemd\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392219 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392328 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-log-socket\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-device-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392367 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-log-socket\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-host\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392402 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392439 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-node-log\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.393721 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392437 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovn-node-metrics-cert\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-conf-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392517 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392541 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c584c61-7539-4017-b452-08359175abbc-host-slash\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392565 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-systemd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392586 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-netd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392607 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd8rh\" (UniqueName: \"kubernetes.io/projected/9c584c61-7539-4017-b452-08359175abbc-kube-api-access-jd8rh\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392628 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-config\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-etc-kubernetes\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392672 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392680 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392736 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392747 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94aca6d5-e843-4039-83e1-bbf0638799cd-serviceca\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392763 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-registration-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392788 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-netns\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392814 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-cni-netd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.394535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkggw\" (UniqueName: \"kubernetes.io/projected/4a61f9c6-c394-430b-b635-70b688cfd136-kube-api-access-tkggw\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c584c61-7539-4017-b452-08359175abbc-host-slash\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392861 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-systemd-units\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392896 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-run-systemd\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-os-release\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392955 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-socket-dir-parent\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.392981 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-kubernetes\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393006 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-lib-modules\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393034 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-slash\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393061 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b488979-2260-40ad-b845-0b4a44f214fc-konnectivity-ca\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393200 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-systemd-units\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-run-netns\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.393314 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.393403 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:35.893362678 +0000 UTC m=+3.091981455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovnkube-config\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393454 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae0d6acd-4132-4403-b00d-d0b6c896c222-registration-dir\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393506 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-kubernetes\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393593 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b488979-2260-40ad-b845-0b4a44f214fc-konnectivity-ca\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393600 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b69b81d-a157-4276-98e6-3a830cde5ec9-host-slash\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.393599 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/993bd913-60ad-4cff-b80b-37d1195a0c9b-lib-modules\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.394762 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-tmp\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.395084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/993bd913-60ad-4cff-b80b-37d1195a0c9b-etc-tuned\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.395173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b69b81d-a157-4276-98e6-3a830cde5ec9-ovn-node-metrics-cert\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.395703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.395247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b488979-2260-40ad-b845-0b4a44f214fc-agent-certs\") pod \"konnectivity-agent-sbcwc\" (UID: \"1b488979-2260-40ad-b845-0b4a44f214fc\") " pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.399009 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.398985 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:35.399135 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.399011 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:35.399135 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.399027 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:35.399135 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.399083 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:35.899065816 +0000 UTC m=+3.097684589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:35.399314 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.399209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jqx\" (UniqueName: \"kubernetes.io/projected/2c5a13f8-caeb-445f-a0b0-12b2429d27fa-kube-api-access-76jqx\") pod \"multus-additional-cni-plugins-tmvf9\" (UID: \"2c5a13f8-caeb-445f-a0b0-12b2429d27fa\") " pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.399868 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.399838 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26hs\" (UniqueName: \"kubernetes.io/projected/993bd913-60ad-4cff-b80b-37d1195a0c9b-kube-api-access-d26hs\") pod \"tuned-glz67\" (UID: \"993bd913-60ad-4cff-b80b-37d1195a0c9b\") " pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.400199 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.400176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jh2\" (UniqueName: \"kubernetes.io/projected/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-kube-api-access-s6jh2\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.400328 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.400307 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlj97\" (UniqueName: \"kubernetes.io/projected/ae0d6acd-4132-4403-b00d-d0b6c896c222-kube-api-access-nlj97\") pod \"aws-ebs-csi-driver-node-58n9k\" (UID: \"ae0d6acd-4132-4403-b00d-d0b6c896c222\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.400395 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.400369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmlf\" (UniqueName: \"kubernetes.io/projected/4b69b81d-a157-4276-98e6-3a830cde5ec9-kube-api-access-stmlf\") pod \"ovnkube-node-2vwrc\" (UID: \"4b69b81d-a157-4276-98e6-3a830cde5ec9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.400991 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.400966 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd8rh\" (UniqueName: \"kubernetes.io/projected/9c584c61-7539-4017-b452-08359175abbc-kube-api-access-jd8rh\") pod \"iptables-alerter-nqxms\" (UID: \"9c584c61-7539-4017-b452-08359175abbc\") " pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.401278 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.401260 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqqpm\" (UniqueName: \"kubernetes.io/projected/94aca6d5-e843-4039-83e1-bbf0638799cd-kube-api-access-gqqpm\") pod \"node-ca-hr4db\" (UID: \"94aca6d5-e843-4039-83e1-bbf0638799cd\") " pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.494351 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494259 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-etc-kubernetes\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494351 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494330 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkggw\" (UniqueName: \"kubernetes.io/projected/4a61f9c6-c394-430b-b635-70b688cfd136-kube-api-access-tkggw\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494364 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-os-release\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494389 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-socket-dir-parent\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494328 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-etc-kubernetes\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494414 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-system-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494439 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-cnibin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494461 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-k8s-cni-cncf-io\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494483 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-multus\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-os-release\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-socket-dir-parent\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494500 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-system-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494515 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-cni-binary-copy\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494534 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-cnibin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-netns\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.494549 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494554 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-multus\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494567 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-multus-daemon-config\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-k8s-cni-cncf-io\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494600 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-bin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494625 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-multus-certs\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-netns\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494650 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-kubelet\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494674 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-hostroot\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494680 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-cni-bin\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494706 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494726 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-run-multus-certs\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494730 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-conf-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494768 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-hostroot\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494787 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-conf-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494811 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-host-var-lib-kubelet\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.494836 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a61f9c6-c394-430b-b635-70b688cfd136-multus-cni-dir\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.495111 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-multus-daemon-config\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.495162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.495111 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a61f9c6-c394-430b-b635-70b688cfd136-cni-binary-copy\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.502633 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.502603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkggw\" (UniqueName: \"kubernetes.io/projected/4a61f9c6-c394-430b-b635-70b688cfd136-kube-api-access-tkggw\") pod \"multus-rwcwp\" (UID: \"4a61f9c6-c394-430b-b635-70b688cfd136\") " pod="openshift-multus/multus-rwcwp" May 21 17:32:35.577542 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.577503 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqxms" May 21 17:32:35.585190 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.585165 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" May 21 17:32:35.592711 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.592683 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" May 21 17:32:35.598646 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.598618 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:35.604302 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.604279 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:35.611132 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.611106 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glz67" May 21 17:32:35.612004 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.611978 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:35.619857 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.619831 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr4db" May 21 17:32:35.625510 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.625485 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rwcwp" May 21 17:32:35.897772 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.897745 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:35.897942 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.897872 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:35.897942 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.897941 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:36.897924747 +0000 UTC m=+4.096543506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:35.917351 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.917198 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c584c61_7539_4017_b452_08359175abbc.slice/crio-adc031181f04adbac2c18d9b606edb31768c595c8c8fb20a6016e25e6f31cacc WatchSource:0}: Error finding container adc031181f04adbac2c18d9b606edb31768c595c8c8fb20a6016e25e6f31cacc: Status 404 returned error can't find the container with id adc031181f04adbac2c18d9b606edb31768c595c8c8fb20a6016e25e6f31cacc May 21 17:32:35.918975 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.918946 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5a13f8_caeb_445f_a0b0_12b2429d27fa.slice/crio-99cdc587fbc2228f3014fc837a40426e879c7ba7c8e60b11a8a808ba5f282ed8 WatchSource:0}: Error finding container 99cdc587fbc2228f3014fc837a40426e879c7ba7c8e60b11a8a808ba5f282ed8: Status 404 returned error can't find the container with id 99cdc587fbc2228f3014fc837a40426e879c7ba7c8e60b11a8a808ba5f282ed8 May 21 17:32:35.921526 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.921466 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b488979_2260_40ad_b845_0b4a44f214fc.slice/crio-0b3de56118b3717a7fba711c95b03bc81abf6d2a53df7f285cd0be5857b66ce6 WatchSource:0}: Error finding container 0b3de56118b3717a7fba711c95b03bc81abf6d2a53df7f285cd0be5857b66ce6: Status 404 returned error can't find the container with id 0b3de56118b3717a7fba711c95b03bc81abf6d2a53df7f285cd0be5857b66ce6 May 21 17:32:35.922361 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.922329 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993bd913_60ad_4cff_b80b_37d1195a0c9b.slice/crio-f08fef4525a0eff43500271a2ac14315c45b3dbc38cda063c5b6fcab73f783fb WatchSource:0}: Error finding container f08fef4525a0eff43500271a2ac14315c45b3dbc38cda063c5b6fcab73f783fb: Status 404 returned error can't find the container with id f08fef4525a0eff43500271a2ac14315c45b3dbc38cda063c5b6fcab73f783fb May 21 17:32:35.924037 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.924011 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94aca6d5_e843_4039_83e1_bbf0638799cd.slice/crio-f8639a7a2f9f78222acb6135a48c1035b3962e4dcc5992410fe120fb2cd35a4d WatchSource:0}: Error finding container f8639a7a2f9f78222acb6135a48c1035b3962e4dcc5992410fe120fb2cd35a4d: Status 404 returned error can't find the container with id f8639a7a2f9f78222acb6135a48c1035b3962e4dcc5992410fe120fb2cd35a4d May 21 17:32:35.925242 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.924859 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0d6acd_4132_4403_b00d_d0b6c896c222.slice/crio-4dd051ca41a17f920978c0a5719fff5f184fb27ab71cb547fb12898f7cb24064 WatchSource:0}: Error finding container 4dd051ca41a17f920978c0a5719fff5f184fb27ab71cb547fb12898f7cb24064: Status 404 returned error can't find the container with id 4dd051ca41a17f920978c0a5719fff5f184fb27ab71cb547fb12898f7cb24064 May 21 17:32:35.925775 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.925577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b69b81d_a157_4276_98e6_3a830cde5ec9.slice/crio-b811f2afad4873feb3cf690b5bb29f8a933c184fefb048ce4879d4e3712a65d5 WatchSource:0}: Error finding container b811f2afad4873feb3cf690b5bb29f8a933c184fefb048ce4879d4e3712a65d5: Status 404 returned error can't find the container with id b811f2afad4873feb3cf690b5bb29f8a933c184fefb048ce4879d4e3712a65d5 May 21 17:32:35.927650 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:35.927627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a61f9c6_c394_430b_b635_70b688cfd136.slice/crio-9cd61a86ffb098263ececa8a7ebae621cc5e52450c6a1e71b33f0aee330c95bf WatchSource:0}: Error finding container 9cd61a86ffb098263ececa8a7ebae621cc5e52450c6a1e71b33f0aee330c95bf: Status 404 returned error can't find the container with id 9cd61a86ffb098263ececa8a7ebae621cc5e52450c6a1e71b33f0aee330c95bf May 21 17:32:35.999019 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:35.998993 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:35.999150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.999103 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:35.999150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.999123 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:35.999150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.999133 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:35.999247 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:35.999181 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:36.99916663 +0000 UTC m=+4.197785388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:36.312722 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.312638 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:34 +0000 UTC" deadline="2028-02-12 00:37:22.09065927 +0000 UTC" May 21 17:32:36.312722 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.312676 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15151h4m45.777986488s" May 21 17:32:36.432027 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.431940 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:36.432196 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:36.432102 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:36.440409 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.440347 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr4db" event={"ID":"94aca6d5-e843-4039-83e1-bbf0638799cd","Type":"ContainerStarted","Data":"f8639a7a2f9f78222acb6135a48c1035b3962e4dcc5992410fe120fb2cd35a4d"} May 21 17:32:36.443779 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.443749 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glz67" event={"ID":"993bd913-60ad-4cff-b80b-37d1195a0c9b","Type":"ContainerStarted","Data":"f08fef4525a0eff43500271a2ac14315c45b3dbc38cda063c5b6fcab73f783fb"} May 21 17:32:36.450332 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.450296 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rwcwp" event={"ID":"4a61f9c6-c394-430b-b635-70b688cfd136","Type":"ContainerStarted","Data":"9cd61a86ffb098263ececa8a7ebae621cc5e52450c6a1e71b33f0aee330c95bf"} May 21 17:32:36.454133 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.454100 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"b811f2afad4873feb3cf690b5bb29f8a933c184fefb048ce4879d4e3712a65d5"} May 21 17:32:36.456186 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.456143 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" event={"ID":"ae0d6acd-4132-4403-b00d-d0b6c896c222","Type":"ContainerStarted","Data":"4dd051ca41a17f920978c0a5719fff5f184fb27ab71cb547fb12898f7cb24064"} May 21 17:32:36.462793 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.462758 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sbcwc" event={"ID":"1b488979-2260-40ad-b845-0b4a44f214fc","Type":"ContainerStarted","Data":"0b3de56118b3717a7fba711c95b03bc81abf6d2a53df7f285cd0be5857b66ce6"} May 21 17:32:36.470041 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.469999 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerStarted","Data":"99cdc587fbc2228f3014fc837a40426e879c7ba7c8e60b11a8a808ba5f282ed8"} May 21 17:32:36.472686 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.472656 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqxms" event={"ID":"9c584c61-7539-4017-b452-08359175abbc","Type":"ContainerStarted","Data":"adc031181f04adbac2c18d9b606edb31768c595c8c8fb20a6016e25e6f31cacc"} May 21 17:32:36.476561 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.476534 2568 generic.go:358] "Generic (PLEG): container finished" podID="b12914dd05933086c1cd221c73887ab2" containerID="3b147062b94861e35bb659cbaed4096aa8f83a15f5a1d1d17ffd80579e5f940e" exitCode=0 May 21 17:32:36.476749 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.476604 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" event={"ID":"b12914dd05933086c1cd221c73887ab2","Type":"ContainerDied","Data":"3b147062b94861e35bb659cbaed4096aa8f83a15f5a1d1d17ffd80579e5f940e"} May 21 17:32:36.486594 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.486565 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" event={"ID":"0a33f18e40315f11e89b9080e4b2917f","Type":"ContainerStarted","Data":"b259632fd923492785c99efe13ac4ecb06890e44f8ad68dacb6a821ba0a4901a"} May 21 17:32:36.907113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:36.907055 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:36.907304 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:36.907238 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:36.907304 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:36.907304 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:38.907285291 +0000 UTC m=+6.105904050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:37.008179 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:37.008074 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:37.008343 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:37.008265 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:37.008343 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:37.008282 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:37.008343 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:37.008294 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:37.008516 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:37.008353 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:39.008334823 +0000 UTC m=+6.206953601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:37.437129 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:37.437092 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:37.437647 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:37.437273 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:37.503862 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:37.503591 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" event={"ID":"b12914dd05933086c1cd221c73887ab2","Type":"ContainerStarted","Data":"ef8b9c3ad000a58d622e4ff9130b696d11be92a1e96cec56cfaf052fb5100c92"} May 21 17:32:37.515068 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:37.515001 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-73.ec2.internal" podStartSLOduration=3.514983655 podStartE2EDuration="3.514983655s" podCreationTimestamp="2026-05-21 17:32:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:36.50273133 +0000 UTC m=+3.701350108" watchObservedRunningTime="2026-05-21 17:32:37.514983655 +0000 UTC m=+4.713602434" May 21 17:32:38.432404 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:38.432373 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:38.432590 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:38.432520 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:38.925547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:38.925507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:38.925934 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:38.925669 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:38.925934 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:38.925736 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:42.925716512 +0000 UTC m=+10.124335284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:39.026727 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:39.026691 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:39.026936 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:39.026852 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:39.026936 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:39.026871 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:39.026936 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:39.026885 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:39.027100 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:39.026961 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:43.026940187 +0000 UTC m=+10.225558947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:39.434725 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:39.434680 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:39.434931 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:39.434808 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:40.433047 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.433016 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:40.433498 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:40.433151 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:40.989303 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.989222 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-73.ec2.internal" podStartSLOduration=6.989199259 podStartE2EDuration="6.989199259s" podCreationTimestamp="2026-05-21 17:32:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:37.516079636 +0000 UTC m=+4.714698414" watchObservedRunningTime="2026-05-21 17:32:40.989199259 +0000 UTC m=+8.187818037" May 21 17:32:40.989496 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.989370 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-24jd7"] May 21 17:32:40.994453 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.994354 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24jd7" May 21 17:32:40.996819 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.996792 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8lbvd\"" May 21 17:32:40.997080 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.997061 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 17:32:40.997512 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:40.997491 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 17:32:41.042515 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.042475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba38e0c-6594-416b-a147-3c9f67829767-hosts-file\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.042683 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.042582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrfd\" (UniqueName: \"kubernetes.io/projected/bba38e0c-6594-416b-a147-3c9f67829767-kube-api-access-cqrfd\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.042683 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.042646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba38e0c-6594-416b-a147-3c9f67829767-tmp-dir\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.143486 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.143450 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba38e0c-6594-416b-a147-3c9f67829767-hosts-file\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.143673 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.143585 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrfd\" (UniqueName: \"kubernetes.io/projected/bba38e0c-6594-416b-a147-3c9f67829767-kube-api-access-cqrfd\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.143673 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.143639 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba38e0c-6594-416b-a147-3c9f67829767-tmp-dir\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.143880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.143856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba38e0c-6594-416b-a147-3c9f67829767-hosts-file\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.144574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.144550 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba38e0c-6594-416b-a147-3c9f67829767-tmp-dir\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.153618 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.153592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrfd\" (UniqueName: \"kubernetes.io/projected/bba38e0c-6594-416b-a147-3c9f67829767-kube-api-access-cqrfd\") pod \"node-resolver-24jd7\" (UID: \"bba38e0c-6594-416b-a147-3c9f67829767\") " pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.306431 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.306296 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24jd7" May 21 17:32:41.432497 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:41.432455 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:41.432666 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:41.432588 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:42.432795 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:42.432751 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:42.433286 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:42.432991 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:42.958322 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:42.958270 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:42.958522 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:42.958447 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:42.958573 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:42.958523 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:50.958502819 +0000 UTC m=+18.157121587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:43.059517 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:43.059331 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:43.059517 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:43.059522 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:43.059759 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:43.059540 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:43.059759 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:43.059553 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:43.059759 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:43.059619 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:51.059601464 +0000 UTC m=+18.258220223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:43.432960 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:43.432896 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:43.433406 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:43.433049 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:44.432873 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:44.432835 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:44.433172 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:44.432996 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:45.432328 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:45.432287 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:45.432492 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:45.432428 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:46.432972 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:46.432932 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:46.433438 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:46.433086 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:47.432593 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:47.432556 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:47.432768 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:47.432692 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:48.432133 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:48.432059 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:48.432624 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:48.432201 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:49.432580 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:49.432542 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:49.433038 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:49.432678 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:49.977710 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:49.977677 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ptv4m"] May 21 17:32:50.038825 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.038787 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.038990 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.038888 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:50.112367 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.112332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-kubelet-config\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.112555 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.112385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.112555 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.112472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-dbus\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213125 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.213085 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-kubelet-config\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213294 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.213154 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213294 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.213215 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-dbus\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213294 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.213239 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-kubelet-config\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213468 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.213327 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:50.213468 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.213395 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75c6b319-3005-4c70-abd3-16781298a3df-dbus\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.213468 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.213400 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:32:50.713381571 +0000 UTC m=+17.912000335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:50.432352 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.432317 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:50.432555 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.432455 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:50.716837 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:50.716753 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:50.717359 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.716927 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:50.717359 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:50.716996 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:32:51.716980592 +0000 UTC m=+18.915599350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:51.018254 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:51.018168 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:51.018420 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.018330 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:51.018420 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.018414 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:07.018393062 +0000 UTC m=+34.217011831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:51.119229 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:51.119193 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:51.119408 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.119379 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:51.119408 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.119403 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:51.119509 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.119417 2568 projected.go:194] Error preparing data for projected volume kube-api-access-xpkmq for pod openshift-network-diagnostics/network-check-target-546lq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:51.119509 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.119483 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq podName:596877dc-5aa4-427f-83db-1e2efb3854a4 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:07.119462665 +0000 UTC m=+34.318081437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpkmq" (UniqueName: "kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq") pod "network-check-target-546lq" (UID: "596877dc-5aa4-427f-83db-1e2efb3854a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:51.432450 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:51.432414 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:51.432632 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:51.432414 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:51.432632 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.432546 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:51.432762 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.432624 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:51.723059 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:51.722966 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:51.723415 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.723131 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:51.723415 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:51.723205 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:32:53.723182276 +0000 UTC m=+20.921801047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:52.432301 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:52.432260 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:52.432489 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:52.432411 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:53.312730 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:32:53.312690 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba38e0c_6594_416b_a147_3c9f67829767.slice/crio-cd06f6cae092d8d881402b32abe5713843b1ec53e9c388e104ce5f23b8f29758 WatchSource:0}: Error finding container cd06f6cae092d8d881402b32abe5713843b1ec53e9c388e104ce5f23b8f29758: Status 404 returned error can't find the container with id cd06f6cae092d8d881402b32abe5713843b1ec53e9c388e104ce5f23b8f29758 May 21 17:32:53.433286 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.433066 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:53.433422 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:53.433396 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:53.433806 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.433784 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:53.433923 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:53.433886 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:53.533325 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.533286 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sbcwc" event={"ID":"1b488979-2260-40ad-b845-0b4a44f214fc","Type":"ContainerStarted","Data":"12070cb7f415a1f78fed143363d058f2fea10ba9b22e02f46d267a12b4a926be"} May 21 17:32:53.534850 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.534818 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24jd7" event={"ID":"bba38e0c-6594-416b-a147-3c9f67829767","Type":"ContainerStarted","Data":"cd06f6cae092d8d881402b32abe5713843b1ec53e9c388e104ce5f23b8f29758"} May 21 17:32:53.554370 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.554298 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sbcwc" podStartSLOduration=10.924055093 podStartE2EDuration="20.554280104s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.924114258 +0000 UTC m=+3.122733012" lastFinishedPulling="2026-05-21 17:32:45.554339259 +0000 UTC m=+12.752958023" observedRunningTime="2026-05-21 17:32:53.554067596 +0000 UTC m=+20.752686375" watchObservedRunningTime="2026-05-21 17:32:53.554280104 +0000 UTC m=+20.752898882" May 21 17:32:53.739720 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:53.739694 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:53.739871 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:53.739850 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:53.739955 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:53.739943 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:32:57.739902903 +0000 UTC m=+24.938521663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:54.432877 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.432694 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:54.433608 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:54.432990 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:54.537881 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.537842 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24jd7" event={"ID":"bba38e0c-6594-416b-a147-3c9f67829767","Type":"ContainerStarted","Data":"3750aeae8075f0cf02c231f48711d95b3d2ce250a934060a8baff661f17cbb0c"} May 21 17:32:54.539068 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.539045 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr4db" event={"ID":"94aca6d5-e843-4039-83e1-bbf0638799cd","Type":"ContainerStarted","Data":"5e5c31a33d2ff02831d3fb325de3f0fb115debb3c1d96bc279f0698c8871a21a"} May 21 17:32:54.540166 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.540145 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glz67" event={"ID":"993bd913-60ad-4cff-b80b-37d1195a0c9b","Type":"ContainerStarted","Data":"a2aa017e64e230a61a68f42eb5e20b78178571f7caa613b945e88a4ec0a182aa"} May 21 17:32:54.541414 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.541392 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rwcwp" event={"ID":"4a61f9c6-c394-430b-b635-70b688cfd136","Type":"ContainerStarted","Data":"8c31bac64841cbba1ed201b3162b16eedd27d0eef2d0f75b4ceaa41e91076ca4"} May 21 17:32:54.546179 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:32:54.546432 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546413 2568 generic.go:358] "Generic (PLEG): container finished" podID="4b69b81d-a157-4276-98e6-3a830cde5ec9" containerID="8c58648b65ecd3185cc58b9983c9eae16fbe97b905f4a8e4cf01f5a8e1371ed4" exitCode=1 May 21 17:32:54.546497 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546477 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"92d91c1e1633b2516d6a5ace222620ac79e7afa4f4240143a42fa8e425cb2179"} May 21 17:32:54.546547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546498 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"9956a58b62c3720e660c883bf0df11c84bf238ccf97e85f9b9d27140c2b70199"} May 21 17:32:54.546547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546508 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"514382954a2827e44d0f0002cd207adc5704ef205728cd896af8cccaabd61f0c"} May 21 17:32:54.546547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546516 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"34899042dbfbe9c458f5721cbc5022154f1817de26b4fa1e882c187b2607c0fc"} May 21 17:32:54.546547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546523 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerDied","Data":"8c58648b65ecd3185cc58b9983c9eae16fbe97b905f4a8e4cf01f5a8e1371ed4"} May 21 17:32:54.546547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.546533 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"f1af24e7411c3e79c12a538eaae5c257c5db8bf19cbf0d6ba1c232768ae14e8b"} May 21 17:32:54.547631 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.547611 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" event={"ID":"ae0d6acd-4132-4403-b00d-d0b6c896c222","Type":"ContainerStarted","Data":"b87e3785e57b7b69f4dd67dd997106ad52ba8cf9db055454fd3783d4bb91be79"} May 21 17:32:54.548803 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.548784 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="e0729e47f68abc0b13e8e07cf6c067565217d6e6e2cee86c6cf0bbc987fd417e" exitCode=0 May 21 17:32:54.548893 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.548859 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"e0729e47f68abc0b13e8e07cf6c067565217d6e6e2cee86c6cf0bbc987fd417e"} May 21 17:32:54.550681 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.550650 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-24jd7" podStartSLOduration=14.550641367 podStartE2EDuration="14.550641367s" podCreationTimestamp="2026-05-21 17:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:54.550277677 +0000 UTC m=+21.748896454" watchObservedRunningTime="2026-05-21 17:32:54.550641367 +0000 UTC m=+21.749260144" May 21 17:32:54.580506 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.580463 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hr4db" podStartSLOduration=4.158319075 podStartE2EDuration="21.580450533s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.926336739 +0000 UTC m=+3.124955500" lastFinishedPulling="2026-05-21 17:32:53.348468191 +0000 UTC m=+20.547086958" observedRunningTime="2026-05-21 17:32:54.579950385 +0000 UTC m=+21.778569162" watchObservedRunningTime="2026-05-21 17:32:54.580450533 +0000 UTC m=+21.779069310" May 21 17:32:54.612696 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.612650 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-glz67" podStartSLOduration=4.18585243 podStartE2EDuration="21.612638042s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.924095979 +0000 UTC m=+3.122714746" lastFinishedPulling="2026-05-21 17:32:53.3508816 +0000 UTC m=+20.549500358" observedRunningTime="2026-05-21 17:32:54.612620289 +0000 UTC m=+21.811239067" watchObservedRunningTime="2026-05-21 17:32:54.612638042 +0000 UTC m=+21.811256818" May 21 17:32:54.612840 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.612789 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rwcwp" podStartSLOduration=4.175122884 podStartE2EDuration="21.612784344s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.929594011 +0000 UTC m=+3.128212781" lastFinishedPulling="2026-05-21 17:32:53.367255476 +0000 UTC m=+20.565874241" observedRunningTime="2026-05-21 17:32:54.598399955 +0000 UTC m=+21.797018731" watchObservedRunningTime="2026-05-21 17:32:54.612784344 +0000 UTC m=+21.811403122" May 21 17:32:54.843623 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:54.843376 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 17:32:55.348619 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.348218 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T17:32:54.843620297Z","UUID":"4b4d5fec-bf3b-47bf-a4c0-dc2511694bb0","Handler":null,"Name":"","Endpoint":""} May 21 17:32:55.350391 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.350367 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 17:32:55.350546 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.350399 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 17:32:55.432165 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.432133 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:55.432376 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.432132 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:55.432376 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:55.432270 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:55.432509 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:55.432376 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:55.553182 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.553143 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" event={"ID":"ae0d6acd-4132-4403-b00d-d0b6c896c222","Type":"ContainerStarted","Data":"75d219feb26c19c87d9512c39a939591288c5125f5ba399e2873626a77b0bc43"} May 21 17:32:55.555138 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.555104 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqxms" event={"ID":"9c584c61-7539-4017-b452-08359175abbc","Type":"ContainerStarted","Data":"1b45e33bdb2cb2cd15178337a178fd3f201d4f3a5fb33208939fefcc885fed40"} May 21 17:32:55.567651 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:55.567594 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nqxms" podStartSLOduration=5.156624743 podStartE2EDuration="22.567577574s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.91927932 +0000 UTC m=+3.117898090" lastFinishedPulling="2026-05-21 17:32:53.330232163 +0000 UTC m=+20.528850921" observedRunningTime="2026-05-21 17:32:55.567424212 +0000 UTC m=+22.766042990" watchObservedRunningTime="2026-05-21 17:32:55.567577574 +0000 UTC m=+22.766196352" May 21 17:32:56.395790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.395741 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:56.396514 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.396488 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:56.432608 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.432531 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:56.432785 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:56.432641 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:56.481832 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.481790 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:56.482300 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.482284 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sbcwc" May 21 17:32:56.560263 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.560237 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:32:56.560780 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.560516 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"0848dd816e294f596a006462f85e3386d429df048ad91d5b3a2200195fd080fd"} May 21 17:32:56.562330 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.562301 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" event={"ID":"ae0d6acd-4132-4403-b00d-d0b6c896c222","Type":"ContainerStarted","Data":"428a3edf863146bc214826c729a48bd3f4924ea9058a0be06b3ede8a53389949"} May 21 17:32:56.577617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:56.577577 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58n9k" podStartSLOduration=3.7894269510000003 podStartE2EDuration="23.577564833s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.927469139 +0000 UTC m=+3.126087897" lastFinishedPulling="2026-05-21 17:32:55.71560702 +0000 UTC m=+22.914225779" observedRunningTime="2026-05-21 17:32:56.577349498 +0000 UTC m=+23.775968275" watchObservedRunningTime="2026-05-21 17:32:56.577564833 +0000 UTC m=+23.776183610" May 21 17:32:57.432202 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:57.432170 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:57.432202 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:57.432196 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:57.432453 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:57.432298 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:57.432574 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:57.432550 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:57.768694 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:57.768601 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:57.769213 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:57.768750 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:57.769213 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:57.768818 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:33:05.768803084 +0000 UTC m=+32.967421845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:58.433034 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.432262 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:32:58.433034 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:58.432671 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:32:58.570196 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.570115 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:32:58.570529 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.570495 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"5cb1fe013879272884fa933f1b9ced7b7e275134403bbea89fa022e68c52a4b3"} May 21 17:32:58.570961 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.570936 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:58.571070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.570971 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:58.571070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.571012 2568 scope.go:117] "RemoveContainer" containerID="8c58648b65ecd3185cc58b9983c9eae16fbe97b905f4a8e4cf01f5a8e1371ed4" May 21 17:32:58.594837 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.594701 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:58.594837 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.594800 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:58.945692 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:58.945621 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:32:59.432267 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:59.432231 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:32:59.432465 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:59.432231 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:32:59.432465 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:59.432355 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:32:59.432578 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:32:59.432456 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:32:59.586551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:59.586450 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:32:59.586903 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:59.586865 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" event={"ID":"4b69b81d-a157-4276-98e6-3a830cde5ec9","Type":"ContainerStarted","Data":"e2d67cd2016fc5704bd396db41d892a2a7b6a5157786a9a04fd74be8800157d5"} May 21 17:32:59.613564 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:32:59.613492 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" podStartSLOduration=9.136926927 podStartE2EDuration="26.613472015s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.9287882 +0000 UTC m=+3.127406969" lastFinishedPulling="2026-05-21 17:32:53.405333288 +0000 UTC m=+20.603952057" observedRunningTime="2026-05-21 17:32:59.612633907 +0000 UTC m=+26.811252701" watchObservedRunningTime="2026-05-21 17:32:59.613472015 +0000 UTC m=+26.812090794" May 21 17:33:00.316691 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.316655 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-546lq"] May 21 17:33:00.317157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.316781 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:00.317157 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:00.316903 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:33:00.319520 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.319496 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9km89"] May 21 17:33:00.319633 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.319616 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:00.319718 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:00.319700 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:33:00.329447 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.329408 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ptv4m"] May 21 17:33:00.329616 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:00.329498 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:00.329616 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:00.329592 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:33:01.432291 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:01.432110 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:01.432679 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:01.432372 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:33:01.592490 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:01.592454 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="7d8b9af69a61ae697b943fc7ef96206dcd390aa7f9c1a114b1caac5f9ab023fc" exitCode=0 May 21 17:33:01.592490 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:01.592490 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"7d8b9af69a61ae697b943fc7ef96206dcd390aa7f9c1a114b1caac5f9ab023fc"} May 21 17:33:02.432441 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:02.432408 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:02.432884 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:02.432408 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:02.432884 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:02.432517 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:33:02.432884 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:02.432616 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:33:03.433527 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:03.433489 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:03.434183 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:03.433584 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:33:03.597962 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:03.597927 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="8cf408a5a1b206ddf1b08bc3a21f7032da94f65ed7be2b72ebca1304fa1a81d7" exitCode=0 May 21 17:33:03.597962 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:03.597965 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"8cf408a5a1b206ddf1b08bc3a21f7032da94f65ed7be2b72ebca1304fa1a81d7"} May 21 17:33:04.431845 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:04.431815 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:04.432042 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:04.431815 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:04.432042 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:04.431927 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ptv4m" podUID="75c6b319-3005-4c70-abd3-16781298a3df" May 21 17:33:04.432042 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:04.432002 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-546lq" podUID="596877dc-5aa4-427f-83db-1e2efb3854a4" May 21 17:33:05.432505 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:05.432470 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:05.432984 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:05.432587 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:33:05.606300 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:05.606266 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="6eeb633b8a1fb5ac1e6737bb1af94f829e32830cd7d282fcd4afa4bca110cb70" exitCode=0 May 21 17:33:05.606464 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:05.606314 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"6eeb633b8a1fb5ac1e6737bb1af94f829e32830cd7d282fcd4afa4bca110cb70"} May 21 17:33:05.828059 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:05.828016 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:05.828250 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:05.828124 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:33:05.828250 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:05.828176 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret podName:75c6b319-3005-4c70-abd3-16781298a3df nodeName:}" failed. No retries permitted until 2026-05-21 17:33:21.828162221 +0000 UTC m=+49.026780980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret") pod "global-pull-secret-syncer-ptv4m" (UID: "75c6b319-3005-4c70-abd3-16781298a3df") : object "kube-system"/"original-pull-secret" not registered May 21 17:33:06.153266 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.152977 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-73.ec2.internal" event="NodeReady" May 21 17:33:06.153415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.153356 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 17:33:06.198480 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.198444 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g8ghl"] May 21 17:33:06.215522 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.215478 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jrdb8"] May 21 17:33:06.215689 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.215659 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.217991 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.217966 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 17:33:06.218157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.218035 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 17:33:06.218157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.218036 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\"" May 21 17:33:06.230197 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.230156 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8ghl"] May 21 17:33:06.230197 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.230188 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrdb8"] May 21 17:33:06.230354 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.230292 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.232525 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.232507 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\"" May 21 17:33:06.232647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.232507 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 17:33:06.232647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.232507 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 17:33:06.232647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.232635 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 17:33:06.332212 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-config-volume\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.332411 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-tmp-dir\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.332411 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.332559 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.332559 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vccw\" (UniqueName: \"kubernetes.io/projected/b8d7beb7-bfcf-45be-9838-08bab4283641-kube-api-access-4vccw\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.332559 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.332517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwjv\" (UniqueName: \"kubernetes.io/projected/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-kube-api-access-kdwjv\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.432469 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.432351 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:06.432625 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.432546 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:06.433049 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433026 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.433127 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433067 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vccw\" (UniqueName: \"kubernetes.io/projected/b8d7beb7-bfcf-45be-9838-08bab4283641-kube-api-access-4vccw\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.433127 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433093 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwjv\" (UniqueName: \"kubernetes.io/projected/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-kube-api-access-kdwjv\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.433232 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433159 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-config-volume\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.433232 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.433181 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:06.433232 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433204 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-tmp-dir\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.433366 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433233 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.433366 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.433356 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:06.433465 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.433373 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.933351952 +0000 UTC m=+34.131970723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:06.433465 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.433421 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.933404174 +0000 UTC m=+34.132022933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:06.433793 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-tmp-dir\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.433886 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.433864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-config-volume\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.434870 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.434841 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 17:33:06.434979 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.434938 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 17:33:06.434979 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.434938 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 17:33:06.434979 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.434966 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2czh7\"" May 21 17:33:06.446073 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.446007 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwjv\" (UniqueName: \"kubernetes.io/projected/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-kube-api-access-kdwjv\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.446386 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.446364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vccw\" (UniqueName: \"kubernetes.io/projected/b8d7beb7-bfcf-45be-9838-08bab4283641-kube-api-access-4vccw\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.938684 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.938648 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:06.938885 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:06.938705 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:06.938885 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.938846 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:06.938885 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.938849 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:06.939048 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.938905 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:07.938886597 +0000 UTC m=+35.137505365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:06.939048 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:06.938931 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:07.938924456 +0000 UTC m=+35.137543210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:07.040051 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.040008 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:07.040218 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.040174 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:33:07.040272 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.040253 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:39.040231522 +0000 UTC m=+66.238850279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:33:07.140945 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.140895 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:07.144127 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.144094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkmq\" (UniqueName: \"kubernetes.io/projected/596877dc-5aa4-427f-83db-1e2efb3854a4-kube-api-access-xpkmq\") pod \"network-check-target-546lq\" (UID: \"596877dc-5aa4-427f-83db-1e2efb3854a4\") " pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:07.355491 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.355458 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:07.432305 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.432272 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:07.435254 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.435068 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:33:07.435254 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.435175 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\"" May 21 17:33:07.538811 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.538779 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-546lq"] May 21 17:33:07.543275 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:33:07.543245 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596877dc_5aa4_427f_83db_1e2efb3854a4.slice/crio-a938ab58600cbb410d0e0aa08825b3ff37f08143fb4edf8d82d2372148aa1bd9 WatchSource:0}: Error finding container a938ab58600cbb410d0e0aa08825b3ff37f08143fb4edf8d82d2372148aa1bd9: Status 404 returned error can't find the container with id a938ab58600cbb410d0e0aa08825b3ff37f08143fb4edf8d82d2372148aa1bd9 May 21 17:33:07.611679 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.611590 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-546lq" event={"ID":"596877dc-5aa4-427f-83db-1e2efb3854a4","Type":"ContainerStarted","Data":"a938ab58600cbb410d0e0aa08825b3ff37f08143fb4edf8d82d2372148aa1bd9"} May 21 17:33:07.946920 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.946819 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:07.946920 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:07.946876 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:07.947127 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.947013 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:07.947127 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.947068 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:09.947054929 +0000 UTC m=+37.145673684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:07.947127 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.947012 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:07.947270 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:07.947177 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:09.947151385 +0000 UTC m=+37.145770157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:09.966089 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:09.966055 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:09.966563 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:09.966124 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:09.966563 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:09.966228 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:09.966563 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:09.966252 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:09.966563 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:09.966307 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:13.966287627 +0000 UTC m=+41.164906382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:09.966563 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:09.966328 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:13.966318918 +0000 UTC m=+41.164937680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:12.625537 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:12.625313 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="815191bc63a90920825567986c3dcd01919ae59de32f364ec5cb8a5807e1b96c" exitCode=0 May 21 17:33:12.625537 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:12.625390 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"815191bc63a90920825567986c3dcd01919ae59de32f364ec5cb8a5807e1b96c"} May 21 17:33:12.626800 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:12.626778 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-546lq" event={"ID":"596877dc-5aa4-427f-83db-1e2efb3854a4","Type":"ContainerStarted","Data":"3abc3ff229fa256d85d5adecfe164297412e127fa2ad16b6202696e8fba1d4d8"} May 21 17:33:12.626977 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:12.626959 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:33:12.659062 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:12.659009 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-546lq" podStartSLOduration=34.858471223 podStartE2EDuration="39.658990365s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:33:07.545527192 +0000 UTC m=+34.744145948" lastFinishedPulling="2026-05-21 17:33:12.346046131 +0000 UTC m=+39.544665090" observedRunningTime="2026-05-21 17:33:12.658700145 +0000 UTC m=+39.857318923" watchObservedRunningTime="2026-05-21 17:33:12.658990365 +0000 UTC m=+39.857609142" May 21 17:33:13.631588 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:13.631555 2568 generic.go:358] "Generic (PLEG): container finished" podID="2c5a13f8-caeb-445f-a0b0-12b2429d27fa" containerID="8f4b1fe7f37423711ff6ae175b53d0570c5f93d9050659060da69ca1cffeed1d" exitCode=0 May 21 17:33:13.631971 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:13.631643 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerDied","Data":"8f4b1fe7f37423711ff6ae175b53d0570c5f93d9050659060da69ca1cffeed1d"} May 21 17:33:13.996565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:13.996459 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:13.996565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:13.996543 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:13.996777 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:13.996617 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:13.996777 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:13.996671 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:13.996777 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:13.996678 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:21.996661018 +0000 UTC m=+49.195279779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:13.996777 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:13.996736 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:21.996722806 +0000 UTC m=+49.195341561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:14.637017 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:14.636983 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" event={"ID":"2c5a13f8-caeb-445f-a0b0-12b2429d27fa","Type":"ContainerStarted","Data":"0004989e19ed9b6b48239204176b74df240e10c06488cc13d9df522665c601d8"} May 21 17:33:14.658070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:14.658017 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tmvf9" podStartSLOduration=5.222945882 podStartE2EDuration="41.658000841s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:32:35.921152482 +0000 UTC m=+3.119771240" lastFinishedPulling="2026-05-21 17:33:12.356207428 +0000 UTC m=+39.554826199" observedRunningTime="2026-05-21 17:33:14.656726964 +0000 UTC m=+41.855345741" watchObservedRunningTime="2026-05-21 17:33:14.658000841 +0000 UTC m=+41.856619695" May 21 17:33:21.855791 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:21.855743 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:21.859114 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:21.859076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75c6b319-3005-4c70-abd3-16781298a3df-original-pull-secret\") pod \"global-pull-secret-syncer-ptv4m\" (UID: \"75c6b319-3005-4c70-abd3-16781298a3df\") " pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:22.044715 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:22.044679 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ptv4m" May 21 17:33:22.057247 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:22.057184 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:22.057394 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:22.057336 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:22.057394 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:22.057346 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:22.057499 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:22.057420 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:38.057398476 +0000 UTC m=+65.256017248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:22.057499 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:22.057457 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:22.057610 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:22.057521 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:33:38.057500502 +0000 UTC m=+65.256119257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:22.174523 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:22.174493 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ptv4m"] May 21 17:33:22.178200 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:33:22.178171 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c6b319_3005_4c70_abd3_16781298a3df.slice/crio-eadfe1672180f69be614177e46f543572037724b96ea392a0aa0bcaaf85c52c5 WatchSource:0}: Error finding container eadfe1672180f69be614177e46f543572037724b96ea392a0aa0bcaaf85c52c5: Status 404 returned error can't find the container with id eadfe1672180f69be614177e46f543572037724b96ea392a0aa0bcaaf85c52c5 May 21 17:33:22.652053 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:22.652018 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ptv4m" event={"ID":"75c6b319-3005-4c70-abd3-16781298a3df","Type":"ContainerStarted","Data":"eadfe1672180f69be614177e46f543572037724b96ea392a0aa0bcaaf85c52c5"} May 21 17:33:26.662288 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:26.662248 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ptv4m" event={"ID":"75c6b319-3005-4c70-abd3-16781298a3df","Type":"ContainerStarted","Data":"6ae22b46217ca70cfbc43b4ab5151c35eb98a1ce436984f88bc0ec584395d14d"} May 21 17:33:26.675817 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:26.675719 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ptv4m" podStartSLOduration=33.435393736 podStartE2EDuration="37.675704853s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:33:22.1800516 +0000 UTC m=+49.378670355" lastFinishedPulling="2026-05-21 17:33:26.420362705 +0000 UTC m=+53.618981472" observedRunningTime="2026-05-21 17:33:26.675608182 +0000 UTC m=+53.874226960" watchObservedRunningTime="2026-05-21 17:33:26.675704853 +0000 UTC m=+53.874323630" May 21 17:33:30.605293 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:30.605263 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vwrc" May 21 17:33:38.066597 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:38.066554 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:33:38.066597 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:38.066606 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:33:38.067150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:38.066694 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:38.067150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:38.066695 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:38.067150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:38.066765 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:10.066743182 +0000 UTC m=+97.265361937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:33:38.067150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:38.066779 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:34:10.066772349 +0000 UTC m=+97.265391103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:33:39.072566 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:39.072530 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:33:39.075335 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:39.075312 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:33:39.083283 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:39.083258 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:33:39.083389 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:33:39.083336 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:43.083311778 +0000 UTC m=+130.281930533 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : secret "metrics-daemon-secret" not found May 21 17:33:43.634183 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:33:43.634040 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-546lq" May 21 17:34:10.075041 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:10.075002 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:34:10.075041 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:10.075051 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:34:10.075483 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:10.075151 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:34:10.075483 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:10.075158 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:34:10.075483 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:10.075211 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert podName:b8d7beb7-bfcf-45be-9838-08bab4283641 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:14.075195953 +0000 UTC m=+161.273814708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert") pod "ingress-canary-jrdb8" (UID: "b8d7beb7-bfcf-45be-9838-08bab4283641") : secret "canary-serving-cert" not found May 21 17:34:10.075483 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:10.075223 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls podName:2e96c0a6-1243-41d7-b3bd-2dc598972eeb nodeName:}" failed. No retries permitted until 2026-05-21 17:35:14.075217012 +0000 UTC m=+161.273835766 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls") pod "dns-default-g8ghl" (UID: "2e96c0a6-1243-41d7-b3bd-2dc598972eeb") : secret "dns-default-metrics-tls" not found May 21 17:34:43.100607 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:43.100553 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:34:43.101124 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:43.100697 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:34:43.101124 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:43.100773 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs podName:da2bcb2a-ebf9-40fa-a347-5c0d47b42744 nodeName:}" failed. No retries permitted until 2026-05-21 17:36:45.100755996 +0000 UTC m=+252.299374756 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs") pod "network-metrics-daemon-9km89" (UID: "da2bcb2a-ebf9-40fa-a347-5c0d47b42744") : secret "metrics-daemon-secret" not found May 21 17:34:48.474537 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.474501 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz"] May 21 17:34:48.476555 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.476538 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.479712 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.479690 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 17:34:48.479829 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.479717 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 17:34:48.480696 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.480671 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kfbkm\"" May 21 17:34:48.480817 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.480800 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 17:34:48.480871 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.480822 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 17:34:48.485965 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.485942 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz"] May 21 17:34:48.536994 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.536951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.536994 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.536991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5tl4\" (UniqueName: \"kubernetes.io/projected/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-kube-api-access-g5tl4\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.537245 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.537075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.640947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.640887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.640947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.640954 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5tl4\" (UniqueName: \"kubernetes.io/projected/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-kube-api-access-g5tl4\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.641209 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.640996 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.641209 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:48.641105 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:34:48.641209 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:48.641172 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:49.141152308 +0000 UTC m=+136.339771065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:34:48.641632 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.641610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:48.649508 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:48.649483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5tl4\" (UniqueName: \"kubernetes.io/projected/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-kube-api-access-g5tl4\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:49.144953 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:49.144881 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:49.145145 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:49.145022 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:34:49.145145 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:49.145092 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:50.145075466 +0000 UTC m=+137.343694221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:34:50.152438 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:50.152393 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:50.152877 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:50.152555 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:34:50.152877 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:50.152636 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:52.152616648 +0000 UTC m=+139.351235409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:34:52.165433 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:52.165385 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:52.165811 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:52.165513 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:34:52.165811 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:52.165579 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:56.165561328 +0000 UTC m=+143.364180082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:34:53.314163 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:53.314135 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24jd7_bba38e0c-6594-416b-a147-3c9f67829767/dns-node-resolver/0.log" May 21 17:34:54.114402 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:54.114375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr4db_94aca6d5-e843-4039-83e1-bbf0638799cd/node-ca/0.log" May 21 17:34:56.194131 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:56.194071 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:34:56.194540 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:56.194219 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:34:56.194540 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:56.194297 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:04.194282415 +0000 UTC m=+151.392901170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:34:58.297576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.297542 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z7lcn"] May 21 17:34:58.299582 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.299564 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.301642 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.301621 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 17:34:58.301883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.301867 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 17:34:58.301984 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.301871 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 17:34:58.303159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.303035 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 17:34:58.303159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.303067 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2qrdk\"" May 21 17:34:58.307188 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.307165 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 17:34:58.309758 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.309734 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z7lcn"] May 21 17:34:58.393214 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.393181 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w"] May 21 17:34:58.394967 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.394948 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" May 21 17:34:58.397113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.397080 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v"] May 21 17:34:58.397741 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.397486 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nb9qs\"" May 21 17:34:58.397741 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.397541 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 17:34:58.398056 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.398036 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 17:34:58.400075 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.400057 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.402718 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.402680 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 17:34:58.402838 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.402691 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 17:34:58.402838 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.402737 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-znk92\"" May 21 17:34:58.403214 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.403048 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 17:34:58.403511 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.403487 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w"] May 21 17:34:58.406419 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.406397 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v"] May 21 17:34:58.409828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.409796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-config\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.409983 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.409842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309d790e-4546-4c56-96b7-ae7ce96db741-serving-cert\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.409983 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.409966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chpr9\" (UniqueName: \"kubernetes.io/projected/309d790e-4546-4c56-96b7-ae7ce96db741-kube-api-access-chpr9\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.410104 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.410045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-trusted-ca\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.497984 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.497955 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h"] May 21 17:34:58.499717 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.499703 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.502353 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.502327 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 17:34:58.502473 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.502333 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 17:34:58.502473 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.502369 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 17:34:58.502473 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.502415 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6f4vq\"" May 21 17:34:58.502473 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.502334 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 17:34:58.508414 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.508392 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h"] May 21 17:34:58.510726 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510705 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-config\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.510828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510738 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309d790e-4546-4c56-96b7-ae7ce96db741-serving-cert\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.510828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.510828 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510815 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chpr9\" (UniqueName: \"kubernetes.io/projected/309d790e-4546-4c56-96b7-ae7ce96db741-kube-api-access-chpr9\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.511005 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmkk5\" (UniqueName: \"kubernetes.io/projected/4109581c-82f3-41a2-9727-46a905f8dd2e-kube-api-access-pmkk5\") pod \"volume-data-source-validator-5cf8c89d64-ptj8w\" (UID: \"4109581c-82f3-41a2-9727-46a905f8dd2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" May 21 17:34:58.511005 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhz5m\" (UniqueName: \"kubernetes.io/projected/30ef177c-d53c-457f-bc28-1b90c489f533-kube-api-access-dhz5m\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.511005 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.510952 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-trusted-ca\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.511328 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.511305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-config\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.511623 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.511602 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/309d790e-4546-4c56-96b7-ae7ce96db741-trusted-ca\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.513064 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.513044 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309d790e-4546-4c56-96b7-ae7ce96db741-serving-cert\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.519870 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.519843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chpr9\" (UniqueName: \"kubernetes.io/projected/309d790e-4546-4c56-96b7-ae7ce96db741-kube-api-access-chpr9\") pod \"console-operator-76dff48d59-z7lcn\" (UID: \"309d790e-4546-4c56-96b7-ae7ce96db741\") " pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.610123 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.610035 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:34:58.611980 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.611956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/643f8836-6a43-49c2-b055-0a67ce61c831-serving-cert\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.612047 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.612008 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/643f8836-6a43-49c2-b055-0a67ce61c831-config\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.612162 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.612145 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.612204 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.612191 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmkk5\" (UniqueName: \"kubernetes.io/projected/4109581c-82f3-41a2-9727-46a905f8dd2e-kube-api-access-pmkk5\") pod \"volume-data-source-validator-5cf8c89d64-ptj8w\" (UID: \"4109581c-82f3-41a2-9727-46a905f8dd2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" May 21 17:34:58.612247 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.612225 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhz5m\" (UniqueName: \"kubernetes.io/projected/30ef177c-d53c-457f-bc28-1b90c489f533-kube-api-access-dhz5m\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.612279 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.612255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8sb\" (UniqueName: \"kubernetes.io/projected/643f8836-6a43-49c2-b055-0a67ce61c831-kube-api-access-xs8sb\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.612327 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:58.612287 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 17:34:58.612366 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:58.612358 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls podName:30ef177c-d53c-457f-bc28-1b90c489f533 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:59.112339453 +0000 UTC m=+146.310958212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls") pod "cluster-samples-operator-697587599-5rp9v" (UID: "30ef177c-d53c-457f-bc28-1b90c489f533") : secret "samples-operator-tls" not found May 21 17:34:58.620935 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.620890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmkk5\" (UniqueName: \"kubernetes.io/projected/4109581c-82f3-41a2-9727-46a905f8dd2e-kube-api-access-pmkk5\") pod \"volume-data-source-validator-5cf8c89d64-ptj8w\" (UID: \"4109581c-82f3-41a2-9727-46a905f8dd2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" May 21 17:34:58.624040 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.624013 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhz5m\" (UniqueName: \"kubernetes.io/projected/30ef177c-d53c-457f-bc28-1b90c489f533-kube-api-access-dhz5m\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:58.707635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.707608 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" May 21 17:34:58.713562 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.713531 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8sb\" (UniqueName: \"kubernetes.io/projected/643f8836-6a43-49c2-b055-0a67ce61c831-kube-api-access-xs8sb\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.713691 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.713593 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/643f8836-6a43-49c2-b055-0a67ce61c831-serving-cert\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.713691 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.713632 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/643f8836-6a43-49c2-b055-0a67ce61c831-config\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.714147 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.714121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/643f8836-6a43-49c2-b055-0a67ce61c831-config\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.715827 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.715802 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/643f8836-6a43-49c2-b055-0a67ce61c831-serving-cert\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.720505 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.720481 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8sb\" (UniqueName: \"kubernetes.io/projected/643f8836-6a43-49c2-b055-0a67ce61c831-kube-api-access-xs8sb\") pod \"service-ca-operator-57b5b68b8-5274h\" (UID: \"643f8836-6a43-49c2-b055-0a67ce61c831\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.736696 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.736666 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z7lcn"] May 21 17:34:58.740271 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:34:58.740243 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309d790e_4546_4c56_96b7_ae7ce96db741.slice/crio-4db84bde18dcde7004486a54c96d33de0565282211d273975ebd19d9312ed4ca WatchSource:0}: Error finding container 4db84bde18dcde7004486a54c96d33de0565282211d273975ebd19d9312ed4ca: Status 404 returned error can't find the container with id 4db84bde18dcde7004486a54c96d33de0565282211d273975ebd19d9312ed4ca May 21 17:34:58.809355 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.809320 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" May 21 17:34:58.832378 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.832348 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w"] May 21 17:34:58.835721 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:34:58.835684 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4109581c_82f3_41a2_9727_46a905f8dd2e.slice/crio-6927d5ceb6ab764450d998929b18b255dcd5011244007629a0425253aad895af WatchSource:0}: Error finding container 6927d5ceb6ab764450d998929b18b255dcd5011244007629a0425253aad895af: Status 404 returned error can't find the container with id 6927d5ceb6ab764450d998929b18b255dcd5011244007629a0425253aad895af May 21 17:34:58.845160 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.845128 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" event={"ID":"4109581c-82f3-41a2-9727-46a905f8dd2e","Type":"ContainerStarted","Data":"6927d5ceb6ab764450d998929b18b255dcd5011244007629a0425253aad895af"} May 21 17:34:58.846180 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.846145 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" event={"ID":"309d790e-4546-4c56-96b7-ae7ce96db741","Type":"ContainerStarted","Data":"4db84bde18dcde7004486a54c96d33de0565282211d273975ebd19d9312ed4ca"} May 21 17:34:58.930588 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:58.930556 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h"] May 21 17:34:58.933558 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:34:58.933530 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643f8836_6a43_49c2_b055_0a67ce61c831.slice/crio-073ae1a9eca0d83849ffc54ed23fa1098b887a5ce0eea010367b37e30cff2752 WatchSource:0}: Error finding container 073ae1a9eca0d83849ffc54ed23fa1098b887a5ce0eea010367b37e30cff2752: Status 404 returned error can't find the container with id 073ae1a9eca0d83849ffc54ed23fa1098b887a5ce0eea010367b37e30cff2752 May 21 17:34:59.117059 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:59.117022 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:34:59.117245 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:59.117150 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 17:34:59.117245 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:34:59.117207 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls podName:30ef177c-d53c-457f-bc28-1b90c489f533 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:00.11719115 +0000 UTC m=+147.315809909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls") pod "cluster-samples-operator-697587599-5rp9v" (UID: "30ef177c-d53c-457f-bc28-1b90c489f533") : secret "samples-operator-tls" not found May 21 17:34:59.848964 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:34:59.848922 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" event={"ID":"643f8836-6a43-49c2-b055-0a67ce61c831","Type":"ContainerStarted","Data":"073ae1a9eca0d83849ffc54ed23fa1098b887a5ce0eea010367b37e30cff2752"} May 21 17:35:00.126454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:00.126362 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:00.126633 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:00.126536 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 17:35:00.126633 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:00.126619 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls podName:30ef177c-d53c-457f-bc28-1b90c489f533 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:02.126597613 +0000 UTC m=+149.325216372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls") pod "cluster-samples-operator-697587599-5rp9v" (UID: "30ef177c-d53c-457f-bc28-1b90c489f533") : secret "samples-operator-tls" not found May 21 17:35:00.851517 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:00.851478 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" event={"ID":"4109581c-82f3-41a2-9727-46a905f8dd2e","Type":"ContainerStarted","Data":"be450da1ff0265f55c0e1d0e459f45bbbdac30a6f8b2a909feebf0359020eaeb"} May 21 17:35:00.865972 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:00.865904 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ptj8w" podStartSLOduration=1.398035734 podStartE2EDuration="2.865888825s" podCreationTimestamp="2026-05-21 17:34:58 +0000 UTC" firstStartedPulling="2026-05-21 17:34:58.837587032 +0000 UTC m=+146.036205791" lastFinishedPulling="2026-05-21 17:35:00.305440115 +0000 UTC m=+147.504058882" observedRunningTime="2026-05-21 17:35:00.864807709 +0000 UTC m=+148.063426486" watchObservedRunningTime="2026-05-21 17:35:00.865888825 +0000 UTC m=+148.064507601" May 21 17:35:02.140341 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.140239 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:02.140722 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:02.140423 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 17:35:02.140722 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:02.140530 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls podName:30ef177c-d53c-457f-bc28-1b90c489f533 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:06.140508146 +0000 UTC m=+153.339126919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls") pod "cluster-samples-operator-697587599-5rp9v" (UID: "30ef177c-d53c-457f-bc28-1b90c489f533") : secret "samples-operator-tls" not found May 21 17:35:02.860610 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.860581 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/0.log" May 21 17:35:02.860801 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.860625 2568 generic.go:358] "Generic (PLEG): container finished" podID="309d790e-4546-4c56-96b7-ae7ce96db741" containerID="0538bcacb3559af70008ee5809c6b08b7307fd6c7097fa7b63587739846d0e16" exitCode=255 May 21 17:35:02.860801 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.860703 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" event={"ID":"309d790e-4546-4c56-96b7-ae7ce96db741","Type":"ContainerDied","Data":"0538bcacb3559af70008ee5809c6b08b7307fd6c7097fa7b63587739846d0e16"} May 21 17:35:02.860973 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.860958 2568 scope.go:117] "RemoveContainer" containerID="0538bcacb3559af70008ee5809c6b08b7307fd6c7097fa7b63587739846d0e16" May 21 17:35:02.862063 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.862038 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" event={"ID":"643f8836-6a43-49c2-b055-0a67ce61c831","Type":"ContainerStarted","Data":"029152a9650550a5481aaa06cd54f17cfb13cdd5f09b373fd00d234600b0a05d"} May 21 17:35:02.886482 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:02.886436 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" podStartSLOduration=1.9311329879999999 podStartE2EDuration="4.886420676s" podCreationTimestamp="2026-05-21 17:34:58 +0000 UTC" firstStartedPulling="2026-05-21 17:34:58.935378064 +0000 UTC m=+146.133996819" lastFinishedPulling="2026-05-21 17:35:01.890665749 +0000 UTC m=+149.089284507" observedRunningTime="2026-05-21 17:35:02.885616094 +0000 UTC m=+150.084234868" watchObservedRunningTime="2026-05-21 17:35:02.886420676 +0000 UTC m=+150.085039488" May 21 17:35:03.665717 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.665679 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8"] May 21 17:35:03.667872 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.667845 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" May 21 17:35:03.670050 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.670023 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 17:35:03.670925 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.670893 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fjjsl\"" May 21 17:35:03.671007 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.670893 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 17:35:03.684034 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.682403 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8"] May 21 17:35:03.752824 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.752781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwhw\" (UniqueName: \"kubernetes.io/projected/e17a4942-5c3e-45c2-bd46-67a8ad6c9223-kube-api-access-zwwhw\") pod \"migrator-b985f5d89-q5cn8\" (UID: \"e17a4942-5c3e-45c2-bd46-67a8ad6c9223\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" May 21 17:35:03.853757 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.853719 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwhw\" (UniqueName: \"kubernetes.io/projected/e17a4942-5c3e-45c2-bd46-67a8ad6c9223-kube-api-access-zwwhw\") pod \"migrator-b985f5d89-q5cn8\" (UID: \"e17a4942-5c3e-45c2-bd46-67a8ad6c9223\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" May 21 17:35:03.861253 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.861223 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwhw\" (UniqueName: \"kubernetes.io/projected/e17a4942-5c3e-45c2-bd46-67a8ad6c9223-kube-api-access-zwwhw\") pod \"migrator-b985f5d89-q5cn8\" (UID: \"e17a4942-5c3e-45c2-bd46-67a8ad6c9223\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" May 21 17:35:03.866507 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.866486 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:35:03.866856 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.866842 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/0.log" May 21 17:35:03.866907 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.866875 2568 generic.go:358] "Generic (PLEG): container finished" podID="309d790e-4546-4c56-96b7-ae7ce96db741" containerID="3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1" exitCode=255 May 21 17:35:03.866968 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.866940 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" event={"ID":"309d790e-4546-4c56-96b7-ae7ce96db741","Type":"ContainerDied","Data":"3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1"} May 21 17:35:03.867002 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.866977 2568 scope.go:117] "RemoveContainer" containerID="0538bcacb3559af70008ee5809c6b08b7307fd6c7097fa7b63587739846d0e16" May 21 17:35:03.867207 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.867191 2568 scope.go:117] "RemoveContainer" containerID="3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1" May 21 17:35:03.867382 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:03.867366 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z7lcn_openshift-console-operator(309d790e-4546-4c56-96b7-ae7ce96db741)\"" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" podUID="309d790e-4546-4c56-96b7-ae7ce96db741" May 21 17:35:03.976427 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:03.976339 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" May 21 17:35:04.100660 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.100622 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8"] May 21 17:35:04.103436 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:04.103408 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17a4942_5c3e_45c2_bd46_67a8ad6c9223.slice/crio-398648ff1e48ffb5b541cbd676d8c0d4c62b383c0bf3e27ffff1010b7f753ccc WatchSource:0}: Error finding container 398648ff1e48ffb5b541cbd676d8c0d4c62b383c0bf3e27ffff1010b7f753ccc: Status 404 returned error can't find the container with id 398648ff1e48ffb5b541cbd676d8c0d4c62b383c0bf3e27ffff1010b7f753ccc May 21 17:35:04.256780 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.256680 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:35:04.256971 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:04.256818 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 17:35:04.256971 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:04.256879 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls podName:63a3ac1b-69ad-4cb3-b6cf-80b11124ab70 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.25686388 +0000 UTC m=+167.455482639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9kxxz" (UID: "63a3ac1b-69ad-4cb3-b6cf-80b11124ab70") : secret "cluster-monitoring-operator-tls" not found May 21 17:35:04.870758 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.870725 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:35:04.871261 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.871167 2568 scope.go:117] "RemoveContainer" containerID="3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1" May 21 17:35:04.871428 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:04.871393 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z7lcn_openshift-console-operator(309d790e-4546-4c56-96b7-ae7ce96db741)\"" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" podUID="309d790e-4546-4c56-96b7-ae7ce96db741" May 21 17:35:04.872228 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.872202 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" event={"ID":"e17a4942-5c3e-45c2-bd46-67a8ad6c9223","Type":"ContainerStarted","Data":"398648ff1e48ffb5b541cbd676d8c0d4c62b383c0bf3e27ffff1010b7f753ccc"} May 21 17:35:04.976153 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.976116 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vxnrm"] May 21 17:35:04.978550 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.978533 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:04.980543 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.980521 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 17:35:04.980669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.980614 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 17:35:04.980866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.980853 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 17:35:04.981092 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.981072 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cqc5t\"" May 21 17:35:04.981221 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.981152 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 17:35:04.988597 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:04.988574 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxnrm"] May 21 17:35:05.062730 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.062690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-crio-socket\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.062730 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.062738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.062987 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.062757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.062987 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.062780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpktx\" (UniqueName: \"kubernetes.io/projected/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-api-access-gpktx\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.062987 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.062856 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-data-volume\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-crio-socket\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163532 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163549 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163862 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-crio-socket\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163862 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:05.163641 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:05.163862 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163622 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpktx\" (UniqueName: \"kubernetes.io/projected/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-api-access-gpktx\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163862 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163691 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-data-volume\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.163862 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:05.163711 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls podName:2dbc48e6-4fa7-468c-97b4-dc41901f81d6 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:05.663693859 +0000 UTC m=+152.862312615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxnrm" (UID: "2dbc48e6-4fa7-468c-97b4-dc41901f81d6") : secret "insights-runtime-extractor-tls" not found May 21 17:35:05.164106 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.163939 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-data-volume\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.164106 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.164048 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.171928 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.171890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpktx\" (UniqueName: \"kubernetes.io/projected/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-kube-api-access-gpktx\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.668567 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.668534 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:05.668702 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:05.668659 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:05.668748 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:05.668711 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls podName:2dbc48e6-4fa7-468c-97b4-dc41901f81d6 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:06.668697408 +0000 UTC m=+153.867316162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxnrm" (UID: "2dbc48e6-4fa7-468c-97b4-dc41901f81d6") : secret "insights-runtime-extractor-tls" not found May 21 17:35:05.876405 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.876369 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" event={"ID":"e17a4942-5c3e-45c2-bd46-67a8ad6c9223","Type":"ContainerStarted","Data":"22c581eff83c807722fcd7685ec3978dc67a7ddcbccca8106fc3f46d6370aa72"} May 21 17:35:05.876405 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.876408 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" event={"ID":"e17a4942-5c3e-45c2-bd46-67a8ad6c9223","Type":"ContainerStarted","Data":"b7f27e7ea5b468a9ff3f95710d5b547f508b8bdb1f3d04b11e8969b3aba8453d"} May 21 17:35:05.891448 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:05.891344 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q5cn8" podStartSLOduration=1.356124492 podStartE2EDuration="2.891327939s" podCreationTimestamp="2026-05-21 17:35:03 +0000 UTC" firstStartedPulling="2026-05-21 17:35:04.105211208 +0000 UTC m=+151.303829963" lastFinishedPulling="2026-05-21 17:35:05.640414652 +0000 UTC m=+152.839033410" observedRunningTime="2026-05-21 17:35:05.890465656 +0000 UTC m=+153.089084450" watchObservedRunningTime="2026-05-21 17:35:05.891327939 +0000 UTC m=+153.089946715" May 21 17:35:06.173090 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:06.172994 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:06.173256 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:06.173138 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 17:35:06.173256 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:06.173207 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls podName:30ef177c-d53c-457f-bc28-1b90c489f533 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:14.173190339 +0000 UTC m=+161.371809099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls") pod "cluster-samples-operator-697587599-5rp9v" (UID: "30ef177c-d53c-457f-bc28-1b90c489f533") : secret "samples-operator-tls" not found May 21 17:35:06.678323 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:06.678281 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:06.678498 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:06.678457 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:06.678546 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:06.678527 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls podName:2dbc48e6-4fa7-468c-97b4-dc41901f81d6 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:08.678510453 +0000 UTC m=+155.877129212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxnrm" (UID: "2dbc48e6-4fa7-468c-97b4-dc41901f81d6") : secret "insights-runtime-extractor-tls" not found May 21 17:35:08.611148 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:08.611111 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:35:08.611148 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:08.611152 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:35:08.611547 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:08.611500 2568 scope.go:117] "RemoveContainer" containerID="3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1" May 21 17:35:08.611664 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:08.611647 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z7lcn_openshift-console-operator(309d790e-4546-4c56-96b7-ae7ce96db741)\"" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" podUID="309d790e-4546-4c56-96b7-ae7ce96db741" May 21 17:35:08.695637 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:08.695600 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:08.695817 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:08.695760 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:08.695869 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:08.695861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls podName:2dbc48e6-4fa7-468c-97b4-dc41901f81d6 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:12.695836854 +0000 UTC m=+159.894455615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxnrm" (UID: "2dbc48e6-4fa7-468c-97b4-dc41901f81d6") : secret "insights-runtime-extractor-tls" not found May 21 17:35:09.227644 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:09.227592 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g8ghl" podUID="2e96c0a6-1243-41d7-b3bd-2dc598972eeb" May 21 17:35:09.239841 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:09.239804 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jrdb8" podUID="b8d7beb7-bfcf-45be-9838-08bab4283641" May 21 17:35:09.887053 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:09.887027 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8ghl" May 21 17:35:10.445003 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:10.444951 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9km89" podUID="da2bcb2a-ebf9-40fa-a347-5c0d47b42744" May 21 17:35:12.728929 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:12.728803 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:12.729327 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:12.728973 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:12.729327 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:12.729041 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls podName:2dbc48e6-4fa7-468c-97b4-dc41901f81d6 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.72902552 +0000 UTC m=+167.927644279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vxnrm" (UID: "2dbc48e6-4fa7-468c-97b4-dc41901f81d6") : secret "insights-runtime-extractor-tls" not found May 21 17:35:14.140554 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.140506 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:35:14.140554 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.140556 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:35:14.142893 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.142870 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e96c0a6-1243-41d7-b3bd-2dc598972eeb-metrics-tls\") pod \"dns-default-g8ghl\" (UID: \"2e96c0a6-1243-41d7-b3bd-2dc598972eeb\") " pod="openshift-dns/dns-default-g8ghl" May 21 17:35:14.142996 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.142978 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d7beb7-bfcf-45be-9838-08bab4283641-cert\") pod \"ingress-canary-jrdb8\" (UID: \"b8d7beb7-bfcf-45be-9838-08bab4283641\") " pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:35:14.241356 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.241322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:14.243672 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.243652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30ef177c-d53c-457f-bc28-1b90c489f533-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5rp9v\" (UID: \"30ef177c-d53c-457f-bc28-1b90c489f533\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:14.313165 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.313129 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" May 21 17:35:14.390277 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.390241 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\"" May 21 17:35:14.399180 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.399105 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8ghl" May 21 17:35:14.437040 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.437003 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v"] May 21 17:35:14.523385 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.523354 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8ghl"] May 21 17:35:14.526303 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:14.526278 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e96c0a6_1243_41d7_b3bd_2dc598972eeb.slice/crio-3144809a7b64e4678ff04c4d25ea739868bb5f98b343fd0f861d710632be5bab WatchSource:0}: Error finding container 3144809a7b64e4678ff04c4d25ea739868bb5f98b343fd0f861d710632be5bab: Status 404 returned error can't find the container with id 3144809a7b64e4678ff04c4d25ea739868bb5f98b343fd0f861d710632be5bab May 21 17:35:14.900240 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.900201 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8ghl" event={"ID":"2e96c0a6-1243-41d7-b3bd-2dc598972eeb","Type":"ContainerStarted","Data":"3144809a7b64e4678ff04c4d25ea739868bb5f98b343fd0f861d710632be5bab"} May 21 17:35:14.901107 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:14.901083 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" event={"ID":"30ef177c-d53c-457f-bc28-1b90c489f533","Type":"ContainerStarted","Data":"5ccf05967a10ad19a041bcf90c46e55cf6b6e4244b5ffcdb1d89ba9a4d358021"} May 21 17:35:16.908440 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.908405 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8ghl" event={"ID":"2e96c0a6-1243-41d7-b3bd-2dc598972eeb","Type":"ContainerStarted","Data":"1e803d44e1be9669b52cccac9e19b59b8ee5b801e04ca7d3aa7d03201cd1cc93"} May 21 17:35:16.908440 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.908448 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8ghl" event={"ID":"2e96c0a6-1243-41d7-b3bd-2dc598972eeb","Type":"ContainerStarted","Data":"937b1d6a7e1c8b1979e00b70b73dc60c94f1b501f5b60da93025e88d363f1fdf"} May 21 17:35:16.908905 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.908533 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g8ghl" May 21 17:35:16.909955 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.909931 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" event={"ID":"30ef177c-d53c-457f-bc28-1b90c489f533","Type":"ContainerStarted","Data":"5db0a174ed72f0ac311d6ca2cf783e655d12e345b09275c989f82dcc7318fe4e"} May 21 17:35:16.910062 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.909962 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" event={"ID":"30ef177c-d53c-457f-bc28-1b90c489f533","Type":"ContainerStarted","Data":"4fcf24856789fb5831f43b2be1809f7b2b29aa4d50c1e8d49e96d51983a91d2c"} May 21 17:35:16.924024 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.923979 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-g8ghl" podStartSLOduration=129.481301373 podStartE2EDuration="2m10.923964199s" podCreationTimestamp="2026-05-21 17:33:06 +0000 UTC" firstStartedPulling="2026-05-21 17:35:14.528084046 +0000 UTC m=+161.726702804" lastFinishedPulling="2026-05-21 17:35:15.970746874 +0000 UTC m=+163.169365630" observedRunningTime="2026-05-21 17:35:16.922599484 +0000 UTC m=+164.121218255" watchObservedRunningTime="2026-05-21 17:35:16.923964199 +0000 UTC m=+164.122582975" May 21 17:35:16.936377 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:16.936335 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5rp9v" podStartSLOduration=16.99174396 podStartE2EDuration="18.936321159s" podCreationTimestamp="2026-05-21 17:34:58 +0000 UTC" firstStartedPulling="2026-05-21 17:35:14.488954729 +0000 UTC m=+161.687573499" lastFinishedPulling="2026-05-21 17:35:16.433531942 +0000 UTC m=+163.632150698" observedRunningTime="2026-05-21 17:35:16.935451835 +0000 UTC m=+164.134070613" watchObservedRunningTime="2026-05-21 17:35:16.936321159 +0000 UTC m=+164.134939937" May 21 17:35:20.288645 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.288602 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:35:20.291007 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.290986 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63a3ac1b-69ad-4cb3-b6cf-80b11124ab70-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9kxxz\" (UID: \"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:35:20.432565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.432516 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:35:20.435074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.435041 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\"" May 21 17:35:20.443409 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.443380 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrdb8" May 21 17:35:20.575480 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.575402 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrdb8"] May 21 17:35:20.578744 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:20.578718 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d7beb7_bfcf_45be_9838_08bab4283641.slice/crio-a693c6b0ab125bd431f1b1863f0a55608e8a841d3a234467c140e6db71afcd12 WatchSource:0}: Error finding container a693c6b0ab125bd431f1b1863f0a55608e8a841d3a234467c140e6db71afcd12: Status 404 returned error can't find the container with id a693c6b0ab125bd431f1b1863f0a55608e8a841d3a234467c140e6db71afcd12 May 21 17:35:20.584876 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.584856 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" May 21 17:35:20.703393 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.703365 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz"] May 21 17:35:20.705843 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:20.705818 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a3ac1b_69ad_4cb3_b6cf_80b11124ab70.slice/crio-c02e5a51d21ed317e5085057ecaf1d4d1f3db6fb7c556a6935e8e7a3847b438e WatchSource:0}: Error finding container c02e5a51d21ed317e5085057ecaf1d4d1f3db6fb7c556a6935e8e7a3847b438e: Status 404 returned error can't find the container with id c02e5a51d21ed317e5085057ecaf1d4d1f3db6fb7c556a6935e8e7a3847b438e May 21 17:35:20.792794 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.792763 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:20.795014 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.794995 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dbc48e6-4fa7-468c-97b4-dc41901f81d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vxnrm\" (UID: \"2dbc48e6-4fa7-468c-97b4-dc41901f81d6\") " pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:20.888495 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.888400 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vxnrm" May 21 17:35:20.921943 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.921885 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" event={"ID":"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70","Type":"ContainerStarted","Data":"c02e5a51d21ed317e5085057ecaf1d4d1f3db6fb7c556a6935e8e7a3847b438e"} May 21 17:35:20.923804 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:20.923771 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrdb8" event={"ID":"b8d7beb7-bfcf-45be-9838-08bab4283641","Type":"ContainerStarted","Data":"a693c6b0ab125bd431f1b1863f0a55608e8a841d3a234467c140e6db71afcd12"} May 21 17:35:21.029516 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:21.029483 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vxnrm"] May 21 17:35:21.032661 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:21.032630 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbc48e6_4fa7_468c_97b4_dc41901f81d6.slice/crio-762bd1edf713d126e6345063286251f7ee404e42d68d397f7a75b0c4e89e9f9f WatchSource:0}: Error finding container 762bd1edf713d126e6345063286251f7ee404e42d68d397f7a75b0c4e89e9f9f: Status 404 returned error can't find the container with id 762bd1edf713d126e6345063286251f7ee404e42d68d397f7a75b0c4e89e9f9f May 21 17:35:21.928619 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:21.928578 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxnrm" event={"ID":"2dbc48e6-4fa7-468c-97b4-dc41901f81d6","Type":"ContainerStarted","Data":"0971f0094ceb48227dab4839571edbcd6a363d5a6a9404e666bb7298d9db02e2"} May 21 17:35:21.928619 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:21.928623 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxnrm" event={"ID":"2dbc48e6-4fa7-468c-97b4-dc41901f81d6","Type":"ContainerStarted","Data":"762bd1edf713d126e6345063286251f7ee404e42d68d397f7a75b0c4e89e9f9f"} May 21 17:35:22.432596 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.432563 2568 scope.go:117] "RemoveContainer" containerID="3510d27fdfa6301136668d1ebc4427745a70aa7c12cc235c3bb008ecd9366ae1" May 21 17:35:22.936241 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.936211 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxnrm" event={"ID":"2dbc48e6-4fa7-468c-97b4-dc41901f81d6","Type":"ContainerStarted","Data":"9110cbdd11ca4c92bfed150a3bec017fbde4393a565940e0ac081f55cb6102cc"} May 21 17:35:22.938290 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.938095 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrdb8" event={"ID":"b8d7beb7-bfcf-45be-9838-08bab4283641","Type":"ContainerStarted","Data":"13be209ddafcb0c504d0e434a111a635c6ea8b202460ba2fed4c82551778c997"} May 21 17:35:22.946136 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.946047 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:35:22.946278 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.946229 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" event={"ID":"309d790e-4546-4c56-96b7-ae7ce96db741","Type":"ContainerStarted","Data":"87a53510432df81dce37824539e610b0a5c1593140754c546cfe0b931909e332"} May 21 17:35:22.947455 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.947414 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:35:22.948779 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.948749 2568 patch_prober.go:28] interesting pod/console-operator-76dff48d59-z7lcn container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= May 21 17:35:22.948885 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.948805 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" podUID="309d790e-4546-4c56-96b7-ae7ce96db741" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" May 21 17:35:22.953395 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.953139 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jrdb8" podStartSLOduration=135.384919242 podStartE2EDuration="2m16.953126969s" podCreationTimestamp="2026-05-21 17:33:06 +0000 UTC" firstStartedPulling="2026-05-21 17:35:20.580531757 +0000 UTC m=+167.779150511" lastFinishedPulling="2026-05-21 17:35:22.148739477 +0000 UTC m=+169.347358238" observedRunningTime="2026-05-21 17:35:22.952219069 +0000 UTC m=+170.150837847" watchObservedRunningTime="2026-05-21 17:35:22.953126969 +0000 UTC m=+170.151745764" May 21 17:35:22.969086 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:22.969016 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" podStartSLOduration=21.822150548 podStartE2EDuration="24.968998357s" podCreationTimestamp="2026-05-21 17:34:58 +0000 UTC" firstStartedPulling="2026-05-21 17:34:58.741943738 +0000 UTC m=+145.940562493" lastFinishedPulling="2026-05-21 17:35:01.888791544 +0000 UTC m=+149.087410302" observedRunningTime="2026-05-21 17:35:22.967675682 +0000 UTC m=+170.166294482" watchObservedRunningTime="2026-05-21 17:35:22.968998357 +0000 UTC m=+170.167617134" May 21 17:35:23.434705 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.434674 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:35:23.950612 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.950582 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vxnrm" event={"ID":"2dbc48e6-4fa7-468c-97b4-dc41901f81d6","Type":"ContainerStarted","Data":"dd7d92bc61fa9041834c952dc70d4feccc2ba378f14e78b2101300782733be99"} May 21 17:35:23.951854 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.951826 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" event={"ID":"63a3ac1b-69ad-4cb3-b6cf-80b11124ab70","Type":"ContainerStarted","Data":"43dbc3254226a1a454411e76d539696cef3af58bfd0ab3ce4c0b2d60e3f0536c"} May 21 17:35:23.957091 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.957069 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-z7lcn" May 21 17:35:23.968112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.968065 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vxnrm" podStartSLOduration=17.189597501 podStartE2EDuration="19.968051298s" podCreationTimestamp="2026-05-21 17:35:04 +0000 UTC" firstStartedPulling="2026-05-21 17:35:21.101867115 +0000 UTC m=+168.300485876" lastFinishedPulling="2026-05-21 17:35:23.880320914 +0000 UTC m=+171.078939673" observedRunningTime="2026-05-21 17:35:23.967094497 +0000 UTC m=+171.165713275" watchObservedRunningTime="2026-05-21 17:35:23.968051298 +0000 UTC m=+171.166670075" May 21 17:35:23.981866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:23.981820 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9kxxz" podStartSLOduration=33.789497199 podStartE2EDuration="35.981807076s" podCreationTimestamp="2026-05-21 17:34:48 +0000 UTC" firstStartedPulling="2026-05-21 17:35:20.707758367 +0000 UTC m=+167.906377125" lastFinishedPulling="2026-05-21 17:35:22.900068034 +0000 UTC m=+170.098687002" observedRunningTime="2026-05-21 17:35:23.981410444 +0000 UTC m=+171.180029222" watchObservedRunningTime="2026-05-21 17:35:23.981807076 +0000 UTC m=+171.180425853" May 21 17:35:24.163552 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.163463 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-744b9fcdbc-992sj"] May 21 17:35:24.166731 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.166706 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.169769 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.169736 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 17:35:24.169892 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.169814 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 17:35:24.169892 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.169838 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 17:35:24.170033 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.170016 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rwzsm\"" May 21 17:35:24.174417 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.174400 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 17:35:24.178056 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.178034 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-744b9fcdbc-992sj"] May 21 17:35:24.235821 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.235786 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-744b9fcdbc-992sj"] May 21 17:35:24.236003 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:24.235977 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-86hrs registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-86hrs registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" podUID="e2300337-3350-4b00-af29-86473ef9851f" May 21 17:35:24.322618 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322618 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86hrs\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.322835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.323030 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.322846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424280 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424177 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424280 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424229 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424280 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424264 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424280 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424282 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424300 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424321 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86hrs\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424373 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424480 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.424906 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.424886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.425273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.425214 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.425273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.425252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.427048 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.427019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.427191 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.427176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.427241 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.427222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.432134 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.432111 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.432421 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.432398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86hrs\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs\") pod \"image-registry-744b9fcdbc-992sj\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.957422 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.956695 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:24.961723 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:24.961702 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:25.129677 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129641 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86hrs\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.129843 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129688 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.129843 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129709 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.129843 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129733 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.130033 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129850 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.130033 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129896 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.130033 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129943 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.130033 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.129968 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls\") pod \"e2300337-3350-4b00-af29-86473ef9851f\" (UID: \"e2300337-3350-4b00-af29-86473ef9851f\") " May 21 17:35:25.130236 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.130071 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:35:25.130285 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.130254 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:35:25.131037 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.130338 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-trusted-ca\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.131037 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.130351 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:35:25.131037 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.130362 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2300337-3350-4b00-af29-86473ef9851f-ca-trust-extracted\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.132478 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.132446 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:35:25.132573 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.132459 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs" (OuterVolumeSpecName: "kube-api-access-86hrs") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "kube-api-access-86hrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:35:25.132573 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.132523 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:35:25.132573 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.132523 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:35:25.132815 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.132797 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e2300337-3350-4b00-af29-86473ef9851f" (UID: "e2300337-3350-4b00-af29-86473ef9851f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230707 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-registry-tls\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230741 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86hrs\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-kube-api-access-86hrs\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230755 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-installation-pull-secrets\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230770 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2300337-3350-4b00-af29-86473ef9851f-image-registry-private-configuration\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230780 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2300337-3350-4b00-af29-86473ef9851f-registry-certificates\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.230802 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.230789 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2300337-3350-4b00-af29-86473ef9851f-bound-sa-token\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:35:25.958647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.958605 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744b9fcdbc-992sj" May 21 17:35:25.987650 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.987621 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-744b9fcdbc-992sj"] May 21 17:35:25.991039 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:25.991010 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-744b9fcdbc-992sj"] May 21 17:35:26.915410 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:26.915384 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g8ghl" May 21 17:35:27.436314 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.436282 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2300337-3350-4b00-af29-86473ef9851f" path="/var/lib/kubelet/pods/e2300337-3350-4b00-af29-86473ef9851f/volumes" May 21 17:35:27.442614 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.442588 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl"] May 21 17:35:27.446859 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.446840 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.449207 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.449184 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 17:35:27.449318 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.449190 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 17:35:27.449318 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.449219 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 17:35:27.450446 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.450421 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fcz2b\"" May 21 17:35:27.452581 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.452547 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl"] May 21 17:35:27.547809 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.547767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5pc\" (UniqueName: \"kubernetes.io/projected/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-kube-api-access-zf5pc\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.547809 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.547810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.548041 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.547903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.548041 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.547978 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.649307 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.649264 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.649307 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.649311 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5pc\" (UniqueName: \"kubernetes.io/projected/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-kube-api-access-zf5pc\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.649515 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.649350 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.649584 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.649560 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.650097 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.650064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.651814 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.651792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.651901 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.651795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.659573 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.659548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5pc\" (UniqueName: \"kubernetes.io/projected/ab6c4d05-33ed-4e96-b3a9-9b051aea7d99-kube-api-access-zf5pc\") pod \"prometheus-operator-7779bbdd78-2k8vl\" (UID: \"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.755756 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.755660 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" May 21 17:35:27.877399 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.877368 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl"] May 21 17:35:27.880450 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:27.880423 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6c4d05_33ed_4e96_b3a9_9b051aea7d99.slice/crio-297ab684a5c47aef9d62db1b313b231dcaf818255ee4749c6090c52fd82970d7 WatchSource:0}: Error finding container 297ab684a5c47aef9d62db1b313b231dcaf818255ee4749c6090c52fd82970d7: Status 404 returned error can't find the container with id 297ab684a5c47aef9d62db1b313b231dcaf818255ee4749c6090c52fd82970d7 May 21 17:35:27.964690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:27.964654 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" event={"ID":"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99","Type":"ContainerStarted","Data":"297ab684a5c47aef9d62db1b313b231dcaf818255ee4749c6090c52fd82970d7"} May 21 17:35:29.976464 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:29.976425 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" event={"ID":"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99","Type":"ContainerStarted","Data":"96b78138cd54687d15215b9b04d9302cdb7b6784131e5ebc91532638c6030ecc"} May 21 17:35:29.976464 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:29.976465 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" event={"ID":"ab6c4d05-33ed-4e96-b3a9-9b051aea7d99","Type":"ContainerStarted","Data":"884f313a6e768e672e12ec229bbefcc72e4bd1509aa5eb0ea89ae8f4dea1b6cd"} May 21 17:35:29.991286 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:29.991227 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-2k8vl" podStartSLOduration=1.541408282 podStartE2EDuration="2.991210666s" podCreationTimestamp="2026-05-21 17:35:27 +0000 UTC" firstStartedPulling="2026-05-21 17:35:27.882385591 +0000 UTC m=+175.081004346" lastFinishedPulling="2026-05-21 17:35:29.332187972 +0000 UTC m=+176.530806730" observedRunningTime="2026-05-21 17:35:29.991096819 +0000 UTC m=+177.189715596" watchObservedRunningTime="2026-05-21 17:35:29.991210666 +0000 UTC m=+177.189829443" May 21 17:35:31.789252 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.789215 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jxndk"] May 21 17:35:31.792591 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.792571 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:31.794940 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.794905 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 17:35:31.795190 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.795168 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 17:35:31.795287 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.795223 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kgp8j\"" May 21 17:35:31.803487 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.803461 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jxndk"] May 21 17:35:31.811561 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.811533 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mxjsg"] May 21 17:35:31.814880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.814862 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.817841 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.817259 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 17:35:31.817993 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.817855 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 17:35:31.817993 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.817972 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h42qc\"" May 21 17:35:31.818116 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.818005 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 17:35:31.982781 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.982781 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e6e82-a5b7-4936-afaf-41bfb6032563-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-sys\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.982985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-textfile\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983002 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-metrics-client-ca\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmb7\" (UniqueName: \"kubernetes.io/projected/0f0e6e82-a5b7-4936-afaf-41bfb6032563-kube-api-access-twmb7\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:31.983381 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-wtmp\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983381 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck8jt\" (UniqueName: \"kubernetes.io/projected/707ebcb5-f21d-48fe-b312-e351135519db-kube-api-access-ck8jt\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983381 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-root\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:31.983381 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:31.983243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.083825 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083721 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.083825 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.083825 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083813 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083841 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083881 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083905 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e6e82-a5b7-4936-afaf-41bfb6032563-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.083979 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-sys\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084003 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-textfile\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:32.084005 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084069 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-sys\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:32.084078 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls podName:707ebcb5-f21d-48fe-b312-e351135519db nodeName:}" failed. No retries permitted until 2026-05-21 17:35:32.584058282 +0000 UTC m=+179.782677044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls") pod "node-exporter-mxjsg" (UID: "707ebcb5-f21d-48fe-b312-e351135519db") : secret "node-exporter-tls" not found May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084107 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-metrics-client-ca\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084150 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084135 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twmb7\" (UniqueName: \"kubernetes.io/projected/0f0e6e82-a5b7-4936-afaf-41bfb6032563-kube-api-access-twmb7\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084186 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-wtmp\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck8jt\" (UniqueName: \"kubernetes.io/projected/707ebcb5-f21d-48fe-b312-e351135519db-kube-api-access-ck8jt\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084256 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-root\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-root\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084451 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-wtmp\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084675 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084452 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084994 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084763 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-textfile\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.084994 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084838 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e6e82-a5b7-4936-afaf-41bfb6032563-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.084994 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.084985 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707ebcb5-f21d-48fe-b312-e351135519db-metrics-client-ca\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.086452 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.086430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.086715 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.086699 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.086860 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.086844 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f0e6e82-a5b7-4936-afaf-41bfb6032563-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.093476 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.093449 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck8jt\" (UniqueName: \"kubernetes.io/projected/707ebcb5-f21d-48fe-b312-e351135519db-kube-api-access-ck8jt\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.093609 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.093517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmb7\" (UniqueName: \"kubernetes.io/projected/0f0e6e82-a5b7-4936-afaf-41bfb6032563-kube-api-access-twmb7\") pod \"openshift-state-metrics-9c959559f-jxndk\" (UID: \"0f0e6e82-a5b7-4936-afaf-41bfb6032563\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.101314 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.101290 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" May 21 17:35:32.231005 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.230970 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jxndk"] May 21 17:35:32.233812 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:32.233781 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0e6e82_a5b7_4936_afaf_41bfb6032563.slice/crio-14bb648b1724086e1e062b834f33a33aed07092577eab5f0cae40c4afd333fa4 WatchSource:0}: Error finding container 14bb648b1724086e1e062b834f33a33aed07092577eab5f0cae40c4afd333fa4: Status 404 returned error can't find the container with id 14bb648b1724086e1e062b834f33a33aed07092577eab5f0cae40c4afd333fa4 May 21 17:35:32.588152 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.588051 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:32.588338 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:32.588263 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 17:35:32.588399 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:32.588344 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls podName:707ebcb5-f21d-48fe-b312-e351135519db nodeName:}" failed. No retries permitted until 2026-05-21 17:35:33.588322402 +0000 UTC m=+180.786941172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls") pod "node-exporter-mxjsg" (UID: "707ebcb5-f21d-48fe-b312-e351135519db") : secret "node-exporter-tls" not found May 21 17:35:32.986383 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.986281 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" event={"ID":"0f0e6e82-a5b7-4936-afaf-41bfb6032563","Type":"ContainerStarted","Data":"a90fa4ef0dbacfa54c51c15ee08a304194cb2083a81d88f88dc6e25a0675ce56"} May 21 17:35:32.986383 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.986349 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" event={"ID":"0f0e6e82-a5b7-4936-afaf-41bfb6032563","Type":"ContainerStarted","Data":"97b1e59bce9a2a462f286b2231c3d48af420c114cc44c9540bea474d81196df4"} May 21 17:35:32.986383 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:32.986364 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" event={"ID":"0f0e6e82-a5b7-4936-afaf-41bfb6032563","Type":"ContainerStarted","Data":"14bb648b1724086e1e062b834f33a33aed07092577eab5f0cae40c4afd333fa4"} May 21 17:35:33.596405 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.596377 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:33.598568 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.598504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/707ebcb5-f21d-48fe-b312-e351135519db-node-exporter-tls\") pod \"node-exporter-mxjsg\" (UID: \"707ebcb5-f21d-48fe-b312-e351135519db\") " pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:33.626714 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.626680 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h42qc\"" May 21 17:35:33.635216 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.635184 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxjsg" May 21 17:35:33.644011 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:33.643980 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707ebcb5_f21d_48fe_b312_e351135519db.slice/crio-e5b4bfc8b23fc5f25a0c79c8300359705848f1d4d7a5ca13c1b5618f6c44a27e WatchSource:0}: Error finding container e5b4bfc8b23fc5f25a0c79c8300359705848f1d4d7a5ca13c1b5618f6c44a27e: Status 404 returned error can't find the container with id e5b4bfc8b23fc5f25a0c79c8300359705848f1d4d7a5ca13c1b5618f6c44a27e May 21 17:35:33.775233 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.775198 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dddc7d686-rls58"] May 21 17:35:33.780211 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.780191 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.782692 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.782623 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 17:35:33.782823 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.782692 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 17:35:33.782823 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.782744 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mp6b2\"" May 21 17:35:33.782823 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.782628 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 17:35:33.782823 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.782626 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 17:35:33.783039 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.783005 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 17:35:33.783113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.783068 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-289hd1v184blj\"" May 21 17:35:33.790098 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.790045 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dddc7d686-rls58"] May 21 17:35:33.898808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.898770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb78619-3f85-4de0-bebd-9673bccf15a7-metrics-client-ca\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.898816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llt8j\" (UniqueName: \"kubernetes.io/projected/3bb78619-3f85-4de0-bebd-9673bccf15a7-kube-api-access-llt8j\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.898872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.898946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899020 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.898990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-grpc-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899153 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.899022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899153 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.899045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.899153 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.899061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.991216 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.991179 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" event={"ID":"0f0e6e82-a5b7-4936-afaf-41bfb6032563","Type":"ContainerStarted","Data":"1f489f84e6b1ae4c8270e6b1ce5cfd31bb49700896d56935728ad41165817c08"} May 21 17:35:33.992283 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.992259 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxjsg" event={"ID":"707ebcb5-f21d-48fe-b312-e351135519db","Type":"ContainerStarted","Data":"e5b4bfc8b23fc5f25a0c79c8300359705848f1d4d7a5ca13c1b5618f6c44a27e"} May 21 17:35:33.999847 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.999824 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llt8j\" (UniqueName: \"kubernetes.io/projected/3bb78619-3f85-4de0-bebd-9673bccf15a7-kube-api-access-llt8j\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.999974 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.999863 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:33.999974 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.999905 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000095 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:33.999990 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-grpc-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000095 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.000029 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000095 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.000058 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000095 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.000089 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000292 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.000145 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb78619-3f85-4de0-bebd-9673bccf15a7-metrics-client-ca\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.000926 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.000891 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb78619-3f85-4de0-bebd-9673bccf15a7-metrics-client-ca\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.002838 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.002805 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.003018 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.002851 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-grpc-tls\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.003018 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.002857 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.003113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.003012 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.003113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.003019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.003113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.003078 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb78619-3f85-4de0-bebd-9673bccf15a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.006281 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.006262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llt8j\" (UniqueName: \"kubernetes.io/projected/3bb78619-3f85-4de0-bebd-9673bccf15a7-kube-api-access-llt8j\") pod \"thanos-querier-7dddc7d686-rls58\" (UID: \"3bb78619-3f85-4de0-bebd-9673bccf15a7\") " pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.008700 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.008646 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jxndk" podStartSLOduration=1.8144095949999999 podStartE2EDuration="3.008632993s" podCreationTimestamp="2026-05-21 17:35:31 +0000 UTC" firstStartedPulling="2026-05-21 17:35:32.345270571 +0000 UTC m=+179.543889332" lastFinishedPulling="2026-05-21 17:35:33.539493965 +0000 UTC m=+180.738112730" observedRunningTime="2026-05-21 17:35:34.007942319 +0000 UTC m=+181.206561095" watchObservedRunningTime="2026-05-21 17:35:34.008632993 +0000 UTC m=+181.207251772" May 21 17:35:34.090190 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.090111 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:34.242988 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.242943 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dddc7d686-rls58"] May 21 17:35:34.247009 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:34.246983 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb78619_3f85_4de0_bebd_9673bccf15a7.slice/crio-751bc4849f85917c87a56c3a85eaa79b6c63a2959c3b9e55aa489c534ed2b446 WatchSource:0}: Error finding container 751bc4849f85917c87a56c3a85eaa79b6c63a2959c3b9e55aa489c534ed2b446: Status 404 returned error can't find the container with id 751bc4849f85917c87a56c3a85eaa79b6c63a2959c3b9e55aa489c534ed2b446 May 21 17:35:34.995603 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:34.995571 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"751bc4849f85917c87a56c3a85eaa79b6c63a2959c3b9e55aa489c534ed2b446"} May 21 17:35:35.999747 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:35.999714 2568 generic.go:358] "Generic (PLEG): container finished" podID="707ebcb5-f21d-48fe-b312-e351135519db" containerID="54d1f29f4b775ab443c17f85733abe3ad6b8471206432b1c33f99828338ec908" exitCode=0 May 21 17:35:36.000261 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:35.999773 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxjsg" event={"ID":"707ebcb5-f21d-48fe-b312-e351135519db","Type":"ContainerDied","Data":"54d1f29f4b775ab443c17f85733abe3ad6b8471206432b1c33f99828338ec908"} May 21 17:35:36.593082 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.593043 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wm45t"] May 21 17:35:36.596031 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.596006 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:36.598353 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.598327 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 17:35:36.598353 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.598336 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-zfmjw\"" May 21 17:35:36.600580 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.600537 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wm45t"] May 21 17:35:36.622840 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.622804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wm45t\" (UID: \"a3de2530-3d52-417a-b614-d4c9087cd0bf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:36.723715 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:36.723679 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wm45t\" (UID: \"a3de2530-3d52-417a-b614-d4c9087cd0bf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:36.723897 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:36.723840 2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 17:35:36.723983 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:36.723942 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert podName:a3de2530-3d52-417a-b614-d4c9087cd0bf nodeName:}" failed. No retries permitted until 2026-05-21 17:35:37.223896647 +0000 UTC m=+184.422515445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-wm45t" (UID: "a3de2530-3d52-417a-b614-d4c9087cd0bf") : secret "monitoring-plugin-cert" not found May 21 17:35:37.005535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.005495 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxjsg" event={"ID":"707ebcb5-f21d-48fe-b312-e351135519db","Type":"ContainerStarted","Data":"7d01a3491746ee6a0d7a691c8a680c8615d389e299fdeaef65a95c6c0f0cdbe5"} May 21 17:35:37.005535 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.005540 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxjsg" event={"ID":"707ebcb5-f21d-48fe-b312-e351135519db","Type":"ContainerStarted","Data":"e44398083078e9a705dd4bf869653038fbaf575d4c71fdc1c2d1ecefed573394"} May 21 17:35:37.007157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.007133 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"3911a04695ed82e2278e9f516c4334c2f1ec2d3776907bd43f13c3b485a6a34b"} May 21 17:35:37.007263 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.007162 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"701982ae670d5d94c184488c06e95af77c31b3819b608589cfd49c6c49b4e057"} May 21 17:35:37.022210 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.022169 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mxjsg" podStartSLOduration=4.547259146 podStartE2EDuration="6.022154254s" podCreationTimestamp="2026-05-21 17:35:31 +0000 UTC" firstStartedPulling="2026-05-21 17:35:33.645673935 +0000 UTC m=+180.844292690" lastFinishedPulling="2026-05-21 17:35:35.12056903 +0000 UTC m=+182.319187798" observedRunningTime="2026-05-21 17:35:37.021007644 +0000 UTC m=+184.219626422" watchObservedRunningTime="2026-05-21 17:35:37.022154254 +0000 UTC m=+184.220773031" May 21 17:35:37.228045 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.227934 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wm45t\" (UID: \"a3de2530-3d52-417a-b614-d4c9087cd0bf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:37.228045 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:37.228019 2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 17:35:37.228279 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:35:37.228113 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert podName:a3de2530-3d52-417a-b614-d4c9087cd0bf nodeName:}" failed. No retries permitted until 2026-05-21 17:35:38.228080037 +0000 UTC m=+185.426698808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-wm45t" (UID: "a3de2530-3d52-417a-b614-d4c9087cd0bf") : secret "monitoring-plugin-cert" not found May 21 17:35:37.960727 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.960688 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:35:37.965347 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.965314 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:37.967712 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.967634 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 17:35:37.967953 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.967935 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 17:35:37.968217 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968162 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 17:35:37.968327 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968301 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 17:35:37.968402 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968350 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2gvrr\"" May 21 17:35:37.968402 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968388 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etg1gtkn67q4e\"" May 21 17:35:37.968521 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968438 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 17:35:37.968521 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968477 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 17:35:37.968975 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968949 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 17:35:37.968975 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.968967 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 17:35:37.969229 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.969211 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 17:35:37.969486 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.969468 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 17:35:37.969981 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.969962 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 17:35:37.971253 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.971224 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 17:35:37.976433 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.976406 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:35:37.977858 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:37.977828 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 17:35:38.015875 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.015826 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"46ad132697aaaedd75379a6a9852f0aba0dda9c8f0c91ddf393242df552e6776"} May 21 17:35:38.016269 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.015881 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"9bdd2a514c94b78d1da61a72b35fc4695a45343a85981f264989b4be577c154f"} May 21 17:35:38.016269 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.015896 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"5f6020825e27791a39363bcfe955baabe093c74dda001120d6160bd8ebff536e"} May 21 17:35:38.016269 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.015933 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" event={"ID":"3bb78619-3f85-4de0-bebd-9673bccf15a7","Type":"ContainerStarted","Data":"2c4524ff93d163cbea343cb17b8711936e89222ec91f4711ec38bd26bdab707c"} May 21 17:35:38.036996 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.036956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037179 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037179 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037055 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q5cv\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037179 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037352 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037352 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037352 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037352 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037396 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037574 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037664 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.037846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.037678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.042628 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.042579 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" podStartSLOduration=1.495209961 podStartE2EDuration="5.042563231s" podCreationTimestamp="2026-05-21 17:35:33 +0000 UTC" firstStartedPulling="2026-05-21 17:35:34.248876894 +0000 UTC m=+181.447495664" lastFinishedPulling="2026-05-21 17:35:37.796230175 +0000 UTC m=+184.994848934" observedRunningTime="2026-05-21 17:35:38.040895669 +0000 UTC m=+185.239514446" watchObservedRunningTime="2026-05-21 17:35:38.042563231 +0000 UTC m=+185.241182009" May 21 17:35:38.139146 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139049 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139146 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139088 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139146 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139110 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139427 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139251 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139427 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139285 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139427 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139316 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139427 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139342 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139634 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139472 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139634 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139527 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139634 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139565 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139634 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139593 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139634 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139622 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139636 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139763 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139805 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139838 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q5cv\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.139880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.140147 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139906 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.140147 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.139966 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.141193 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.140851 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.141525 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.141499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.141812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.141788 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.142214 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.142185 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.142647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.142620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.142946 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.142904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.143336 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.143311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.143432 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.143409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.144790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.144758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.144790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.144773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.145288 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.145268 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.145358 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.145306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.145736 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.145715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.146003 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.145985 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.146092 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.145990 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.147298 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.147277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.148588 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.148567 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q5cv\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv\") pod \"prometheus-k8s-0\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.241433 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.241383 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wm45t\" (UID: \"a3de2530-3d52-417a-b614-d4c9087cd0bf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:38.243948 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.243923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3de2530-3d52-417a-b614-d4c9087cd0bf-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wm45t\" (UID: \"a3de2530-3d52-417a-b614-d4c9087cd0bf\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:38.284840 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.284801 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:35:38.409019 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.408901 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:38.437508 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.437446 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:35:38.445516 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:38.445477 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119449f8_348c_4289_a8d6_94e5c364df98.slice/crio-bb22802ddde553bf9935a1438f0c5682e0b983ff1a98a4dd2b88d4cedb8225f6 WatchSource:0}: Error finding container bb22802ddde553bf9935a1438f0c5682e0b983ff1a98a4dd2b88d4cedb8225f6: Status 404 returned error can't find the container with id bb22802ddde553bf9935a1438f0c5682e0b983ff1a98a4dd2b88d4cedb8225f6 May 21 17:35:38.555988 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:38.555902 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wm45t"] May 21 17:35:38.558976 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:35:38.558948 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3de2530_3d52_417a_b614_d4c9087cd0bf.slice/crio-118e2864e08928e3ed5aa68f41964b8308cfd8056058edf669e58f36547ac54b WatchSource:0}: Error finding container 118e2864e08928e3ed5aa68f41964b8308cfd8056058edf669e58f36547ac54b: Status 404 returned error can't find the container with id 118e2864e08928e3ed5aa68f41964b8308cfd8056058edf669e58f36547ac54b May 21 17:35:39.019992 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:39.019954 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" event={"ID":"a3de2530-3d52-417a-b614-d4c9087cd0bf","Type":"ContainerStarted","Data":"118e2864e08928e3ed5aa68f41964b8308cfd8056058edf669e58f36547ac54b"} May 21 17:35:39.021308 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:39.021278 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"bb22802ddde553bf9935a1438f0c5682e0b983ff1a98a4dd2b88d4cedb8225f6"} May 21 17:35:39.021659 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:39.021637 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:40.025820 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.025785 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" event={"ID":"a3de2530-3d52-417a-b614-d4c9087cd0bf","Type":"ContainerStarted","Data":"3ab0c9007badd9bafa60354772929151434c4a7b071e3cfe79bc602beb088953"} May 21 17:35:40.026312 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.025972 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:40.027237 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.027213 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" exitCode=0 May 21 17:35:40.027377 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.027307 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} May 21 17:35:40.030970 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.030949 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" May 21 17:35:40.040594 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:40.040549 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wm45t" podStartSLOduration=2.724365145 podStartE2EDuration="4.040534829s" podCreationTimestamp="2026-05-21 17:35:36 +0000 UTC" firstStartedPulling="2026-05-21 17:35:38.560730426 +0000 UTC m=+185.759349182" lastFinishedPulling="2026-05-21 17:35:39.876900109 +0000 UTC m=+187.075518866" observedRunningTime="2026-05-21 17:35:40.039401416 +0000 UTC m=+187.238020218" watchObservedRunningTime="2026-05-21 17:35:40.040534829 +0000 UTC m=+187.239153606" May 21 17:35:43.047750 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:43.047663 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} May 21 17:35:43.047750 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:43.047707 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} May 21 17:35:43.047750 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:43.047722 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} May 21 17:35:44.054086 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:44.054041 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} May 21 17:35:44.054086 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:44.054083 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} May 21 17:35:44.054545 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:44.054098 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerStarted","Data":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} May 21 17:35:44.083459 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:44.083366 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.721727945 podStartE2EDuration="7.08334928s" podCreationTimestamp="2026-05-21 17:35:37 +0000 UTC" firstStartedPulling="2026-05-21 17:35:38.449235009 +0000 UTC m=+185.647853767" lastFinishedPulling="2026-05-21 17:35:42.810856344 +0000 UTC m=+190.009475102" observedRunningTime="2026-05-21 17:35:44.081167929 +0000 UTC m=+191.279786706" watchObservedRunningTime="2026-05-21 17:35:44.08334928 +0000 UTC m=+191.281968057" May 21 17:35:45.033108 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:45.033053 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dddc7d686-rls58" May 21 17:35:48.285782 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:35:48.285738 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:12.151194 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:12.151165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jrdb8_b8d7beb7-bfcf-45be-9838-08bab4283641/serve-healthcheck-canary/0.log" May 21 17:36:18.163625 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:18.163589 2568 generic.go:358] "Generic (PLEG): container finished" podID="643f8836-6a43-49c2-b055-0a67ce61c831" containerID="029152a9650550a5481aaa06cd54f17cfb13cdd5f09b373fd00d234600b0a05d" exitCode=0 May 21 17:36:18.163625 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:18.163629 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" event={"ID":"643f8836-6a43-49c2-b055-0a67ce61c831","Type":"ContainerDied","Data":"029152a9650550a5481aaa06cd54f17cfb13cdd5f09b373fd00d234600b0a05d"} May 21 17:36:18.164231 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:18.164033 2568 scope.go:117] "RemoveContainer" containerID="029152a9650550a5481aaa06cd54f17cfb13cdd5f09b373fd00d234600b0a05d" May 21 17:36:19.168455 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:19.168416 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5274h" event={"ID":"643f8836-6a43-49c2-b055-0a67ce61c831","Type":"ContainerStarted","Data":"ed070258a2d385cd4e783f662a947fa2111e840c1981c483ee66c65069b9d777"} May 21 17:36:38.285364 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:38.285326 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:38.305076 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:38.305047 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:39.248502 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:39.248471 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:45.135053 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:45.134970 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:36:45.137314 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:45.137285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2bcb2a-ebf9-40fa-a347-5c0d47b42744-metrics-certs\") pod \"network-metrics-daemon-9km89\" (UID: \"da2bcb2a-ebf9-40fa-a347-5c0d47b42744\") " pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:36:45.338233 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:45.338201 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\"" May 21 17:36:45.346088 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:45.346060 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9km89" May 21 17:36:45.469075 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:45.468868 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9km89"] May 21 17:36:45.471647 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:36:45.471623 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2bcb2a_ebf9_40fa_a347_5c0d47b42744.slice/crio-c51b16e445274cb4edd93d2174f61f6f4c3293ed00db9779e165e65bd0721ec7 WatchSource:0}: Error finding container c51b16e445274cb4edd93d2174f61f6f4c3293ed00db9779e165e65bd0721ec7: Status 404 returned error can't find the container with id c51b16e445274cb4edd93d2174f61f6f4c3293ed00db9779e165e65bd0721ec7 May 21 17:36:46.258073 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:46.258027 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9km89" event={"ID":"da2bcb2a-ebf9-40fa-a347-5c0d47b42744","Type":"ContainerStarted","Data":"c51b16e445274cb4edd93d2174f61f6f4c3293ed00db9779e165e65bd0721ec7"} May 21 17:36:47.262789 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:47.262751 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9km89" event={"ID":"da2bcb2a-ebf9-40fa-a347-5c0d47b42744","Type":"ContainerStarted","Data":"e423c3bd40e211db60ed63cd88636c01390f5577d082ec5c2e78a56dc270883c"} May 21 17:36:47.263192 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:47.262790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9km89" event={"ID":"da2bcb2a-ebf9-40fa-a347-5c0d47b42744","Type":"ContainerStarted","Data":"243aa82e0fbdee6000bc4442de063001a819cd49bcb6e72133a5ee99c0ab701d"} May 21 17:36:47.278357 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:47.278305 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9km89" podStartSLOduration=253.332002701 podStartE2EDuration="4m14.278290494s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:36:45.47828867 +0000 UTC m=+252.676907425" lastFinishedPulling="2026-05-21 17:36:46.42457645 +0000 UTC m=+253.623195218" observedRunningTime="2026-05-21 17:36:47.277045147 +0000 UTC m=+254.475663937" watchObservedRunningTime="2026-05-21 17:36:47.278290494 +0000 UTC m=+254.476909271" May 21 17:36:56.322660 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.322623 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323281 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="prometheus" containerID="cri-o://cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" gracePeriod=600 May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323296 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-thanos" containerID="cri-o://98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" gracePeriod=600 May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323313 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="config-reloader" containerID="cri-o://033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" gracePeriod=600 May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323335 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="thanos-sidecar" containerID="cri-o://363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" gracePeriod=600 May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323356 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy" containerID="cri-o://c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" gracePeriod=600 May 21 17:36:56.323454 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.323313 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-web" containerID="cri-o://b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" gracePeriod=600 May 21 17:36:56.582264 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.582191 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:56.737450 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737417 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737458 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737482 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q5cv\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737502 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737519 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737543 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737571 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737588 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737606 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.737654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737634 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737664 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737691 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737724 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737745 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737778 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737816 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737864 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.737899 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config\") pod \"119449f8-348c-4289-a8d6-94e5c364df98\" (UID: \"119449f8-348c-4289-a8d6-94e5c364df98\") " May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738003 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738013 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:36:56.738112 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738034 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:36:56.738659 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738217 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.738659 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738238 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.738659 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738253 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-configmap-metrics-client-ca\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.738659 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.738277 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:36:56.740169 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.739898 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:36:56.740169 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.740117 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:36:56.741292 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.741259 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:36:56.741787 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.741761 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out" (OuterVolumeSpecName: "config-out") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:36:56.741874 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.741766 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv" (OuterVolumeSpecName: "kube-api-access-2q5cv") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "kube-api-access-2q5cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:36:56.742542 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742506 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.742635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742535 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.742635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742554 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.742635 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742597 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.742773 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742692 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.742773 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.742732 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config" (OuterVolumeSpecName: "config") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.743223 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.743204 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.743943 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.743924 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.751836 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.751809 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config" (OuterVolumeSpecName: "web-config") pod "119449f8-348c-4289-a8d6-94e5c364df98" (UID: "119449f8-348c-4289-a8d6-94e5c364df98"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839013 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839058 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-web-config\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839077 2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-grpc-tls\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839086 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q5cv\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-kube-api-access-2q5cv\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839095 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-config-out\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839104 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839113 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119449f8-348c-4289-a8d6-94e5c364df98-tls-assets\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839123 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839113 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839132 2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-kube-rbac-proxy\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839144 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839153 2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-secret-metrics-client-certs\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839162 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-db\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839170 2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-config\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839178 2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/119449f8-348c-4289-a8d6-94e5c364df98-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:56.839493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:56.839187 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/119449f8-348c-4289-a8d6-94e5c364df98-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:36:57.298036 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298007 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" exitCode=0 May 21 17:36:57.298036 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298031 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" exitCode=0 May 21 17:36:57.298036 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298037 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" exitCode=0 May 21 17:36:57.298036 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298043 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" exitCode=0 May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298048 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" exitCode=0 May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298054 2568 generic.go:358] "Generic (PLEG): container finished" podID="119449f8-348c-4289-a8d6-94e5c364df98" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" exitCode=0 May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298092 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298111 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298134 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298146 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298157 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298167 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298176 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298186 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"119449f8-348c-4289-a8d6-94e5c364df98","Type":"ContainerDied","Data":"bb22802ddde553bf9935a1438f0c5682e0b983ff1a98a4dd2b88d4cedb8225f6"} May 21 17:36:57.298273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.298201 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.305812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.305693 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.312821 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.312805 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.319783 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.319702 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.321281 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.321258 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:57.323614 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.323594 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:57.328456 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.328429 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.335576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.335559 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.353004 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.352967 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:57.353405 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353390 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-web" May 21 17:36:57.353447 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353409 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-web" May 21 17:36:57.353447 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353423 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="prometheus" May 21 17:36:57.353447 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353431 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="prometheus" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353446 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="config-reloader" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353457 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="config-reloader" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353468 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="thanos-sidecar" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353473 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="thanos-sidecar" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353482 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353487 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353494 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-thanos" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353500 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-thanos" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353513 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="init-config-reloader" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353518 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="init-config-reloader" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353564 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-web" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353572 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="prometheus" May 21 17:36:57.353576 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353577 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy" May 21 17:36:57.353947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353585 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="config-reloader" May 21 17:36:57.353947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353591 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="thanos-sidecar" May 21 17:36:57.353947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.353597 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="119449f8-348c-4289-a8d6-94e5c364df98" containerName="kube-rbac-proxy-thanos" May 21 17:36:57.356544 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.356527 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.359203 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.359182 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.361587 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.361569 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 17:36:57.361979 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.361884 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 17:36:57.361979 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.361901 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 17:36:57.362157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.361906 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 17:36:57.362157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362035 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 17:36:57.362308 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362290 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 17:36:57.362375 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362358 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 17:36:57.362437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362424 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2gvrr\"" May 21 17:36:57.362437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362429 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etg1gtkn67q4e\"" May 21 17:36:57.362538 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362421 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 17:36:57.362538 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362498 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 17:36:57.362858 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362838 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 17:36:57.362977 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.362869 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 17:36:57.365138 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.364997 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 17:36:57.365801 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.365785 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.366180 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.366152 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.366292 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.366191 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.366292 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.366238 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.366815 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.366585 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.366815 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.366615 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.366815 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.366671 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.367070 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.366984 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.367070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367012 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.367070 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367036 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.367337 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.367295 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.367337 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367327 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.367470 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367346 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.367733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367565 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 17:36:57.367733 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.367591 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.367733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367617 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.367733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.367636 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.368223 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.368194 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.368330 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.368226 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.368330 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.368249 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.368711 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:36:57.368684 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.368792 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.368718 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.368792 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.368740 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.369051 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369021 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.369156 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369052 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.369493 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369472 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:57.369599 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369563 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.369670 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369601 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.369889 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369868 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.369998 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.369891 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.370168 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370147 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.370168 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370167 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.370398 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370381 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.370459 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370398 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.370644 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370624 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.370644 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370641 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.370891 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370868 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.370989 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.370893 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.371171 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371152 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.371241 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371173 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.371411 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371391 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.371470 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371413 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.371638 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371622 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.371638 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371637 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.371857 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371837 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.371857 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.371857 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.372074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372058 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.372074 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372073 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.372307 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372290 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.372393 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372309 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.372589 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372568 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.372691 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372590 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.372851 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372821 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.372851 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.372847 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.373107 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373080 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.373175 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373109 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.373394 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373372 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.373463 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373398 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.373639 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373619 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.373689 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373642 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.373877 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373857 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.373983 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.373879 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.374155 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374132 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.374203 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374157 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.374370 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374350 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.374431 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374372 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.374610 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374593 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.374657 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374612 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.374805 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374786 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.374872 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374807 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.375008 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.374993 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.375073 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375010 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.375207 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375191 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.375271 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375208 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.375426 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375409 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.375468 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375427 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.375599 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375582 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.375664 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375601 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.375774 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375758 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.375819 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375776 2568 scope.go:117] "RemoveContainer" containerID="98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5" May 21 17:36:57.375983 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375966 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5"} err="failed to get container status \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": rpc error: code = NotFound desc = could not find container \"98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5\": container with ID starting with 98e60de0cf5ce3aeaf79bb5dec52899304845519c96be4df4a242c952b5b63a5 not found: ID does not exist" May 21 17:36:57.376054 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.375984 2568 scope.go:117] "RemoveContainer" containerID="c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272" May 21 17:36:57.376207 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376190 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272"} err="failed to get container status \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": rpc error: code = NotFound desc = could not find container \"c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272\": container with ID starting with c05974a3ff5434d1014c2079d36eb846ce131752505988d56059329acff5c272 not found: ID does not exist" May 21 17:36:57.376255 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376208 2568 scope.go:117] "RemoveContainer" containerID="b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972" May 21 17:36:57.376412 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376395 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972"} err="failed to get container status \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": rpc error: code = NotFound desc = could not find container \"b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972\": container with ID starting with b55fa3e1844ab862c7080af315ebfe5a0dbe865b3e6270af609a80d9e53f7972 not found: ID does not exist" May 21 17:36:57.376455 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376414 2568 scope.go:117] "RemoveContainer" containerID="363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543" May 21 17:36:57.376620 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376603 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543"} err="failed to get container status \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": rpc error: code = NotFound desc = could not find container \"363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543\": container with ID starting with 363570069ae7a1e2fa2ebb1642af53cf5742f710055e24dd46270c2ff352f543 not found: ID does not exist" May 21 17:36:57.376691 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376621 2568 scope.go:117] "RemoveContainer" containerID="033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6" May 21 17:36:57.376812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376791 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6"} err="failed to get container status \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": rpc error: code = NotFound desc = could not find container \"033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6\": container with ID starting with 033b0d28a44de38f44c9ef760554c3b2953b209b4e5afa22898b645ab2a8d8e6 not found: ID does not exist" May 21 17:36:57.376861 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376814 2568 scope.go:117] "RemoveContainer" containerID="cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0" May 21 17:36:57.376993 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376978 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0"} err="failed to get container status \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": rpc error: code = NotFound desc = could not find container \"cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0\": container with ID starting with cb97775b52582daca65e5dff47529f6572020fd5d223e4752f4ba2e5ab1f44a0 not found: ID does not exist" May 21 17:36:57.377050 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.376993 2568 scope.go:117] "RemoveContainer" containerID="0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b" May 21 17:36:57.377188 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.377170 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b"} err="failed to get container status \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": rpc error: code = NotFound desc = could not find container \"0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b\": container with ID starting with 0af2d8bcf513ed964804be8f6c3b4db34b836ba708961f2b658735ff024c461b not found: ID does not exist" May 21 17:36:57.441971 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.441935 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119449f8-348c-4289-a8d6-94e5c364df98" path="/var/lib/kubelet/pods/119449f8-348c-4289-a8d6-94e5c364df98/volumes" May 21 17:36:57.445001 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.444981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445064 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-config-out\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445064 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445136 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445167 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445201 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-web-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445201 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pn9\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-kube-api-access-r5pn9\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445291 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445346 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445398 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445398 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445496 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445496 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445496 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445496 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.445669 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.445572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.546795 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546750 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.546795 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546796 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546814 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546831 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546848 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546896 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546945 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.546978 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547001 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547028 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547062 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547095 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-config-out\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547117 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547162 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547200 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547235 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-web-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547258 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pn9\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-kube-api-access-r5pn9\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.547883 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.548765 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547718 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.548765 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547787 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.548765 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.547881 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550327 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550015 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550327 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550327 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afe42ed5-24d8-473b-916d-96d0fdff8a54-config-out\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550327 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550730 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550705 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.550896 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.550872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.551356 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.551327 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.551551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.551527 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afe42ed5-24d8-473b-916d-96d0fdff8a54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.552197 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.552172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.552509 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.552488 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-web-config\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.552715 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.552655 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.552958 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.552938 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.553146 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.553128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afe42ed5-24d8-473b-916d-96d0fdff8a54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.554578 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.554562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pn9\" (UniqueName: \"kubernetes.io/projected/afe42ed5-24d8-473b-916d-96d0fdff8a54-kube-api-access-r5pn9\") pod \"prometheus-k8s-0\" (UID: \"afe42ed5-24d8-473b-916d-96d0fdff8a54\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.671880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.671827 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:36:57.806655 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:57.806630 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 17:36:57.808201 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:36:57.808173 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe42ed5_24d8_473b_916d_96d0fdff8a54.slice/crio-4707538262e246f3b9e858a505b0115bd882e388feae5d8c94f5dbb10647199c WatchSource:0}: Error finding container 4707538262e246f3b9e858a505b0115bd882e388feae5d8c94f5dbb10647199c: Status 404 returned error can't find the container with id 4707538262e246f3b9e858a505b0115bd882e388feae5d8c94f5dbb10647199c May 21 17:36:58.304703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:58.304667 2568 generic.go:358] "Generic (PLEG): container finished" podID="afe42ed5-24d8-473b-916d-96d0fdff8a54" containerID="240369b504878033cdd32bdd9b0e0d6273430b12c622db77e5a940807c3dda15" exitCode=0 May 21 17:36:58.304872 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:58.304754 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerDied","Data":"240369b504878033cdd32bdd9b0e0d6273430b12c622db77e5a940807c3dda15"} May 21 17:36:58.304872 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:58.304792 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"4707538262e246f3b9e858a505b0115bd882e388feae5d8c94f5dbb10647199c"} May 21 17:36:59.311037 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311004 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"59045bff9da4a74ebabad7ceb16bc355059d60604ae3450193338ca6f6108add"} May 21 17:36:59.311037 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311039 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"40dea2c6268f06b59ada9c9a8746235896e405a2c8f253ac47f88e80d9080d34"} May 21 17:36:59.311437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311050 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"d72e645d149ed3384459d209ee01593c038ee255776d80706023ba1561bdbc8a"} May 21 17:36:59.311437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311060 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"2e50f684d89eb39941a92e3970631947e474e603d89f492bf54e351f8b0fb0de"} May 21 17:36:59.311437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311068 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"8f981c89052050c5df062a49f4d4d1c896f4fda9d42a53c3cca2a0c11fc8485f"} May 21 17:36:59.311437 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.311076 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afe42ed5-24d8-473b-916d-96d0fdff8a54","Type":"ContainerStarted","Data":"6062f33777b46e88bbdaf372e5431a0e1d6af5b45a27e031a388a4bdabbb9626"} May 21 17:36:59.336769 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:36:59.336718 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.336702068 podStartE2EDuration="2.336702068s" podCreationTimestamp="2026-05-21 17:36:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:36:59.334369321 +0000 UTC m=+266.532988099" watchObservedRunningTime="2026-05-21 17:36:59.336702068 +0000 UTC m=+266.535320844" May 21 17:37:02.672964 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:02.672886 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:37:33.290291 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:33.290262 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:37:33.290839 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:33.290271 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:37:33.294078 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:33.294055 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:37:33.294199 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:33.294168 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:37:33.300566 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:33.300546 2568 kubelet.go:1628] "Image garbage collection succeeded" May 21 17:37:57.672325 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:57.672284 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:37:57.687834 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:57.687805 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:37:58.499439 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:37:58.499410 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 17:39:31.133466 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.133434 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-t89gz"] May 21 17:39:31.136654 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.136635 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.138968 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.138947 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5qpdg\"" May 21 17:39:31.139078 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.138948 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 17:39:31.139613 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.139599 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 17:39:31.145467 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.145439 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-t89gz"] May 21 17:39:31.189138 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.189106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-bound-sa-token\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.189317 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.189153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mz5\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-kube-api-access-f2mz5\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.290369 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.290317 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-bound-sa-token\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.290369 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.290377 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mz5\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-kube-api-access-f2mz5\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.297846 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.297815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-bound-sa-token\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.298004 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.297987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mz5\" (UniqueName: \"kubernetes.io/projected/e32ae4e7-eea1-4f2a-823b-5529c4f15d66-kube-api-access-f2mz5\") pod \"cert-manager-79c8d999ff-t89gz\" (UID: \"e32ae4e7-eea1-4f2a-823b-5529c4f15d66\") " pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.453345 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.453262 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-t89gz" May 21 17:39:31.577444 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.577419 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-t89gz"] May 21 17:39:31.580232 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:39:31.580205 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode32ae4e7_eea1_4f2a_823b_5529c4f15d66.slice/crio-cb25928ade3f8c243407516e3f58f2ed401e5803123392de13a6553edaeedd48 WatchSource:0}: Error finding container cb25928ade3f8c243407516e3f58f2ed401e5803123392de13a6553edaeedd48: Status 404 returned error can't find the container with id cb25928ade3f8c243407516e3f58f2ed401e5803123392de13a6553edaeedd48 May 21 17:39:31.582102 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.582086 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:39:31.751733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:31.751649 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-t89gz" event={"ID":"e32ae4e7-eea1-4f2a-823b-5529c4f15d66","Type":"ContainerStarted","Data":"cb25928ade3f8c243407516e3f58f2ed401e5803123392de13a6553edaeedd48"} May 21 17:39:35.766845 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:35.766814 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-t89gz" event={"ID":"e32ae4e7-eea1-4f2a-823b-5529c4f15d66","Type":"ContainerStarted","Data":"54f4bef91fd3695fb59ab45e0ea835cc67805da4cfb6b74c58c826f936fe5bec"} May 21 17:39:35.781646 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:35.781596 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-t89gz" podStartSLOduration=1.434063033 podStartE2EDuration="4.781577732s" podCreationTimestamp="2026-05-21 17:39:31 +0000 UTC" firstStartedPulling="2026-05-21 17:39:31.582212092 +0000 UTC m=+418.780830847" lastFinishedPulling="2026-05-21 17:39:34.929726761 +0000 UTC m=+422.128345546" observedRunningTime="2026-05-21 17:39:35.780938618 +0000 UTC m=+422.979557392" watchObservedRunningTime="2026-05-21 17:39:35.781577732 +0000 UTC m=+422.980196512" May 21 17:39:55.575339 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.575257 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn"] May 21 17:39:55.579510 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.579489 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.583406 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.583383 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 17:39:55.583502 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.583400 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 17:39:55.583502 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.583400 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 17:39:55.583709 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.583694 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 17:39:55.583924 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.583897 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-flk4z\"" May 21 17:39:55.594268 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.594245 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn"] May 21 17:39:55.693024 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.692982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6pd\" (UniqueName: \"kubernetes.io/projected/156eab35-3f4d-4e43-9011-3fbd3595de9a-kube-api-access-4k6pd\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.693024 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.693024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.693289 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.693159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.794610 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.794567 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.794610 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.794609 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6pd\" (UniqueName: \"kubernetes.io/projected/156eab35-3f4d-4e43-9011-3fbd3595de9a-kube-api-access-4k6pd\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.794868 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.794633 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.797088 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.797061 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.797220 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.797112 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/156eab35-3f4d-4e43-9011-3fbd3595de9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.806130 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.806093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6pd\" (UniqueName: \"kubernetes.io/projected/156eab35-3f4d-4e43-9011-3fbd3595de9a-kube-api-access-4k6pd\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn\" (UID: \"156eab35-3f4d-4e43-9011-3fbd3595de9a\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:55.889349 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:55.889259 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:56.019156 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:56.019114 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn"] May 21 17:39:56.023777 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:39:56.023750 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156eab35_3f4d_4e43_9011_3fbd3595de9a.slice/crio-e6cf6fd8e1d7dc73cadc3a46dfc5ca8cfd406860f9019f6e464b39dbfa4f3aa6 WatchSource:0}: Error finding container e6cf6fd8e1d7dc73cadc3a46dfc5ca8cfd406860f9019f6e464b39dbfa4f3aa6: Status 404 returned error can't find the container with id e6cf6fd8e1d7dc73cadc3a46dfc5ca8cfd406860f9019f6e464b39dbfa4f3aa6 May 21 17:39:56.830361 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:56.830324 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" event={"ID":"156eab35-3f4d-4e43-9011-3fbd3595de9a","Type":"ContainerStarted","Data":"e6cf6fd8e1d7dc73cadc3a46dfc5ca8cfd406860f9019f6e464b39dbfa4f3aa6"} May 21 17:39:58.838663 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:58.838632 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" event={"ID":"156eab35-3f4d-4e43-9011-3fbd3595de9a","Type":"ContainerStarted","Data":"6894c4ac08972ff9ac54f9c38393bf2b317b258aba598280a41852310ce5a27a"} May 21 17:39:58.839063 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:58.838775 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:39:58.864067 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:39:58.864012 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" podStartSLOduration=1.482131442 podStartE2EDuration="3.863998755s" podCreationTimestamp="2026-05-21 17:39:55 +0000 UTC" firstStartedPulling="2026-05-21 17:39:56.025455565 +0000 UTC m=+443.224074320" lastFinishedPulling="2026-05-21 17:39:58.407322874 +0000 UTC m=+445.605941633" observedRunningTime="2026-05-21 17:39:58.861749275 +0000 UTC m=+446.060368051" watchObservedRunningTime="2026-05-21 17:39:58.863998755 +0000 UTC m=+446.062617604" May 21 17:40:03.125050 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.125013 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv"] May 21 17:40:03.127281 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.127265 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.129969 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.129945 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 17:40:03.130678 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.130658 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 17:40:03.130678 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.130670 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 17:40:03.130814 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.130687 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cvdqk\"" May 21 17:40:03.130814 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.130688 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 17:40:03.130814 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.130765 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 17:40:03.137465 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.137445 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv"] May 21 17:40:03.257516 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.257467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/664f7463-4662-4edf-9e4c-5fcb2ce06a72-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.257516 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.257521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.257736 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.257552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.257736 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.257580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6rn\" (UniqueName: \"kubernetes.io/projected/664f7463-4662-4edf-9e4c-5fcb2ce06a72-kube-api-access-vc6rn\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.358244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.358200 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/664f7463-4662-4edf-9e4c-5fcb2ce06a72-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.358244 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.358250 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.358515 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.358274 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.358515 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.358292 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6rn\" (UniqueName: \"kubernetes.io/projected/664f7463-4662-4edf-9e4c-5fcb2ce06a72-kube-api-access-vc6rn\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.359019 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.358998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/664f7463-4662-4edf-9e4c-5fcb2ce06a72-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.360768 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.360744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.360853 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.360815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664f7463-4662-4edf-9e4c-5fcb2ce06a72-cert\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.366379 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.366357 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6rn\" (UniqueName: \"kubernetes.io/projected/664f7463-4662-4edf-9e4c-5fcb2ce06a72-kube-api-access-vc6rn\") pod \"lws-controller-manager-7f6d69ccc4-c95sv\" (UID: \"664f7463-4662-4edf-9e4c-5fcb2ce06a72\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.436835 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.436759 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:03.560254 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.560211 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv"] May 21 17:40:03.561923 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:40:03.561886 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664f7463_4662_4edf_9e4c_5fcb2ce06a72.slice/crio-0912297b61a987e2781038531de02dee1a3a929e09ca3d750c25a032731dbebd WatchSource:0}: Error finding container 0912297b61a987e2781038531de02dee1a3a929e09ca3d750c25a032731dbebd: Status 404 returned error can't find the container with id 0912297b61a987e2781038531de02dee1a3a929e09ca3d750c25a032731dbebd May 21 17:40:03.855158 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:03.855123 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" event={"ID":"664f7463-4662-4edf-9e4c-5fcb2ce06a72","Type":"ContainerStarted","Data":"0912297b61a987e2781038531de02dee1a3a929e09ca3d750c25a032731dbebd"} May 21 17:40:06.865355 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:06.865319 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" event={"ID":"664f7463-4662-4edf-9e4c-5fcb2ce06a72","Type":"ContainerStarted","Data":"4c2250834dc4ab4e9101db16d6f858e461c4187bdb76f3357f8a20fc74c0e0fb"} May 21 17:40:06.865764 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:06.865453 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:40:06.880642 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:06.880589 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" podStartSLOduration=0.77663781 podStartE2EDuration="3.880572974s" podCreationTimestamp="2026-05-21 17:40:03 +0000 UTC" firstStartedPulling="2026-05-21 17:40:03.566152108 +0000 UTC m=+450.764770864" lastFinishedPulling="2026-05-21 17:40:06.67008726 +0000 UTC m=+453.868706028" observedRunningTime="2026-05-21 17:40:06.879998098 +0000 UTC m=+454.078616875" watchObservedRunningTime="2026-05-21 17:40:06.880572974 +0000 UTC m=+454.079191750" May 21 17:40:09.843889 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:09.843855 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn" May 21 17:40:13.043444 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.043410 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p"] May 21 17:40:13.045736 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.045716 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.049121 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.049086 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 17:40:13.049121 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.049112 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 17:40:13.049322 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.049158 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xt6ww\"" May 21 17:40:13.049322 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.049161 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 17:40:13.049322 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.049224 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 17:40:13.058513 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.058478 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p"] May 21 17:40:13.139433 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.139391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tmp\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.139433 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.139433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.139653 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.139521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7td\" (UniqueName: \"kubernetes.io/projected/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-kube-api-access-nn7td\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.240671 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.240615 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7td\" (UniqueName: \"kubernetes.io/projected/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-kube-api-access-nn7td\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.240827 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.240708 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tmp\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.240827 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.240729 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.243077 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.243051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tmp\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.243210 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.243195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.247742 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.247724 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7td\" (UniqueName: \"kubernetes.io/projected/8a89dda3-63de-4bc1-a685-3442f1ff8cd9-kube-api-access-nn7td\") pod \"kube-auth-proxy-85f6f977d9-85j2p\" (UID: \"8a89dda3-63de-4bc1-a685-3442f1ff8cd9\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.360816 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.360731 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" May 21 17:40:13.492885 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.492858 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p"] May 21 17:40:13.495812 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:40:13.495782 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a89dda3_63de_4bc1_a685_3442f1ff8cd9.slice/crio-6ebff82843f378dd60560f209c440ca3540f59482eeb6c84c7a41778837e23fe WatchSource:0}: Error finding container 6ebff82843f378dd60560f209c440ca3540f59482eeb6c84c7a41778837e23fe: Status 404 returned error can't find the container with id 6ebff82843f378dd60560f209c440ca3540f59482eeb6c84c7a41778837e23fe May 21 17:40:13.887619 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:13.887581 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" event={"ID":"8a89dda3-63de-4bc1-a685-3442f1ff8cd9","Type":"ContainerStarted","Data":"6ebff82843f378dd60560f209c440ca3540f59482eeb6c84c7a41778837e23fe"} May 21 17:40:16.903356 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:16.903318 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" event={"ID":"8a89dda3-63de-4bc1-a685-3442f1ff8cd9","Type":"ContainerStarted","Data":"0bf2b58731ad16a2b8e54c5bdf711085b48188e538d9bd1322ec4d2c794847c4"} May 21 17:40:16.918970 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:16.918927 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-85j2p" podStartSLOduration=1.160967031 podStartE2EDuration="3.918894156s" podCreationTimestamp="2026-05-21 17:40:13 +0000 UTC" firstStartedPulling="2026-05-21 17:40:13.497637537 +0000 UTC m=+460.696256302" lastFinishedPulling="2026-05-21 17:40:16.255564673 +0000 UTC m=+463.454183427" observedRunningTime="2026-05-21 17:40:16.918087606 +0000 UTC m=+464.116706392" watchObservedRunningTime="2026-05-21 17:40:16.918894156 +0000 UTC m=+464.117512932" May 21 17:40:17.870391 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:40:17.870361 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-c95sv" May 21 17:41:52.894185 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.894142 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4"] May 21 17:41:52.896655 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.896637 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:52.899157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.899124 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 17:41:52.900029 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.900008 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fl2gj\"" May 21 17:41:52.900128 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.900038 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 17:41:52.900128 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.900008 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 17:41:52.905867 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.905843 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4"] May 21 17:41:52.991086 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:52.991050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6z2\" (UniqueName: \"kubernetes.io/projected/075c4406-4017-45fb-84ee-edf2fbcc4039-kube-api-access-xp6z2\") pod \"dns-operator-controller-manager-648d5c98bc-h8xz4\" (UID: \"075c4406-4017-45fb-84ee-edf2fbcc4039\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:53.091836 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:53.091799 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6z2\" (UniqueName: \"kubernetes.io/projected/075c4406-4017-45fb-84ee-edf2fbcc4039-kube-api-access-xp6z2\") pod \"dns-operator-controller-manager-648d5c98bc-h8xz4\" (UID: \"075c4406-4017-45fb-84ee-edf2fbcc4039\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:53.102971 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:53.102946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6z2\" (UniqueName: \"kubernetes.io/projected/075c4406-4017-45fb-84ee-edf2fbcc4039-kube-api-access-xp6z2\") pod \"dns-operator-controller-manager-648d5c98bc-h8xz4\" (UID: \"075c4406-4017-45fb-84ee-edf2fbcc4039\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:53.207320 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:53.207232 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:53.340161 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:53.340128 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4"] May 21 17:41:53.343475 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:41:53.343450 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075c4406_4017_45fb_84ee_edf2fbcc4039.slice/crio-ab13fb3504a1cff1fd979fdcaefead2978267a17f783a00e0507e1a86fab70e7 WatchSource:0}: Error finding container ab13fb3504a1cff1fd979fdcaefead2978267a17f783a00e0507e1a86fab70e7: Status 404 returned error can't find the container with id ab13fb3504a1cff1fd979fdcaefead2978267a17f783a00e0507e1a86fab70e7 May 21 17:41:54.221198 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:54.221159 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" event={"ID":"075c4406-4017-45fb-84ee-edf2fbcc4039","Type":"ContainerStarted","Data":"ab13fb3504a1cff1fd979fdcaefead2978267a17f783a00e0507e1a86fab70e7"} May 21 17:41:56.229863 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.229825 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" event={"ID":"075c4406-4017-45fb-84ee-edf2fbcc4039","Type":"ContainerStarted","Data":"f547d9f489ab9c37b57949d5bae0af796c68f25ff9542d2bc670c4698e387eba"} May 21 17:41:56.230287 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.230033 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:41:56.250772 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.250710 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" podStartSLOduration=2.411153147 podStartE2EDuration="4.250691987s" podCreationTimestamp="2026-05-21 17:41:52 +0000 UTC" firstStartedPulling="2026-05-21 17:41:53.34541638 +0000 UTC m=+560.544035135" lastFinishedPulling="2026-05-21 17:41:55.184955217 +0000 UTC m=+562.383573975" observedRunningTime="2026-05-21 17:41:56.25040502 +0000 UTC m=+563.449023798" watchObservedRunningTime="2026-05-21 17:41:56.250691987 +0000 UTC m=+563.449310765" May 21 17:41:56.282619 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.282581 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z"] May 21 17:41:56.285159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.285138 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.289159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.288550 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w8sdk\"" May 21 17:41:56.289159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.288834 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 17:41:56.289159 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.289047 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 17:41:56.301392 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.301368 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z"] May 21 17:41:56.421623 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.421589 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a725c9c-c7ef-4105-91b8-260736f596d3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.421795 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.421672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.421795 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.421694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2t4z\" (UniqueName: \"kubernetes.io/projected/3a725c9c-c7ef-4105-91b8-260736f596d3-kube-api-access-f2t4z\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.523185 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.523096 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.523185 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.523135 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2t4z\" (UniqueName: \"kubernetes.io/projected/3a725c9c-c7ef-4105-91b8-260736f596d3-kube-api-access-f2t4z\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.523185 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.523184 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a725c9c-c7ef-4105-91b8-260736f596d3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.523518 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:41:56.523243 2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 17:41:56.523518 ip-10-0-139-73 kubenswrapper[2568]: E0521 17:41:56.523321 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert podName:3a725c9c-c7ef-4105-91b8-260736f596d3 nodeName:}" failed. No retries permitted until 2026-05-21 17:41:57.023296647 +0000 UTC m=+564.221915422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-kkz4z" (UID: "3a725c9c-c7ef-4105-91b8-260736f596d3") : secret "plugin-serving-cert" not found May 21 17:41:56.523734 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.523716 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a725c9c-c7ef-4105-91b8-260736f596d3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:56.536672 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:56.536643 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2t4z\" (UniqueName: \"kubernetes.io/projected/3a725c9c-c7ef-4105-91b8-260736f596d3-kube-api-access-f2t4z\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:57.028069 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:57.028030 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:57.030397 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:57.030376 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a725c9c-c7ef-4105-91b8-260736f596d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kkz4z\" (UID: \"3a725c9c-c7ef-4105-91b8-260736f596d3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:57.195866 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:57.195812 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" May 21 17:41:57.322751 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:57.322725 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z"] May 21 17:41:57.325389 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:41:57.325361 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a725c9c_c7ef_4105_91b8_260736f596d3.slice/crio-aebdc953d2443744e97842a6bf47297eaaf5e7cb32c3dc204d32920defe800f6 WatchSource:0}: Error finding container aebdc953d2443744e97842a6bf47297eaaf5e7cb32c3dc204d32920defe800f6: Status 404 returned error can't find the container with id aebdc953d2443744e97842a6bf47297eaaf5e7cb32c3dc204d32920defe800f6 May 21 17:41:58.239187 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:41:58.239149 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" event={"ID":"3a725c9c-c7ef-4105-91b8-260736f596d3","Type":"ContainerStarted","Data":"aebdc953d2443744e97842a6bf47297eaaf5e7cb32c3dc204d32920defe800f6"} May 21 17:42:07.235763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:07.235725 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-h8xz4" May 21 17:42:20.324446 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:20.324411 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" event={"ID":"3a725c9c-c7ef-4105-91b8-260736f596d3","Type":"ContainerStarted","Data":"fac4fbe14ab9a9423913844365679101180a36e394f76b738bf8a2da511f5bd0"} May 21 17:42:20.341384 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:20.341332 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kkz4z" podStartSLOduration=2.003068704 podStartE2EDuration="24.34131707s" podCreationTimestamp="2026-05-21 17:41:56 +0000 UTC" firstStartedPulling="2026-05-21 17:41:57.327140292 +0000 UTC m=+564.525759050" lastFinishedPulling="2026-05-21 17:42:19.665388656 +0000 UTC m=+586.864007416" observedRunningTime="2026-05-21 17:42:20.339018782 +0000 UTC m=+587.537637560" watchObservedRunningTime="2026-05-21 17:42:20.34131707 +0000 UTC m=+587.539935846" May 21 17:42:33.315900 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:33.315866 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:42:33.316726 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:33.316703 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:42:33.318415 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:33.318396 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:42:33.319409 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:33.319387 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:42:57.734167 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.734048 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:42:57.787790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.785828 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:42:57.787790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.785896 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:42:57.787790 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.786009 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.788527 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.788510 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 17:42:57.874649 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.874609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7203874-998b-4f8b-897f-ca360cb21da8-config-file\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.874837 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.874731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl4tn\" (UniqueName: \"kubernetes.io/projected/b7203874-998b-4f8b-897f-ca360cb21da8-kube-api-access-xl4tn\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.975176 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.975141 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7203874-998b-4f8b-897f-ca360cb21da8-config-file\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.975341 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.975217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl4tn\" (UniqueName: \"kubernetes.io/projected/b7203874-998b-4f8b-897f-ca360cb21da8-kube-api-access-xl4tn\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.975792 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.975771 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7203874-998b-4f8b-897f-ca360cb21da8-config-file\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:57.983109 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:57.983085 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl4tn\" (UniqueName: \"kubernetes.io/projected/b7203874-998b-4f8b-897f-ca360cb21da8-kube-api-access-xl4tn\") pod \"limitador-limitador-78c99df468-j6sdq\" (UID: \"b7203874-998b-4f8b-897f-ca360cb21da8\") " pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:58.096114 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:58.096079 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:42:58.226038 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:58.223425 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:42:58.229791 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:42:58.229763 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7203874_998b_4f8b_897f_ca360cb21da8.slice/crio-1ffb0f46f6375b4d13c0b6d7ed7b830ddeb573fb2b219ed0cdbf34f1f5aad2fe WatchSource:0}: Error finding container 1ffb0f46f6375b4d13c0b6d7ed7b830ddeb573fb2b219ed0cdbf34f1f5aad2fe: Status 404 returned error can't find the container with id 1ffb0f46f6375b4d13c0b6d7ed7b830ddeb573fb2b219ed0cdbf34f1f5aad2fe May 21 17:42:58.452774 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:42:58.452689 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" event={"ID":"b7203874-998b-4f8b-897f-ca360cb21da8","Type":"ContainerStarted","Data":"1ffb0f46f6375b4d13c0b6d7ed7b830ddeb573fb2b219ed0cdbf34f1f5aad2fe"} May 21 17:43:01.469211 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:43:01.469175 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" event={"ID":"b7203874-998b-4f8b-897f-ca360cb21da8","Type":"ContainerStarted","Data":"d9da8f363997a3c1f6c2c222cf453bc6ded148e855389aa32e9f3b5187bb7d17"} May 21 17:43:01.469597 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:43:01.469391 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:43:01.483851 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:43:01.483801 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" podStartSLOduration=1.963745517 podStartE2EDuration="4.483787089s" podCreationTimestamp="2026-05-21 17:42:57 +0000 UTC" firstStartedPulling="2026-05-21 17:42:58.231555554 +0000 UTC m=+625.430174309" lastFinishedPulling="2026-05-21 17:43:00.751597113 +0000 UTC m=+627.950215881" observedRunningTime="2026-05-21 17:43:01.483293977 +0000 UTC m=+628.681912755" watchObservedRunningTime="2026-05-21 17:43:01.483787089 +0000 UTC m=+628.682405867" May 21 17:43:12.474651 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:43:12.474621 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-j6sdq" May 21 17:44:22.107395 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:44:22.107356 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:44:49.666800 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:44:49.666765 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:44:53.095215 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:44:53.095175 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:45:00.129762 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.129728 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656425-pxzm9"] May 21 17:45:00.133308 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.133290 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:00.135763 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.135737 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bgwfd\"" May 21 17:45:00.138450 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.138415 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656425-pxzm9"] May 21 17:45:00.326642 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.326601 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcsv\" (UniqueName: \"kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv\") pod \"maas-api-key-cleanup-29656425-pxzm9\" (UID: \"69b90bd9-c88b-41b9-8f65-c24a974b671a\") " pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:00.427597 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.427496 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcsv\" (UniqueName: \"kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv\") pod \"maas-api-key-cleanup-29656425-pxzm9\" (UID: \"69b90bd9-c88b-41b9-8f65-c24a974b671a\") " pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:00.435120 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.435094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcsv\" (UniqueName: \"kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv\") pod \"maas-api-key-cleanup-29656425-pxzm9\" (UID: \"69b90bd9-c88b-41b9-8f65-c24a974b671a\") " pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:00.443848 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.443825 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:00.570716 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.570684 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656425-pxzm9"] May 21 17:45:00.573395 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:45:00.573368 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b90bd9_c88b_41b9_8f65_c24a974b671a.slice/crio-178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005 WatchSource:0}: Error finding container 178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005: Status 404 returned error can't find the container with id 178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005 May 21 17:45:00.575191 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.575171 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:45:00.878109 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:00.878072 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" event={"ID":"69b90bd9-c88b-41b9-8f65-c24a974b671a","Type":"ContainerStarted","Data":"178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005"} May 21 17:45:01.024510 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.024464 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd"] May 21 17:45:01.029504 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.029477 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.032146 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.032118 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 17:45:01.032267 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.032119 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 17:45:01.033540 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.033517 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dnpq5\"" May 21 17:45:01.033540 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.033524 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 17:45:01.035811 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.035790 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd"] May 21 17:45:01.134273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.134273 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4sj\" (UniqueName: \"kubernetes.io/projected/5f4d3713-25bd-4135-a583-7c43343545f0-kube-api-access-gj4sj\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.134706 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.134706 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134395 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.134706 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.134706 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.134456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f4d3713-25bd-4135-a583-7c43343545f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235359 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235359 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235363 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235401 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f4d3713-25bd-4135-a583-7c43343545f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235442 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235617 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235480 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4sj\" (UniqueName: \"kubernetes.io/projected/5f4d3713-25bd-4135-a583-7c43343545f0-kube-api-access-gj4sj\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235822 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235784 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235822 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235794 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.235945 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.235897 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.237733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.237700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f4d3713-25bd-4135-a583-7c43343545f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.237993 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.237976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f4d3713-25bd-4135-a583-7c43343545f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.242645 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.242628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4sj\" (UniqueName: \"kubernetes.io/projected/5f4d3713-25bd-4135-a583-7c43343545f0-kube-api-access-gj4sj\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd\" (UID: \"5f4d3713-25bd-4135-a583-7c43343545f0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.340842 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.340801 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:01.467367 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.467342 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd"] May 21 17:45:01.469679 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:45:01.469648 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4d3713_25bd_4135_a583_7c43343545f0.slice/crio-756ffcb6de2fac45bfdfc17e8c478ab05227034533a6c3e58bd16be979205410 WatchSource:0}: Error finding container 756ffcb6de2fac45bfdfc17e8c478ab05227034533a6c3e58bd16be979205410: Status 404 returned error can't find the container with id 756ffcb6de2fac45bfdfc17e8c478ab05227034533a6c3e58bd16be979205410 May 21 17:45:01.883667 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:01.883617 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" event={"ID":"5f4d3713-25bd-4135-a583-7c43343545f0","Type":"ContainerStarted","Data":"756ffcb6de2fac45bfdfc17e8c478ab05227034533a6c3e58bd16be979205410"} May 21 17:45:02.306506 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:02.305856 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:45:04.901420 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:04.901325 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" event={"ID":"69b90bd9-c88b-41b9-8f65-c24a974b671a","Type":"ContainerStarted","Data":"7c9e5775edd465eca6253ad6311eed2a55e512d7ac5a1050e889b7545f2bc443"} May 21 17:45:04.915670 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:04.915534 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" podStartSLOduration=1.903149951 podStartE2EDuration="4.915516383s" podCreationTimestamp="2026-05-21 17:45:00 +0000 UTC" firstStartedPulling="2026-05-21 17:45:00.575315638 +0000 UTC m=+747.773934393" lastFinishedPulling="2026-05-21 17:45:03.587682067 +0000 UTC m=+750.786300825" observedRunningTime="2026-05-21 17:45:04.915118598 +0000 UTC m=+752.113737369" watchObservedRunningTime="2026-05-21 17:45:04.915516383 +0000 UTC m=+752.114135162" May 21 17:45:06.602399 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:06.602369 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:45:06.909939 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:06.909890 2568 generic.go:358] "Generic (PLEG): container finished" podID="69b90bd9-c88b-41b9-8f65-c24a974b671a" containerID="7c9e5775edd465eca6253ad6311eed2a55e512d7ac5a1050e889b7545f2bc443" exitCode=0 May 21 17:45:06.910118 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:06.909957 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" event={"ID":"69b90bd9-c88b-41b9-8f65-c24a974b671a","Type":"ContainerDied","Data":"7c9e5775edd465eca6253ad6311eed2a55e512d7ac5a1050e889b7545f2bc443"} May 21 17:45:06.911322 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:06.911299 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" event={"ID":"5f4d3713-25bd-4135-a583-7c43343545f0","Type":"ContainerStarted","Data":"560c23bdf3da1dbe061d39d8629a81cf3c8eb220cebd75cc8c2fa27bd15357e1"} May 21 17:45:08.035902 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.035878 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:08.107885 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.107859 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kcsv\" (UniqueName: \"kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv\") pod \"69b90bd9-c88b-41b9-8f65-c24a974b671a\" (UID: \"69b90bd9-c88b-41b9-8f65-c24a974b671a\") " May 21 17:45:08.110127 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.110092 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv" (OuterVolumeSpecName: "kube-api-access-5kcsv") pod "69b90bd9-c88b-41b9-8f65-c24a974b671a" (UID: "69b90bd9-c88b-41b9-8f65-c24a974b671a"). InnerVolumeSpecName "kube-api-access-5kcsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:45:08.209158 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.209072 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kcsv\" (UniqueName: \"kubernetes.io/projected/69b90bd9-c88b-41b9-8f65-c24a974b671a-kube-api-access-5kcsv\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 17:45:08.920011 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.919977 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" event={"ID":"69b90bd9-c88b-41b9-8f65-c24a974b671a","Type":"ContainerDied","Data":"178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005"} May 21 17:45:08.920011 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.920011 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="178cb011804f31bf9e43ecad8cade1a922ce7f280e297c360966ecf3c4460005" May 21 17:45:08.920265 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:08.920039 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656425-pxzm9" May 21 17:45:12.935135 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:12.935095 2568 generic.go:358] "Generic (PLEG): container finished" podID="5f4d3713-25bd-4135-a583-7c43343545f0" containerID="560c23bdf3da1dbe061d39d8629a81cf3c8eb220cebd75cc8c2fa27bd15357e1" exitCode=0 May 21 17:45:12.935543 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:12.935169 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" event={"ID":"5f4d3713-25bd-4135-a583-7c43343545f0","Type":"ContainerDied","Data":"560c23bdf3da1dbe061d39d8629a81cf3c8eb220cebd75cc8c2fa27bd15357e1"} May 21 17:45:14.945518 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:14.945483 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" event={"ID":"5f4d3713-25bd-4135-a583-7c43343545f0","Type":"ContainerStarted","Data":"92c5e11501904f00b5f9a030b7f0e30e8e2c6d04b5bc1d8fedb637f84f3890ab"} May 21 17:45:14.945952 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:14.945693 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:14.963551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:14.963506 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" podStartSLOduration=1.393965626 podStartE2EDuration="13.963492891s" podCreationTimestamp="2026-05-21 17:45:01 +0000 UTC" firstStartedPulling="2026-05-21 17:45:01.471479427 +0000 UTC m=+748.670098185" lastFinishedPulling="2026-05-21 17:45:14.041006681 +0000 UTC m=+761.239625450" observedRunningTime="2026-05-21 17:45:14.961816942 +0000 UTC m=+762.160435720" watchObservedRunningTime="2026-05-21 17:45:14.963492891 +0000 UTC m=+762.162111667" May 21 17:45:25.962944 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:25.962892 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd" May 21 17:45:43.624993 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.624896 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b"] May 21 17:45:43.625472 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.625452 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b90bd9-c88b-41b9-8f65-c24a974b671a" containerName="cleanup" May 21 17:45:43.625551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.625476 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b90bd9-c88b-41b9-8f65-c24a974b671a" containerName="cleanup" May 21 17:45:43.625551 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.625562 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b90bd9-c88b-41b9-8f65-c24a974b671a" containerName="cleanup" May 21 17:45:43.651310 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.651279 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b"] May 21 17:45:43.651453 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.651376 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.653743 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.653718 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 17:45:43.729398 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.729565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.729565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqhd\" (UniqueName: \"kubernetes.io/projected/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kube-api-access-8bqhd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.729565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.729565 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.729703 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.729577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830615 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830566 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830647 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830680 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830705 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830731 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqhd\" (UniqueName: \"kubernetes.io/projected/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kube-api-access-8bqhd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.830812 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.830761 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.831125 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.831094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.831183 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.831130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.831536 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.831075 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.834241 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.834215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.838720 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.838700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.842807 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.842785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqhd\" (UniqueName: \"kubernetes.io/projected/fe0d7a39-11df-4f39-b1a6-449a2b1a09e8-kube-api-access-8bqhd\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b\" (UID: \"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:43.961685 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:43.961603 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:44.095820 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:44.095793 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b"] May 21 17:45:44.097887 ip-10-0-139-73 kubenswrapper[2568]: W0521 17:45:44.097858 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0d7a39_11df_4f39_b1a6_449a2b1a09e8.slice/crio-48a181790517489e46029ab23eac3dcaf32499612f065ff90df2891782cd0a4f WatchSource:0}: Error finding container 48a181790517489e46029ab23eac3dcaf32499612f065ff90df2891782cd0a4f: Status 404 returned error can't find the container with id 48a181790517489e46029ab23eac3dcaf32499612f065ff90df2891782cd0a4f May 21 17:45:45.054990 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:45.054949 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" event={"ID":"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8","Type":"ContainerStarted","Data":"43a2bd03c3017280516e2002ec4090713277f92eeb323461f9b25b7a458f4deb"} May 21 17:45:45.055366 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:45.055000 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" event={"ID":"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8","Type":"ContainerStarted","Data":"48a181790517489e46029ab23eac3dcaf32499612f065ff90df2891782cd0a4f"} May 21 17:45:47.003995 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:47.003948 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:45:50.080863 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:50.080822 2568 generic.go:358] "Generic (PLEG): container finished" podID="fe0d7a39-11df-4f39-b1a6-449a2b1a09e8" containerID="43a2bd03c3017280516e2002ec4090713277f92eeb323461f9b25b7a458f4deb" exitCode=0 May 21 17:45:50.081256 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:50.080882 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" event={"ID":"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8","Type":"ContainerDied","Data":"43a2bd03c3017280516e2002ec4090713277f92eeb323461f9b25b7a458f4deb"} May 21 17:45:51.086076 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:51.086042 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" event={"ID":"fe0d7a39-11df-4f39-b1a6-449a2b1a09e8","Type":"ContainerStarted","Data":"87a8394424ddd1004040358aa50545d759af0794e47939bc56a02366926af936"} May 21 17:45:51.086443 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:51.086256 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:45:51.101656 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:51.101609 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" podStartSLOduration=7.800245894 podStartE2EDuration="8.101591492s" podCreationTimestamp="2026-05-21 17:45:43 +0000 UTC" firstStartedPulling="2026-05-21 17:45:50.081460632 +0000 UTC m=+797.280079386" lastFinishedPulling="2026-05-21 17:45:50.382806214 +0000 UTC m=+797.581424984" observedRunningTime="2026-05-21 17:45:51.100790213 +0000 UTC m=+798.299408991" watchObservedRunningTime="2026-05-21 17:45:51.101591492 +0000 UTC m=+798.300210271" May 21 17:45:55.899064 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:45:55.899026 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:02.103798 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:02.103767 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b" May 21 17:46:08.994948 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:08.994897 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:20.497114 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:20.497076 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:29.503877 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:29.503840 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:39.899580 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:39.899538 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:48.601959 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:48.601900 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:46:58.392948 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:46:58.392890 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:47:33.340755 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:47:33.340722 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:47:33.342180 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:47:33.342160 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:47:33.343627 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:47:33.343605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:47:33.345093 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:47:33.345067 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:48:11.190766 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:48:11.190730 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:48:25.796085 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:48:25.796047 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:49:04.100967 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:49:04.100870 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:49:21.193365 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:49:21.193325 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:49:35.802625 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:49:35.802587 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:49:51.803405 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:49:51.803368 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:50:43.893198 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:50:43.893162 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:50:53.413233 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:50:53.413191 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:51:09.777875 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:51:09.777832 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:51:19.207419 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:51:19.207375 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:51:35.501733 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:51:35.501693 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:51:43.699330 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:51:43.699244 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:17.095660 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:17.095625 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:24.392468 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:24.392429 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:28.201348 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:28.201310 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:33.367013 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:33.366982 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:52:33.368809 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:33.368790 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:52:33.370076 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:33.370059 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:52:33.371862 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:33.371835 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:52:34.101281 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:34.101247 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:42.597177 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:42.597146 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:52:50.700819 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:52:50.700786 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:53:07.706573 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:53:07.706538 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:53:20.997407 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:53:20.997371 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:07.797690 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:07.797648 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:12.392141 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:12.392105 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:20.394647 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:20.394608 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:28.995521 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:28.995483 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:38.101489 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:38.101455 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:46.799064 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:46.798980 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:54:56.398546 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:54:56.398509 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:04.700945 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:04.700896 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:13.996548 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:13.996504 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:21.998512 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:21.998479 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:30.799929 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:30.799886 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:39.497449 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:39.497410 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:48.096257 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:48.096215 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:55:57.395880 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:55:57.395840 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:56:06.403643 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:56:06.403595 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:56:13.499149 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:56:13.499063 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:56:23.405818 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:56:23.405780 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:56:31.205157 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:56:31.205118 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:57:16.409348 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:16.409302 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:57:21.093944 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:21.093896 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:57:33.393965 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:33.393935 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:57:33.395582 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:33.395560 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 17:57:33.396808 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:33.396788 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:57:33.398342 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:57:33.398326 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 17:58:51.006375 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:58:51.006338 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:58:58.400661 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:58:58.400619 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:59:23.704947 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:59:23.704891 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:59:29.801762 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:59:29.801724 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:59:40.098495 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:59:40.098457 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:59:50.401480 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:59:50.401443 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 17:59:58.211652 ip-10-0-139-73 kubenswrapper[2568]: I0521 17:59:58.211613 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:00.135811 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.135775 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656440-zm9k9"] May 21 18:00:00.139285 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.139267 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:00.141922 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.141890 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bgwfd\"" May 21 18:00:00.147665 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.147642 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656440-zm9k9"] May 21 18:00:00.256457 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.256419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742pb\" (UniqueName: \"kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb\") pod \"maas-api-key-cleanup-29656440-zm9k9\" (UID: \"303fe101-a8a7-4926-86de-ef151dd6cc80\") " pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:00.357663 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.357627 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-742pb\" (UniqueName: \"kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb\") pod \"maas-api-key-cleanup-29656440-zm9k9\" (UID: \"303fe101-a8a7-4926-86de-ef151dd6cc80\") " pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:00.365413 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.365386 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-742pb\" (UniqueName: \"kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb\") pod \"maas-api-key-cleanup-29656440-zm9k9\" (UID: \"303fe101-a8a7-4926-86de-ef151dd6cc80\") " pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:00.450493 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.450408 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:00.577267 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.577236 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656440-zm9k9"] May 21 18:00:00.580290 ip-10-0-139-73 kubenswrapper[2568]: W0521 18:00:00.580249 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303fe101_a8a7_4926_86de_ef151dd6cc80.slice/crio-6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc WatchSource:0}: Error finding container 6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc: Status 404 returned error can't find the container with id 6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc May 21 18:00:00.585728 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:00.585709 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:00:01.085283 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:01.085241 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" event={"ID":"303fe101-a8a7-4926-86de-ef151dd6cc80","Type":"ContainerStarted","Data":"8e0b44f36e4ee113405829f99c2eb749e30ef0db9b84c6f3b79283915ce9e174"} May 21 18:00:01.085283 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:01.085284 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" event={"ID":"303fe101-a8a7-4926-86de-ef151dd6cc80","Type":"ContainerStarted","Data":"6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc"} May 21 18:00:01.098772 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:01.098710 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" podStartSLOduration=1.098692511 podStartE2EDuration="1.098692511s" podCreationTimestamp="2026-05-21 18:00:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:00:01.098283973 +0000 UTC m=+1648.296902751" watchObservedRunningTime="2026-05-21 18:00:01.098692511 +0000 UTC m=+1648.297311289" May 21 18:00:02.090413 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:02.090376 2568 generic.go:358] "Generic (PLEG): container finished" podID="303fe101-a8a7-4926-86de-ef151dd6cc80" containerID="8e0b44f36e4ee113405829f99c2eb749e30ef0db9b84c6f3b79283915ce9e174" exitCode=0 May 21 18:00:02.090821 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:02.090462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" event={"ID":"303fe101-a8a7-4926-86de-ef151dd6cc80","Type":"ContainerDied","Data":"8e0b44f36e4ee113405829f99c2eb749e30ef0db9b84c6f3b79283915ce9e174"} May 21 18:00:03.222701 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:03.222678 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:03.286700 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:03.286660 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-742pb\" (UniqueName: \"kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb\") pod \"303fe101-a8a7-4926-86de-ef151dd6cc80\" (UID: \"303fe101-a8a7-4926-86de-ef151dd6cc80\") " May 21 18:00:03.288724 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:03.288703 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb" (OuterVolumeSpecName: "kube-api-access-742pb") pod "303fe101-a8a7-4926-86de-ef151dd6cc80" (UID: "303fe101-a8a7-4926-86de-ef151dd6cc80"). InnerVolumeSpecName "kube-api-access-742pb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:00:03.387632 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:03.387543 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-742pb\" (UniqueName: \"kubernetes.io/projected/303fe101-a8a7-4926-86de-ef151dd6cc80-kube-api-access-742pb\") on node \"ip-10-0-139-73.ec2.internal\" DevicePath \"\"" May 21 18:00:04.098231 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:04.098191 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" event={"ID":"303fe101-a8a7-4926-86de-ef151dd6cc80","Type":"ContainerDied","Data":"6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc"} May 21 18:00:04.098231 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:04.098226 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e9807c6225efdefd65cc6d6bd14e18227dd31b9e68cff02f155b0d589350fbc" May 21 18:00:04.098480 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:04.098250 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656440-zm9k9" May 21 18:00:10.098057 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:10.098019 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:17.898044 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:17.898000 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:28.505770 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:28.505737 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:37.699494 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:37.699451 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:48.002149 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:48.002064 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:00:57.092123 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:00:57.092090 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:01:30.205179 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:01:30.205140 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:02:12.595824 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:12.595745 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:02:20.907741 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:20.907705 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:02:29.907616 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:29.907549 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:02:33.419845 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:33.419819 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 18:02:33.422704 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:33.422684 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 18:02:33.428279 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:33.428262 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 18:02:33.430731 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:33.430715 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 18:02:38.209787 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:38.209749 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:02:47.198447 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:02:47.198408 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:00.205611 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:00.205573 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:09.302005 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:09.301968 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:17.003076 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:17.003039 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:25.902517 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:25.902477 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:34.104552 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:34.104515 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:42.408459 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:42.408380 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:03:52.498393 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:03:52.498348 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:04:10.298451 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:04:10.298404 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:04:18.799507 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:04:18.799466 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:04:27.697695 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:04:27.697664 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:04:36.597894 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:04:36.597857 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:04:53.106009 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:04:53.105973 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:01.001394 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:01.001350 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:10.823483 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:10.823444 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:18.910193 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:18.910154 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:28.463992 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:28.463944 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:36.506333 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:36.506288 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:45.011110 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:45.011076 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:05:56.999858 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:05:56.999823 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:05.612404 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:05.612365 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:19.098544 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:19.098502 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:28.104490 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:28.104451 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:35.811057 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:35.811013 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:44.205768 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:44.205677 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:06:52.401647 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:06:52.401609 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:07:09.105418 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:09.105383 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:07:17.607964 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:17.607929 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:07:26.604438 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:26.604397 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:07:33.446180 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:33.446153 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 18:07:33.449141 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:33.449121 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 18:07:33.454954 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:33.454937 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 18:07:33.457854 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:33.457835 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vwrc_4b69b81d-a157-4276-98e6-3a830cde5ec9/ovn-acl-logging/0.log" May 21 18:07:35.019393 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:35.019359 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:07:59.001762 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:07:59.001723 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:08:11.701702 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:11.701665 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j6sdq"] May 21 18:08:20.253305 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:20.253272 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656425-pxzm9_69b90bd9-c88b-41b9-8f65-c24a974b671a/cleanup/0.log" May 21 18:08:20.364096 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:20.364068 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656440-zm9k9_303fe101-a8a7-4926-86de-ef151dd6cc80/cleanup/0.log" May 21 18:08:20.969788 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:20.969763 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn_156eab35-3f4d-4e43-9011-3fbd3595de9a/manager/0.log" May 21 18:08:22.572547 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:22.572520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-h8xz4_075c4406-4017-45fb-84ee-edf2fbcc4039/manager/0.log" May 21 18:08:22.683252 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:22.683222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-kkz4z_3a725c9c-c7ef-4105-91b8-260736f596d3/kuadrant-console-plugin/0.log" May 21 18:08:23.058230 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:23.058208 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j6sdq_b7203874-998b-4f8b-897f-ca360cb21da8/limitador/0.log" May 21 18:08:23.785019 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:23.784985 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85f6f977d9-85j2p_8a89dda3-63de-4bc1-a685-3442f1ff8cd9/kube-auth-proxy/0.log" May 21 18:08:24.728322 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:24.728289 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b_fe0d7a39-11df-4f39-b1a6-449a2b1a09e8/storage-initializer/0.log" May 21 18:08:24.735186 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:24.735167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-dlv6b_fe0d7a39-11df-4f39-b1a6-449a2b1a09e8/main/0.log" May 21 18:08:25.094369 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:25.094342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd_5f4d3713-25bd-4135-a583-7c43343545f0/storage-initializer/0.log" May 21 18:08:25.101141 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:25.101107 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-hc2hd_5f4d3713-25bd-4135-a583-7c43343545f0/main/0.log" May 21 18:08:32.374530 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:32.374486 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ptv4m_75c6b319-3005-4c70-abd3-16781298a3df/global-pull-secret-syncer/0.log" May 21 18:08:32.504551 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:32.504511 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sbcwc_1b488979-2260-40ad-b845-0b4a44f214fc/konnectivity-agent/0.log" May 21 18:08:32.589285 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:32.589259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-73.ec2.internal_0a33f18e40315f11e89b9080e4b2917f/haproxy/0.log" May 21 18:08:36.600206 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:36.600175 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-h8xz4_075c4406-4017-45fb-84ee-edf2fbcc4039/manager/0.log" May 21 18:08:36.627458 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:36.627432 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-kkz4z_3a725c9c-c7ef-4105-91b8-260736f596d3/kuadrant-console-plugin/0.log" May 21 18:08:36.795164 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:36.795139 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j6sdq_b7203874-998b-4f8b-897f-ca360cb21da8/limitador/0.log" May 21 18:08:38.448734 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:38.448704 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-9kxxz_63a3ac1b-69ad-4cb3-b6cf-80b11124ab70/cluster-monitoring-operator/0.log" May 21 18:08:38.616233 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:38.616206 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-wm45t_a3de2530-3d52-417a-b614-d4c9087cd0bf/monitoring-plugin/0.log" May 21 18:08:38.671667 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:38.671630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxjsg_707ebcb5-f21d-48fe-b312-e351135519db/node-exporter/0.log" May 21 18:08:38.709105 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:38.709076 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxjsg_707ebcb5-f21d-48fe-b312-e351135519db/kube-rbac-proxy/0.log" May 21 18:08:38.750972 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:38.750950 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxjsg_707ebcb5-f21d-48fe-b312-e351135519db/init-textfile/0.log" May 21 18:08:39.104531 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.104497 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jxndk_0f0e6e82-a5b7-4936-afaf-41bfb6032563/kube-rbac-proxy-main/0.log" May 21 18:08:39.171438 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.171415 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jxndk_0f0e6e82-a5b7-4936-afaf-41bfb6032563/kube-rbac-proxy-self/0.log" May 21 18:08:39.231727 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.231698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jxndk_0f0e6e82-a5b7-4936-afaf-41bfb6032563/openshift-state-metrics/0.log" May 21 18:08:39.298313 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.298285 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/prometheus/0.log" May 21 18:08:39.325702 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.325658 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/config-reloader/0.log" May 21 18:08:39.359743 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.359670 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/thanos-sidecar/0.log" May 21 18:08:39.396218 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.396197 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/kube-rbac-proxy-web/0.log" May 21 18:08:39.438192 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.438165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/kube-rbac-proxy/0.log" May 21 18:08:39.492078 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.492044 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/kube-rbac-proxy-thanos/0.log" May 21 18:08:39.540387 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.540361 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_afe42ed5-24d8-473b-916d-96d0fdff8a54/init-config-reloader/0.log" May 21 18:08:39.600004 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.599975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-2k8vl_ab6c4d05-33ed-4e96-b3a9-9b051aea7d99/prometheus-operator/0.log" May 21 18:08:39.640876 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.640799 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-2k8vl_ab6c4d05-33ed-4e96-b3a9-9b051aea7d99/kube-rbac-proxy/0.log" May 21 18:08:39.911594 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.911490 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/thanos-query/0.log" May 21 18:08:39.949254 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:39.949231 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/kube-rbac-proxy-web/0.log" May 21 18:08:40.001327 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:40.001299 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/kube-rbac-proxy/0.log" May 21 18:08:40.045256 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:40.045226 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/prom-label-proxy/0.log" May 21 18:08:40.078000 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:40.077974 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/kube-rbac-proxy-rules/0.log" May 21 18:08:40.103670 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:40.103649 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dddc7d686-rls58_3bb78619-3f85-4de0-bebd-9673bccf15a7/kube-rbac-proxy-metrics/0.log" May 21 18:08:41.037720 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.037690 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp"] May 21 18:08:41.038093 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.038079 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="303fe101-a8a7-4926-86de-ef151dd6cc80" containerName="cleanup" May 21 18:08:41.038093 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.038091 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="303fe101-a8a7-4926-86de-ef151dd6cc80" containerName="cleanup" May 21 18:08:41.038163 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.038145 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="303fe101-a8a7-4926-86de-ef151dd6cc80" containerName="cleanup" May 21 18:08:41.041277 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.041260 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.043935 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.043899 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"openshift-service-ca.crt\"" May 21 18:08:41.044059 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.043940 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"kube-root-ca.crt\"" May 21 18:08:41.044880 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.044867 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5jnr\"/\"default-dockercfg-j7btw\"" May 21 18:08:41.054416 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054394 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp"] May 21 18:08:41.054736 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-lib-modules\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.054785 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-podres\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.054817 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-sys\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.054864 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-proc\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.054963 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.054950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdhv\" (UniqueName: \"kubernetes.io/projected/178140db-b208-490a-9b93-56ed62c6507c-kube-api-access-7sdhv\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156007 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.155969 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-proc\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156041 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdhv\" (UniqueName: \"kubernetes.io/projected/178140db-b208-490a-9b93-56ed62c6507c-kube-api-access-7sdhv\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156074 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-lib-modules\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156093 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-podres\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-proc\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156127 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-sys\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156191 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-sys\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156208 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-podres\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.156578 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.156224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178140db-b208-490a-9b93-56ed62c6507c-lib-modules\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.165680 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.165650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdhv\" (UniqueName: \"kubernetes.io/projected/178140db-b208-490a-9b93-56ed62c6507c-kube-api-access-7sdhv\") pod \"perf-node-gather-daemonset-wtnbp\" (UID: \"178140db-b208-490a-9b93-56ed62c6507c\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.350705 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.350612 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.477642 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.477616 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp"] May 21 18:08:41.480025 ip-10-0-139-73 kubenswrapper[2568]: W0521 18:08:41.479995 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod178140db_b208_490a_9b93_56ed62c6507c.slice/crio-6550cd5c90f8f9b06dcffd7030da83dd8d3be231d2007bb5410b3b5d5b2a52b3 WatchSource:0}: Error finding container 6550cd5c90f8f9b06dcffd7030da83dd8d3be231d2007bb5410b3b5d5b2a52b3: Status 404 returned error can't find the container with id 6550cd5c90f8f9b06dcffd7030da83dd8d3be231d2007bb5410b3b5d5b2a52b3 May 21 18:08:41.481687 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.481667 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:08:41.907310 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.907260 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/1.log" May 21 18:08:41.911673 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.911641 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z7lcn_309d790e-4546-4c56-96b7-ae7ce96db741/console-operator/2.log" May 21 18:08:41.914901 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.914870 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" event={"ID":"178140db-b208-490a-9b93-56ed62c6507c","Type":"ContainerStarted","Data":"5f05804eae5b763cbca56c9a5b9293b0b28294c91493962eee65b1fdb88e494f"} May 21 18:08:41.915066 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.914924 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" event={"ID":"178140db-b208-490a-9b93-56ed62c6507c","Type":"ContainerStarted","Data":"6550cd5c90f8f9b06dcffd7030da83dd8d3be231d2007bb5410b3b5d5b2a52b3"} May 21 18:08:41.915066 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.914944 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:41.935424 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:41.935375 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" podStartSLOduration=0.935361395 podStartE2EDuration="935.361395ms" podCreationTimestamp="2026-05-21 18:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:08:41.933428126 +0000 UTC m=+2169.132046902" watchObservedRunningTime="2026-05-21 18:08:41.935361395 +0000 UTC m=+2169.133980171" May 21 18:08:42.897128 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:42.897095 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-ptj8w_4109581c-82f3-41a2-9727-46a905f8dd2e/volume-data-source-validator/0.log" May 21 18:08:43.664891 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:43.664841 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8ghl_2e96c0a6-1243-41d7-b3bd-2dc598972eeb/dns/0.log" May 21 18:08:43.691269 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:43.691243 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8ghl_2e96c0a6-1243-41d7-b3bd-2dc598972eeb/kube-rbac-proxy/0.log" May 21 18:08:43.809009 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:43.808978 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24jd7_bba38e0c-6594-416b-a147-3c9f67829767/dns-node-resolver/0.log" May 21 18:08:44.348177 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:44.348152 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr4db_94aca6d5-e843-4039-83e1-bbf0638799cd/node-ca/0.log" May 21 18:08:45.472265 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:45.472235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85f6f977d9-85j2p_8a89dda3-63de-4bc1-a685-3442f1ff8cd9/kube-auth-proxy/0.log" May 21 18:08:46.414485 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:46.414457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jrdb8_b8d7beb7-bfcf-45be-9838-08bab4283641/serve-healthcheck-canary/0.log" May 21 18:08:47.097513 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:47.097481 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxnrm_2dbc48e6-4fa7-468c-97b4-dc41901f81d6/kube-rbac-proxy/0.log" May 21 18:08:47.127166 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:47.127129 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxnrm_2dbc48e6-4fa7-468c-97b4-dc41901f81d6/exporter/0.log" May 21 18:08:47.155493 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:47.155459 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vxnrm_2dbc48e6-4fa7-468c-97b4-dc41901f81d6/extractor/0.log" May 21 18:08:47.928695 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:47.928669 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-wtnbp" May 21 18:08:49.535545 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:49.535516 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656425-pxzm9_69b90bd9-c88b-41b9-8f65-c24a974b671a/cleanup/0.log" May 21 18:08:49.578340 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:49.578302 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656440-zm9k9_303fe101-a8a7-4926-86de-ef151dd6cc80/cleanup/0.log" May 21 18:08:49.937324 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:49.937296 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-ph5jn_156eab35-3f4d-4e43-9011-3fbd3595de9a/manager/0.log" May 21 18:08:51.413710 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:51.413687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f6d69ccc4-c95sv_664f7463-4662-4edf-9e4c-5fcb2ce06a72/manager/0.log" May 21 18:08:56.588830 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:56.588795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-q5cn8_e17a4942-5c3e-45c2-bd46-67a8ad6c9223/migrator/0.log" May 21 18:08:56.609798 ip-10-0-139-73 kubenswrapper[2568]: I0521 18:08:56.609774 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-q5cn8_e17a4942-5c3e-45c2-bd46-67a8ad6c9223/graceful-termination/0.log"