Sep 08 13:16:19.852957 ip-10-0-128-91 systemd[1]: Starting Kubernetes Kubelet... Sep 08 13:16:20.220848 ip-10-0-128-91 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:16:20.220848 ip-10-0-128-91 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 13:16:20.220848 ip-10-0-128-91 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:16:20.220848 ip-10-0-128-91 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 13:16:20.220848 ip-10-0-128-91 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:16:20.221525 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.220879 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 13:16:20.225304 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225287 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.225304 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225302 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.225304 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225305 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225309 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225312 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225316 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225318 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225321 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225324 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225327 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225330 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225333 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225337 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225340 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225342 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225345 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225347 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225350 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225353 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225355 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225358 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225362 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.225395 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225366 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225369 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225372 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225377 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225380 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225383 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225386 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225389 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225392 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225395 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225397 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225400 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225403 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225406 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225408 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225411 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225414 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225417 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225420 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.225881 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225422 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225425 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225427 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225430 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225433 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225436 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225438 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225441 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225444 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225446 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225449 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225452 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225454 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225457 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225460 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225462 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225465 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225468 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225471 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225473 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.226370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225476 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225480 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225482 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225485 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225488 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225491 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225494 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225496 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225500 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225504 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225507 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225510 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225513 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225516 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225519 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225522 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225525 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225528 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225530 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.226926 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225533 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225535 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225538 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225540 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225543 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225546 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225548 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225551 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225554 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225557 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225559 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225576 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225582 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225586 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225590 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225594 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225598 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225601 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.225606 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.227388 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226288 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226294 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226297 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226300 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226303 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226306 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226309 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226312 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226315 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226317 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226320 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226322 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226325 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226328 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226330 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226333 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226337 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226341 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226346 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.227859 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226349 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226353 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226368 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226372 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226375 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226378 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226382 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226385 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226388 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226391 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226394 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226397 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226399 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226402 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226405 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226407 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226410 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226413 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226415 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226419 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.228336 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226421 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226424 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226426 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226429 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226431 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226434 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226436 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226439 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226441 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226444 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226446 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226448 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226451 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226455 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226457 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226460 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226463 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226466 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226468 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226471 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.228879 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226474 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226476 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226479 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226481 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226484 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226486 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226489 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226491 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226494 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226496 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226499 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226502 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226505 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226507 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226510 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226512 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226515 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226518 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226520 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.229363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226523 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226525 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226527 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226530 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226533 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226535 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226538 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226541 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226545 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226547 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226551 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226556 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226559 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226574 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226579 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226583 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226588 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226592 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226595 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226597 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.229832 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.226600 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227493 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227499 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227502 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227505 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227508 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227511 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227514 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227516 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227519 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227522 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227525 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227527 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227530 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227533 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227535 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227538 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227540 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227543 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227545 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.230322 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227548 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227550 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227553 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227556 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227559 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227562 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227582 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227585 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227587 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227590 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227593 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227596 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227600 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227604 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227606 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227610 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227613 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227616 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227620 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.230817 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227622 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227625 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227628 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227631 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227634 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227637 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227639 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227642 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227645 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227647 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227649 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227652 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227655 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227657 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227660 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227663 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227665 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227668 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227670 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227673 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.231276 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227675 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227678 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227681 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227683 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227686 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227688 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227691 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227693 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227696 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227698 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227701 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227703 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227707 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227710 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227712 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227717 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227720 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227722 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227725 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.231779 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227727 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227729 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227732 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227734 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227737 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227739 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227742 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227744 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227747 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227750 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227753 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227755 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227759 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227762 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227765 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227768 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227770 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227773 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227776 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.232226 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227779 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227782 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.227785 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227848 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227890 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227897 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227902 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227908 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227911 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227916 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227920 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227923 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227926 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227930 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227933 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227937 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227940 2564 flags.go:64] FLAG: --cgroup-root="" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227943 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227946 2564 flags.go:64] FLAG: --client-ca-file="" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227949 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227953 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227957 2564 flags.go:64] FLAG: --cluster-domain="" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227960 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227964 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 13:16:20.232716 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227967 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227970 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227974 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227977 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227980 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227983 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227987 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227990 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227993 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227996 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.227999 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228003 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228006 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228009 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228012 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228016 2564 flags.go:64] FLAG: --enable-server="true" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228019 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228024 2564 flags.go:64] FLAG: --event-burst="100" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228029 2564 flags.go:64] FLAG: --event-qps="50" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228032 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228035 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228039 2564 flags.go:64] FLAG: --eviction-hard="" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228042 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228046 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228049 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 13:16:20.233285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228052 2564 flags.go:64] FLAG: --eviction-soft="" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228055 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228058 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228061 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228064 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228067 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228070 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228073 2564 flags.go:64] FLAG: --feature-gates="" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228076 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228079 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228083 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228086 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228089 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228092 2564 flags.go:64] FLAG: --help="false" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228095 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228098 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228101 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228104 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228107 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228110 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228113 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228116 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228119 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 13:16:20.233881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228121 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228125 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228129 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228132 2564 flags.go:64] FLAG: --kube-reserved="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228135 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228138 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228141 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228144 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228147 2564 flags.go:64] FLAG: --lock-file="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228150 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228153 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228156 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228161 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228164 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228167 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228170 2564 flags.go:64] FLAG: --logging-format="text" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228173 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228177 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228180 2564 flags.go:64] FLAG: --manifest-url="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228183 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228187 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228190 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228194 2564 flags.go:64] FLAG: --max-pods="110" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228197 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228200 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 13:16:20.234474 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228203 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228206 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228209 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228212 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228215 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228223 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228226 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228229 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228232 2564 flags.go:64] FLAG: --pod-cidr="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228236 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228242 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228245 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228248 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228251 2564 flags.go:64] FLAG: --port="10250" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228254 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228257 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07091f754b8384ea3" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228261 2564 flags.go:64] FLAG: --qos-reserved="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228263 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228267 2564 flags.go:64] FLAG: --register-node="true" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228270 2564 flags.go:64] FLAG: --register-with-taints="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228273 2564 flags.go:64] FLAG: --registry-burst="10" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228276 2564 flags.go:64] FLAG: --registry-qps="5" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228279 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228282 2564 flags.go:64] FLAG: --reserved-memory="" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228298 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 13:16:20.235103 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228301 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228305 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228308 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228311 2564 flags.go:64] FLAG: --runonce="false" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228314 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228317 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228320 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228323 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228326 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228329 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228332 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228335 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228338 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228341 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228345 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228347 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228351 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228355 2564 flags.go:64] FLAG: --system-cgroups="" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228359 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228365 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228368 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228371 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228375 2564 flags.go:64] FLAG: --tls-min-version="" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228378 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228381 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 13:16:20.235762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228384 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228387 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228390 2564 flags.go:64] FLAG: --v="2" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228394 2564 flags.go:64] FLAG: --version="false" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228398 2564 flags.go:64] FLAG: --vmodule="" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228402 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.228407 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228520 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228524 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228527 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228530 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228533 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228536 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228539 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228542 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228545 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228548 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228551 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228554 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228557 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228559 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.236370 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228574 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228577 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228580 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228584 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228587 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228590 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228593 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228595 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228598 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228601 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228604 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228606 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228609 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228612 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228614 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228617 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228620 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228624 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228626 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228631 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.236917 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228634 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228637 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228640 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228643 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228646 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228649 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228651 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228654 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228657 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228659 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228663 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228666 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228670 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228673 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228675 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228679 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228682 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228686 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228688 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.237480 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228691 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228694 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228696 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228699 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228702 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228704 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228707 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228709 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228712 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228715 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228719 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228721 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228724 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228726 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228729 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228732 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228734 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228737 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228739 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.238000 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228742 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228744 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228747 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228750 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228752 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228755 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228757 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228760 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228762 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228767 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228771 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228774 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228777 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228780 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228783 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228785 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228788 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228790 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228793 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228796 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.238479 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228799 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228801 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228804 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228807 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228810 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228813 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.228816 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.229214 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.236507 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.236525 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.237168 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.237176 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237252 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237257 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237260 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.238979 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237264 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237266 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237269 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237272 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237275 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237279 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237283 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237286 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237289 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237292 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237295 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237297 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237300 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237302 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237305 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237308 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237310 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237313 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237315 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.239363 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237318 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237321 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237324 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237326 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237329 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237331 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237334 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237344 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237346 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237349 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237351 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237354 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237356 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237359 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237361 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237372 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237375 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237377 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237380 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237382 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.240057 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237385 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237388 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237390 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237392 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237395 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237398 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237400 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237402 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237405 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237408 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237411 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237413 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237415 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237418 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237420 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237423 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237427 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237430 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237434 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237437 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.240722 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237446 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237449 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237452 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237455 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237457 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237460 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237463 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237465 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237467 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237470 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237472 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237475 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237478 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237480 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237483 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237486 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237488 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237491 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237494 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237497 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.241516 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237499 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237503 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237507 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237509 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237512 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237514 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237517 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237519 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237522 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237524 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237527 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237530 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237533 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237541 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237543 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237546 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.242139 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237548 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.237553 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237720 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237728 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237731 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237734 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237737 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237740 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237742 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237745 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237749 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237754 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237758 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:16:20.242537 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237761 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237764 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237767 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237770 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237772 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237775 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237777 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237780 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237783 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237785 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237788 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237790 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237793 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237796 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237799 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237801 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237810 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237813 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237815 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237817 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:16:20.243100 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237820 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237823 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237825 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237828 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237830 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237833 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237836 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237838 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237841 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237843 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237846 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237849 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237851 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237854 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237856 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237859 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237861 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237864 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237866 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237869 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:16:20.243737 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237871 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237874 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237878 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237881 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237884 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237888 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237890 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237893 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237896 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237906 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237909 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237911 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237914 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237917 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237919 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237922 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237924 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237927 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237929 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237932 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:16:20.244554 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237934 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237937 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237939 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237942 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237944 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237947 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237949 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237952 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237954 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237956 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237959 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237962 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237964 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237967 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237969 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237972 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237975 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237977 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237980 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:16:20.245085 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237982 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237985 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237988 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237996 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.237999 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.238002 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.238005 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:20.238007 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.238012 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.238135 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.241506 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.242452 2564 server.go:1019] "Starting client certificate rotation" Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.242589 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.242630 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 13:16:20.245594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.245191 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 13:16:20.246343 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.246325 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 13:16:20.256547 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.256524 2564 log.go:25] "Validated CRI v1 runtime API" Sep 08 13:16:20.259215 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.259202 2564 log.go:25] "Validated CRI v1 image API" Sep 08 13:16:20.260090 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.260076 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 13:16:20.265446 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.265423 2564 fs.go:135] Filesystem UUIDs: map[25b9aa00-be87-4dab-8da1-23b4d251db3b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8a8a1d7d-ca18-49c5-89d1-4f9ded18ff22:/dev/nvme0n1p4] Sep 08 13:16:20.265502 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.265446 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 13:16:20.270887 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.270747 2564 manager.go:216] Machine: {Timestamp:2026-09-08 13:16:20.269484619 +0000 UTC m=+0.308581207 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100859 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258a4041d0ef5966c08d239a3722b0 SystemUUID:ec258a40-41d0-ef59-66c0-8d239a3722b0 BootID:cc541b0c-fa33-4705-85cd-bb6b492f7d0f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:c5:f2:da:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:c5:f2:da:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:80:94:3d:ce:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 13:16:20.270887 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.270875 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 13:16:20.271005 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.270954 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 13:16:20.273769 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.273691 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 13:16:20.274653 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.273773 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 13:16:20.275206 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.275153 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 13:16:20.275271 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.275245 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 13:16:20.275322 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.275254 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 13:16:20.275966 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.275952 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 13:16:20.277499 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.277485 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 13:16:20.277718 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.277701 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 13:16:20.281442 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281431 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 08 13:16:20.281546 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281537 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 13:16:20.281594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281580 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 08 13:16:20.281594 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281591 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 13:16:20.281654 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281605 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 13:16:20.281654 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281615 2564 kubelet.go:398] "Adding apiserver pod source" Sep 08 13:16:20.281654 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281623 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 13:16:20.281956 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281945 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 13:16:20.282009 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.281965 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 13:16:20.283814 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.283789 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 13:16:20.286136 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286119 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 13:16:20.286222 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286158 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 13:16:20.286379 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286362 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 13:16:20.286451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286383 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 13:16:20.286451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286392 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 13:16:20.286451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286398 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 13:16:20.286451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286406 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 13:16:20.286451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286412 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 13:16:20.286850 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286837 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 13:16:20.286850 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286849 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 13:16:20.286966 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286859 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 13:16:20.286966 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286868 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 13:16:20.286966 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286879 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 13:16:20.286966 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.286891 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 13:16:20.287534 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.287521 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 13:16:20.287534 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.287535 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 13:16:20.288887 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.288869 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 13:16:20.289286 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.289256 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 13:16:20.289338 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.289259 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 13:16:20.291441 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.291287 2564 server.go:1268] "Started kubelet" Sep 08 13:16:20.291478 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.291348 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 13:16:20.291552 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.291373 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 13:16:20.291620 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.291594 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 13:16:20.292362 ip-10-0-128-91 systemd[1]: Started Kubernetes Kubelet. Sep 08 13:16:20.292736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.292720 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 13:16:20.293265 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.293250 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 08 13:16:20.295655 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.295637 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 13:16:20.296577 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.295655 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-91.ec2.internal.18d35adc8c69a628 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-91.ec2.internal,UID:ip-10-0-128-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-91.ec2.internal,},FirstTimestamp:2026-09-08 13:16:20.291257896 +0000 UTC m=+0.330354462,LastTimestamp:2026-09-08 13:16:20.291257896 +0000 UTC m=+0.330354462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-91.ec2.internal,}" Sep 08 13:16:20.297324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.297304 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 13:16:20.297778 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.297760 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 13:16:20.297893 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.297855 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.298682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298468 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 13:16:20.298682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298471 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 13:16:20.298682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298499 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 13:16:20.298682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298642 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 08 13:16:20.298682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298652 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 08 13:16:20.298997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298689 2564 factory.go:55] Registering systemd factory Sep 08 13:16:20.298997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.298727 2564 factory.go:223] Registration of the systemd container factory successfully Sep 08 13:16:20.299163 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299007 2564 factory.go:153] Registering CRI-O factory Sep 08 13:16:20.299163 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299022 2564 factory.go:223] Registration of the crio container factory successfully Sep 08 13:16:20.299163 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299088 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 13:16:20.299163 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299105 2564 factory.go:103] Registering Raw factory Sep 08 13:16:20.299163 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299118 2564 manager.go:1196] Started watching for new ooms in manager Sep 08 13:16:20.299445 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.299432 2564 manager.go:349] Starting recovery of all containers Sep 08 13:16:20.301407 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.301346 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrtzt" Sep 08 13:16:20.308145 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.308123 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 13:16:20.308248 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.308202 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 13:16:20.309874 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.309844 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrtzt" Sep 08 13:16:20.310971 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.310890 2564 manager.go:354] Recovery completed Sep 08 13:16:20.315068 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.315053 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.316913 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.316899 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.316991 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.316926 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.316991 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.316937 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.317513 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.317497 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 13:16:20.317513 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.317513 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 13:16:20.317647 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.317528 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 08 13:16:20.317647 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.317528 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.318421 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.318403 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.318496 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.318430 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.318496 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.318442 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.319598 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.319585 2564 policy_none.go:49] "None policy: Start" Sep 08 13:16:20.319663 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.319601 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 13:16:20.319663 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.319611 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 13:16:20.321434 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.321421 2564 policy_none.go:47] "Start" Sep 08 13:16:20.342249 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342233 2564 manager.go:337] "Starting Device Plugin manager" Sep 08 13:16:20.342327 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.342274 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 13:16:20.342327 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342287 2564 server.go:87] "Starting device plugin registration server" Sep 08 13:16:20.342598 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342578 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 13:16:20.342671 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342596 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 13:16:20.342742 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342730 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 13:16:20.342813 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342801 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 13:16:20.342859 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.342815 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 13:16:20.343228 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.343205 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 13:16:20.343320 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.343258 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.443364 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.444468 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.444501 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.444522 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.444548 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.453100 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.470373 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.453119 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-91.ec2.internal\": node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.471823 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.471742 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 13:16:20.472252 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.472229 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.473039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.473020 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 13:16:20.473132 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.473080 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 13:16:20.473132 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.473105 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 13:16:20.473226 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.473149 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 13:16:20.475219 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.475199 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:20.573160 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.573113 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.574820 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.574188 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal"] Sep 08 13:16:20.574919 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.574882 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.575916 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.575900 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.576009 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.575932 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.576009 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.575946 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.578150 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578135 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.578273 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578251 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.578323 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578292 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.578879 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578858 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.578879 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578866 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.579042 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578886 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.579042 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578891 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.579042 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578900 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.579042 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.578905 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.580982 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.580966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.581064 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.580994 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:16:20.581923 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.581906 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:16:20.581990 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.581939 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:16:20.581990 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.581954 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:16:20.600604 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.600577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f022263899a55b4e99919ae6d5833641-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"f022263899a55b4e99919ae6d5833641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.600687 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.600606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.600687 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.600624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.609229 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.609205 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-91.ec2.internal\" not found" node="ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.613748 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.613732 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-91.ec2.internal\" not found" node="ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.673423 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.673397 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.701156 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f022263899a55b4e99919ae6d5833641-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"f022263899a55b4e99919ae6d5833641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.701258 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.701258 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.701258 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701242 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.701371 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f022263899a55b4e99919ae6d5833641-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"f022263899a55b4e99919ae6d5833641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.701371 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.701243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d65868f21f02702a8ee57e1048429807-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"d65868f21f02702a8ee57e1048429807\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.773965 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.773889 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.874601 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.874554 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:20.911997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.911973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.917076 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:20.916707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:20.975346 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:20.975306 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:21.075931 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.075853 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:21.176372 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.176338 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Sep 08 13:16:21.206071 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.206043 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:21.243115 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.243088 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 13:16:21.243546 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.243238 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 13:16:21.243546 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.243265 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 13:16:21.282515 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.282498 2564 apiserver.go:52] "Watching apiserver" Sep 08 13:16:21.298284 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.298258 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Sep 08 13:16:21.298284 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.298283 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 13:16:21.306809 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.306789 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 13:16:21.307145 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.307127 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-x6bh9","openshift-image-registry/node-ca-jr2dx","openshift-multus/multus-55ltf","openshift-multus/multus-additional-cni-plugins-5rvzc","openshift-network-diagnostics/network-check-target-p8s4x","openshift-network-operator/iptables-alerter-xzj8h","kube-system/konnectivity-agent-lbgbj","openshift-dns/node-resolver-pfjng","openshift-multus/network-metrics-daemon-j2lqn","openshift-ovn-kubernetes/ovnkube-node-5mdfg","kube-system/global-pull-secret-syncer-rvgrg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr"] Sep 08 13:16:21.309732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.309715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.310990 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.310974 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 13:16:21.311079 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.311043 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:21.312033 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.312555 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312530 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 13:11:21 +0000 UTC" deadline="2028-05-29 07:16:46.777721684 +0000 UTC" Sep 08 13:16:21.312555 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312553 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15090h0m25.46517137s" Sep 08 13:16:21.312705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.312705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312671 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.312705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.312691 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqfzt\"" Sep 08 13:16:21.313374 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.313357 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 13:16:21.314274 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.314248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.316835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.315121 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.316835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.315128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.316835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.315128 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qvngp\"" Sep 08 13:16:21.316835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.315267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 13:16:21.317186 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.317166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.317872 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.317852 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.317941 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.317871 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 13:16:21.318123 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.318107 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 13:16:21.318159 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.318128 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cttmh\"" Sep 08 13:16:21.318192 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.318181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.318721 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.318705 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 13:16:21.320037 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.320017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:21.320137 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.320086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:21.320198 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.320139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 13:16:21.320198 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.320159 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 13:16:21.320298 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.320272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sqfzw\"" Sep 08 13:16:21.322407 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.322388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.324720 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.324701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.325220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.325202 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 13:16:21.325305 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.325285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.325361 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.325285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7v6xz\"" Sep 08 13:16:21.325420 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.325287 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.326983 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.326945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.327450 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.327432 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 13:16:21.327525 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.327434 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 13:16:21.327525 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.327482 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n4t8t\"" Sep 08 13:16:21.329225 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.329209 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.329456 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.329442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.329520 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.329500 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:21.329600 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.329586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.329763 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.329750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-892xm\"" Sep 08 13:16:21.338455 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.338435 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.340915 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.340899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.340995 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.340965 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:21.341540 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.341523 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 13:16:21.342875 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.342859 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-42wsg\"" Sep 08 13:16:21.342990 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.342973 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.343050 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.342988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 13:16:21.343050 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343032 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 13:16:21.343050 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.342972 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.343323 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343308 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal"] Sep 08 13:16:21.343360 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343335 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal"] Sep 08 13:16:21.343416 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.343451 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343436 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 13:16:21.343971 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.343954 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jghjf" Sep 08 13:16:21.345931 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.345915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v5j7v\"" Sep 08 13:16:21.346032 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.346016 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 13:16:21.346092 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.346069 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 13:16:21.346383 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.346367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 13:16:21.354980 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.354966 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jghjf" Sep 08 13:16:21.400142 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.400119 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:21.400300 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.400283 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 13:16:21.404944 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.404927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-env-overrides\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.404997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.404954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-socket-dir-parent\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.404997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.404972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-run\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.404997 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.404989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.405111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-kubelet\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.405111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-tmp\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.405111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-multus-certs\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-systemd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cnibin\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-bin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-agent-certs\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-registration-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-tmp-dir\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.405353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-var-lib-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-cni-binary-copy\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-system-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-conf-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvvfv\" (UniqueName: \"kubernetes.io/projected/99a3fb34-38a0-4789-a65c-5c93c8f2f785-kube-api-access-bvvfv\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd628b8-041b-4817-87ea-98709f7b22b5-host-slash\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-systemd-units\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-node-log\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-kubernetes\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-konnectivity-ca\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbz2f\" (UniqueName: \"kubernetes.io/projected/9df611de-523f-40d6-bf4f-df1b92c97f0a-kube-api-access-wbz2f\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwltc\" (UniqueName: \"kubernetes.io/projected/b482797d-2aaa-4857-8784-dc50396e5f9a-kube-api-access-nwltc\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7ms\" (UniqueName: \"kubernetes.io/projected/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kube-api-access-jp7ms\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.405736 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-ovn\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-kubelet-config\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-netns\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-netd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-host\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-host\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ncw8\" (UniqueName: \"kubernetes.io/projected/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-kube-api-access-8ncw8\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.405993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-multus\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-kubelet\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-device-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdcm\" (UniqueName: \"kubernetes.io/projected/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-kube-api-access-5rdcm\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysconfig\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-conf\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-cnibin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-dbus\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxgj4\" (UniqueName: \"kubernetes.io/projected/fbe6f66f-652f-477d-a01d-04a47b11b2a3-kube-api-access-bxgj4\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-netns\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-lib-modules\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-k8s-cni-cncf-io\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-daemon-config\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-etc-kubernetes\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-sys\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc79j\" (UniqueName: \"kubernetes.io/projected/f8fa79be-943f-412c-b434-00bfc7faf83c-kube-api-access-wc79j\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-hostroot\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-sys-fs\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-etc-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-log-socket\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.406888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-bin\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-serviceca\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cd628b8-041b-4817-87ea-98709f7b22b5-iptables-alerter-script\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2m4\" (UniqueName: \"kubernetes.io/projected/6cd628b8-041b-4817-87ea-98709f7b22b5-kube-api-access-gk2m4\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-config\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovn-node-metrics-cert\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-script-lib\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-var-lib-kubelet\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-modprobe-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-systemd\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-tuned\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.406981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-socket-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.407009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-hosts-file\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.407036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-slash\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.407523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.407061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-system-cni-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.408111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.407099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.408111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.407125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.508347 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwltc\" (UniqueName: \"kubernetes.io/projected/b482797d-2aaa-4857-8784-dc50396e5f9a-kube-api-access-nwltc\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.508347 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7ms\" (UniqueName: \"kubernetes.io/projected/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kube-api-access-jp7ms\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-ovn\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-kubelet-config\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-netns\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-ovn\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508491 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-netns\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-kubelet-config\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-netd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.508650 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-host\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-host\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508724 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-netd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508738 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-host\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ncw8\" (UniqueName: \"kubernetes.io/projected/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-kube-api-access-8ncw8\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508774 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-host\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-multus\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-kubelet\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-device-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdcm\" (UniqueName: \"kubernetes.io/projected/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-kube-api-access-5rdcm\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-kubelet\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysconfig\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysconfig\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508933 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-multus\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-conf\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.509184 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.508995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-device-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-cnibin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-dbus\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxgj4\" (UniqueName: \"kubernetes.io/projected/fbe6f66f-652f-477d-a01d-04a47b11b2a3-kube-api-access-bxgj4\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-netns\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509107 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509138 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-netns\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc050c15-aeaf-4499-934d-8c32c0f324f0-dbus\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-lib-modules\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509199 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-cnibin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-k8s-cni-cncf-io\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-daemon-config\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-etc-kubernetes\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-sysctl-conf\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509285 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-k8s-cni-cncf-io\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.510119 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-sys\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-etc-kubernetes\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc79j\" (UniqueName: \"kubernetes.io/projected/f8fa79be-943f-412c-b434-00bfc7faf83c-kube-api-access-wc79j\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-hostroot\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-sys\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-lib-modules\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-sys-fs\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509432 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-hostroot\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509446 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-sys-fs\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-etc-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-log-socket\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.509513 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509515 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-etc-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-bin\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-serviceca\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-log-socket\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.511755 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-cni-bin\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.509613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:22.009556318 +0000 UTC m=+2.048652879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cd628b8-041b-4817-87ea-98709f7b22b5-iptables-alerter-script\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2m4\" (UniqueName: \"kubernetes.io/projected/6cd628b8-041b-4817-87ea-98709f7b22b5-kube-api-access-gk2m4\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-config\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovn-node-metrics-cert\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-script-lib\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-var-lib-kubelet\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-var-lib-kubelet\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509793 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-daemon-config\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-modprobe-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-systemd\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-tuned\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.512624 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-socket-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-serviceca\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-systemd\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-modprobe-d\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.509990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-hosts-file\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-slash\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510176 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-socket-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-system-cni-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-hosts-file\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510222 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-slash\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510263 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-system-cni-dir\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-env-overrides\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.513462 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-socket-dir-parent\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-run\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510379 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cd628b8-041b-4817-87ea-98709f7b22b5-iptables-alerter-script\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510382 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-config\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510440 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-socket-dir-parent\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-kubelet\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovnkube-script-lib\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-run\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-tmp\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-host-kubelet\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-multus-certs\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-systemd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.510578 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510591 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-run-multus-certs\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514234 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cnibin\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.510646 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:22.010626426 +0000 UTC m=+2.049722996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-run-systemd\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510670 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbe6f66f-652f-477d-a01d-04a47b11b2a3-cnibin\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-bin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-agent-certs\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-registration-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-tmp-dir\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df611de-523f-40d6-bf4f-df1b92c97f0a-env-overrides\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-var-lib-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-var-lib-openvswitch\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-cni-binary-copy\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-host-var-lib-cni-bin\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-system-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.514784 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbe6f66f-652f-477d-a01d-04a47b11b2a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-conf-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvvfv\" (UniqueName: \"kubernetes.io/projected/99a3fb34-38a0-4789-a65c-5c93c8f2f785-kube-api-access-bvvfv\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510980 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-system-cni-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.510995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd628b8-041b-4817-87ea-98709f7b22b5-host-slash\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b482797d-2aaa-4857-8784-dc50396e5f9a-multus-conf-dir\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-systemd-units\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-node-log\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cd628b8-041b-4817-87ea-98709f7b22b5-host-slash\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-kubernetes\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-konnectivity-ca\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9d65c5c-54bb-4e12-b239-3252d586c4ee-registration-dir\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-node-log\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-tmp-dir\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-kubernetes\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbz2f\" (UniqueName: \"kubernetes.io/projected/9df611de-523f-40d6-bf4f-df1b92c97f0a-kube-api-access-wbz2f\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df611de-523f-40d6-bf4f-df1b92c97f0a-systemd-units\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.511693 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-konnectivity-ca\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.515255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.512144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b482797d-2aaa-4857-8784-dc50396e5f9a-cni-binary-copy\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.515798 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.514298 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-etc-tuned\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.515798 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.514325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df611de-523f-40d6-bf4f-df1b92c97f0a-ovn-node-metrics-cert\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.515798 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.514468 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8fa79be-943f-412c-b434-00bfc7faf83c-tmp\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.515798 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.514472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f88ba5e-34a7-42f2-8e3a-b16a29d31380-agent-certs\") pod \"konnectivity-agent-lbgbj\" (UID: \"7f88ba5e-34a7-42f2-8e3a-b16a29d31380\") " pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.518033 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.518010 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7ms\" (UniqueName: \"kubernetes.io/projected/c9d65c5c-54bb-4e12-b239-3252d586c4ee-kube-api-access-jp7ms\") pod \"aws-ebs-csi-driver-node-9jmgr\" (UID: \"c9d65c5c-54bb-4e12-b239-3252d586c4ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:21.519766 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.519742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwltc\" (UniqueName: \"kubernetes.io/projected/b482797d-2aaa-4857-8784-dc50396e5f9a-kube-api-access-nwltc\") pod \"multus-55ltf\" (UID: \"b482797d-2aaa-4857-8784-dc50396e5f9a\") " pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.520122 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.520096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdcm\" (UniqueName: \"kubernetes.io/projected/81d11a11-8353-4a7c-a0c6-6bd486a5a3b2-kube-api-access-5rdcm\") pod \"node-resolver-pfjng\" (UID: \"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2\") " pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.520776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.520747 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ncw8\" (UniqueName: \"kubernetes.io/projected/c5ce15f1-4852-4b48-b87e-51fbfe76bbe9-kube-api-access-8ncw8\") pod \"node-ca-jr2dx\" (UID: \"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9\") " pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.520865 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.520785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxgj4\" (UniqueName: \"kubernetes.io/projected/fbe6f66f-652f-477d-a01d-04a47b11b2a3-kube-api-access-bxgj4\") pod \"multus-additional-cni-plugins-5rvzc\" (UID: \"fbe6f66f-652f-477d-a01d-04a47b11b2a3\") " pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.521203 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.521182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2m4\" (UniqueName: \"kubernetes.io/projected/6cd628b8-041b-4817-87ea-98709f7b22b5-kube-api-access-gk2m4\") pod \"iptables-alerter-xzj8h\" (UID: \"6cd628b8-041b-4817-87ea-98709f7b22b5\") " pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.521300 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.521227 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvvfv\" (UniqueName: \"kubernetes.io/projected/99a3fb34-38a0-4789-a65c-5c93c8f2f785-kube-api-access-bvvfv\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:21.521569 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.521553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc79j\" (UniqueName: \"kubernetes.io/projected/f8fa79be-943f-412c-b434-00bfc7faf83c-kube-api-access-wc79j\") pod \"tuned-x6bh9\" (UID: \"f8fa79be-943f-412c-b434-00bfc7faf83c\") " pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.522548 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.522531 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:21.522689 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.522569 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:21.522689 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.522583 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:21.522689 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:21.522666 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:22.022623702 +0000 UTC m=+2.061720259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:21.522912 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.522895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbz2f\" (UniqueName: \"kubernetes.io/projected/9df611de-523f-40d6-bf4f-df1b92c97f0a-kube-api-access-wbz2f\") pod \"ovnkube-node-5mdfg\" (UID: \"9df611de-523f-40d6-bf4f-df1b92c97f0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.579157 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.579067 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:21.628051 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.628014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" Sep 08 13:16:21.638732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.638714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jr2dx" Sep 08 13:16:21.656637 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.656613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55ltf" Sep 08 13:16:21.672063 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.672040 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" Sep 08 13:16:21.688697 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.688672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzj8h" Sep 08 13:16:21.694676 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.694649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:21.708975 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.708949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfjng" Sep 08 13:16:21.721265 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.721246 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:21.726208 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:21.726189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" Sep 08 13:16:22.015146 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.015052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:22.015146 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.015107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:22.015346 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.015230 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:22.015346 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.015267 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:22.015346 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.015295 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:23.015278083 +0000 UTC m=+3.054374638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:22.015346 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.015310 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:23.015303259 +0000 UTC m=+3.054399815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:22.115893 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.115866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:22.116096 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.116043 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:22.116096 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.116064 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:22.116096 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.116074 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:22.116268 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.116123 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:23.116110005 +0000 UTC m=+3.155206560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:22.191114 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.190950 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:22.285566 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.285533 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb482797d_2aaa_4857_8784_dc50396e5f9a.slice/crio-10a06aa923a7c87d18d233d76f00609205af3653b6468f12486cf452893703f1 WatchSource:0}: Error finding container 10a06aa923a7c87d18d233d76f00609205af3653b6468f12486cf452893703f1: Status 404 returned error can't find the container with id 10a06aa923a7c87d18d233d76f00609205af3653b6468f12486cf452893703f1 Sep 08 13:16:22.288369 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.288343 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd628b8_041b_4817_87ea_98709f7b22b5.slice/crio-d80aa5d06dc97e4c576899f9f1ed5ac8491e2cb27ae775790264ea8c003e4f50 WatchSource:0}: Error finding container d80aa5d06dc97e4c576899f9f1ed5ac8491e2cb27ae775790264ea8c003e4f50: Status 404 returned error can't find the container with id d80aa5d06dc97e4c576899f9f1ed5ac8491e2cb27ae775790264ea8c003e4f50 Sep 08 13:16:22.289541 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.289509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ce15f1_4852_4b48_b87e_51fbfe76bbe9.slice/crio-4da79a05a6374628e50351f1ebd9ca458335f37b22c378cca54cce207c43eb95 WatchSource:0}: Error finding container 4da79a05a6374628e50351f1ebd9ca458335f37b22c378cca54cce207c43eb95: Status 404 returned error can't find the container with id 4da79a05a6374628e50351f1ebd9ca458335f37b22c378cca54cce207c43eb95 Sep 08 13:16:22.289958 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.289932 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f88ba5e_34a7_42f2_8e3a_b16a29d31380.slice/crio-cf042283521eff604d3dd4c56b97edad9bcf9516f8b8af9a17a876abbc37eb4a WatchSource:0}: Error finding container cf042283521eff604d3dd4c56b97edad9bcf9516f8b8af9a17a876abbc37eb4a: Status 404 returned error can't find the container with id cf042283521eff604d3dd4c56b97edad9bcf9516f8b8af9a17a876abbc37eb4a Sep 08 13:16:22.292080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.291926 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 13:16:22.298184 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.298081 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df611de_523f_40d6_bf4f_df1b92c97f0a.slice/crio-ace46c0964ec631d6feac6d563c59eb45c81d63d33b6d735664df4193e72beed WatchSource:0}: Error finding container ace46c0964ec631d6feac6d563c59eb45c81d63d33b6d735664df4193e72beed: Status 404 returned error can't find the container with id ace46c0964ec631d6feac6d563c59eb45c81d63d33b6d735664df4193e72beed Sep 08 13:16:22.340710 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.340679 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d11a11_8353_4a7c_a0c6_6bd486a5a3b2.slice/crio-eb428dc028b5de549d5a7181c41e92fc98a2066fc3419cabb097cb3debf044db WatchSource:0}: Error finding container eb428dc028b5de549d5a7181c41e92fc98a2066fc3419cabb097cb3debf044db: Status 404 returned error can't find the container with id eb428dc028b5de549d5a7181c41e92fc98a2066fc3419cabb097cb3debf044db Sep 08 13:16:22.343579 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.343556 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe6f66f_652f_477d_a01d_04a47b11b2a3.slice/crio-df1a138b26fc025497c24a600b637d68beb80eb9f8b554f7c3f1ac3d786673cd WatchSource:0}: Error finding container df1a138b26fc025497c24a600b637d68beb80eb9f8b554f7c3f1ac3d786673cd: Status 404 returned error can't find the container with id df1a138b26fc025497c24a600b637d68beb80eb9f8b554f7c3f1ac3d786673cd Sep 08 13:16:22.350426 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.350402 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d65c5c_54bb_4e12_b239_3252d586c4ee.slice/crio-f9ce8792e01f8e028d5c24e3ba48625f594bfae2318acfe19e5f16b6063abfb2 WatchSource:0}: Error finding container f9ce8792e01f8e028d5c24e3ba48625f594bfae2318acfe19e5f16b6063abfb2: Status 404 returned error can't find the container with id f9ce8792e01f8e028d5c24e3ba48625f594bfae2318acfe19e5f16b6063abfb2 Sep 08 13:16:22.358290 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.358248 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:11:22 +0000 UTC" deadline="2028-06-12 20:24:21.099162196 +0000 UTC" Sep 08 13:16:22.358290 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.358291 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15439h7m58.740875222s" Sep 08 13:16:22.474330 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.474298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:22.474492 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.474342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:22.474492 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.474432 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:22.474574 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:22.474552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:22.478055 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.478010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"ace46c0964ec631d6feac6d563c59eb45c81d63d33b6d735664df4193e72beed"} Sep 08 13:16:22.479121 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.479090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbgbj" event={"ID":"7f88ba5e-34a7-42f2-8e3a-b16a29d31380","Type":"ContainerStarted","Data":"cf042283521eff604d3dd4c56b97edad9bcf9516f8b8af9a17a876abbc37eb4a"} Sep 08 13:16:22.480248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.480230 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jr2dx" event={"ID":"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9","Type":"ContainerStarted","Data":"4da79a05a6374628e50351f1ebd9ca458335f37b22c378cca54cce207c43eb95"} Sep 08 13:16:22.481393 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.481370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzj8h" event={"ID":"6cd628b8-041b-4817-87ea-98709f7b22b5","Type":"ContainerStarted","Data":"d80aa5d06dc97e4c576899f9f1ed5ac8491e2cb27ae775790264ea8c003e4f50"} Sep 08 13:16:22.482539 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.482516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55ltf" event={"ID":"b482797d-2aaa-4857-8784-dc50396e5f9a","Type":"ContainerStarted","Data":"10a06aa923a7c87d18d233d76f00609205af3653b6468f12486cf452893703f1"} Sep 08 13:16:22.483627 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.483603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" event={"ID":"c9d65c5c-54bb-4e12-b239-3252d586c4ee","Type":"ContainerStarted","Data":"f9ce8792e01f8e028d5c24e3ba48625f594bfae2318acfe19e5f16b6063abfb2"} Sep 08 13:16:22.484774 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.484751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerStarted","Data":"df1a138b26fc025497c24a600b637d68beb80eb9f8b554f7c3f1ac3d786673cd"} Sep 08 13:16:22.485727 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:22.485707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfjng" event={"ID":"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2","Type":"ContainerStarted","Data":"eb428dc028b5de549d5a7181c41e92fc98a2066fc3419cabb097cb3debf044db"} Sep 08 13:16:22.691443 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:22.691404 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fa79be_943f_412c_b434_00bfc7faf83c.slice/crio-7b046d713bc49934e721e5e018fa9e17c5f7ca71002aa135a1fef626865b928f WatchSource:0}: Error finding container 7b046d713bc49934e721e5e018fa9e17c5f7ca71002aa135a1fef626865b928f: Status 404 returned error can't find the container with id 7b046d713bc49934e721e5e018fa9e17c5f7ca71002aa135a1fef626865b928f Sep 08 13:16:23.022926 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.022835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:23.023107 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.022931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:23.023107 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.023062 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:23.023239 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.023124 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:25.023104821 +0000 UTC m=+5.062201383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:23.023437 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.023415 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:23.023511 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.023466 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:25.023450907 +0000 UTC m=+5.062547478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:23.123729 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.123688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:23.123928 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.123878 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:23.123928 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.123901 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:23.123928 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.123914 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:23.124125 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.123975 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:25.123954944 +0000 UTC m=+5.163051514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:23.358993 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.358898 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:11:22 +0000 UTC" deadline="2028-04-24 09:15:30.366783039 +0000 UTC" Sep 08 13:16:23.358993 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.358940 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h59m7.007847381s" Sep 08 13:16:23.473830 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.473795 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:23.474028 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:23.473955 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:23.500170 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.500107 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" event={"ID":"f8fa79be-943f-412c-b434-00bfc7faf83c","Type":"ContainerStarted","Data":"7b046d713bc49934e721e5e018fa9e17c5f7ca71002aa135a1fef626865b928f"} Sep 08 13:16:23.593637 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:23.593377 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:16:24.474812 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:24.474776 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:24.475302 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:24.474933 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:24.475419 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:24.475383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:24.475508 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:24.475484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:25.041601 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:25.041537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:25.041833 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:25.041642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:25.041833 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.041785 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:25.041969 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.041849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:29.041829412 +0000 UTC m=+9.080925972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:25.042044 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.042000 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:25.042102 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.042069 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:29.042049443 +0000 UTC m=+9.081146017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:25.142378 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:25.142341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:25.142568 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.142506 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:25.142568 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.142528 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:25.142568 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.142540 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:25.142764 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.142599 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:29.142580754 +0000 UTC m=+9.181677311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:25.474049 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:25.474013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:25.474249 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:25.474191 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:26.473801 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:26.473762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:26.474434 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:26.473914 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:26.474434 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:26.474008 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:26.474434 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:26.474112 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:27.474318 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:27.474275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:27.474825 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:27.474422 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:28.474006 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:28.473971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:28.474006 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:28.474001 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:28.474231 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:28.474119 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:28.474269 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:28.474237 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:29.078373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:29.078321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:29.078983 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:29.078391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:29.078983 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.078629 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:29.078983 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.078707 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.078685116 +0000 UTC m=+17.117781692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:29.079185 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.078629 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:29.079185 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.079119 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.079094934 +0000 UTC m=+17.118191509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:29.179547 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:29.179496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:29.179796 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.179732 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:29.179796 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.179762 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:29.179796 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.179776 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:29.180040 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.179878 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.179849742 +0000 UTC m=+17.218946313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:29.474051 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:29.473409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:29.474051 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:29.473565 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:30.078310 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.077883 2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system_f022263899a55b4e99919ae6d5833641_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1: reading manifest sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" Sep 08 13:16:30.078310 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.077966 2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system_f022263899a55b4e99919ae6d5833641_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1: reading manifest sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:30.078310 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.078001 2564 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system_f022263899a55b4e99919ae6d5833641_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1: reading manifest sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:30.078310 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.078082 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system(f022263899a55b4e99919ae6d5833641)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system(f022263899a55b4e99919ae6d5833641)\\\": rpc error: code = Unknown desc = creating pod sandbox with name \\\"k8s_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_kube-system_f022263899a55b4e99919ae6d5833641_0\\\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1: reading manifest sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" podUID="f022263899a55b4e99919ae6d5833641" Sep 08 13:16:30.475814 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:30.475096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:30.475814 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.475223 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:30.475814 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:30.475611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:30.475814 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:30.475721 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:30.523921 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:30.523886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:30.524249 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:30.524184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Sep 08 13:16:31.473744 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:31.473667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:31.474239 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:31.473827 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:32.473935 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:32.473902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:32.474403 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:32.474044 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:32.474403 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:32.474068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:32.474403 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:32.474145 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:33.474139 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:33.474105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:33.474612 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:33.474245 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:34.474027 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:34.473989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:34.474027 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:34.474034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:34.474506 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:34.474125 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:34.474506 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:34.474254 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:35.473789 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:35.473755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:35.473987 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:35.473877 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:36.473724 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:36.473694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:36.474180 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:36.473694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:36.474180 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:36.473844 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:36.474180 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:36.473952 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:37.138282 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:37.138242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:37.138472 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:37.138318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:37.138472 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.138419 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:37.138609 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.138488 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:53.138473749 +0000 UTC m=+33.177570306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:37.138609 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.138419 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:37.138609 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.138561 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:53.13854875 +0000 UTC m=+33.177645312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:37.238810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:37.238767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:37.238998 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.238908 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:37.238998 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.238938 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:37.238998 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.238951 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:37.239153 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.239011 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:53.23899422 +0000 UTC m=+33.278090794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:37.474096 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:37.474017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:37.474533 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:37.474148 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:38.473776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:38.473736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:38.473776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:38.473763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:38.473988 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:38.473868 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:38.473988 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:38.473976 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:39.473583 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:39.473533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:39.474025 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:39.473682 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:40.429886 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:40.429860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65868f21f02702a8ee57e1048429807.slice/crio-bbebfc094be9cb1584572d5c2ba755d87166f9b29862fee0f1f4a88f70feee10 WatchSource:0}: Error finding container bbebfc094be9cb1584572d5c2ba755d87166f9b29862fee0f1f4a88f70feee10: Status 404 returned error can't find the container with id bbebfc094be9cb1584572d5c2ba755d87166f9b29862fee0f1f4a88f70feee10 Sep 08 13:16:40.474227 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:40.474205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:40.474597 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:40.474290 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:40.474597 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:40.474322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:40.474597 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:40.474399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:40.541901 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:40.541870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"d65868f21f02702a8ee57e1048429807","Type":"ContainerStarted","Data":"bbebfc094be9cb1584572d5c2ba755d87166f9b29862fee0f1f4a88f70feee10"} Sep 08 13:16:40.542901 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:40.542878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" event={"ID":"f022263899a55b4e99919ae6d5833641","Type":"ContainerStarted","Data":"4d9daa74a25dc5d08b34a6ae16c5cc83d02589b9abc909831fc1c374aadc6a5b"} Sep 08 13:16:41.473796 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.473585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:41.473992 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:41.473909 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:41.547561 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.547524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" event={"ID":"c9d65c5c-54bb-4e12-b239-3252d586c4ee","Type":"ContainerStarted","Data":"3f7640cead1a69ea3e9df6ddf74fd4e67b26b31e4a369964a514de5bed36b4fc"} Sep 08 13:16:41.549535 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.549494 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="26f792d5e49b5bd8d1fc5671fe6b2204756dd4a31fc0aad8eee46bc21b28af35" exitCode=0 Sep 08 13:16:41.549680 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.549613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"26f792d5e49b5bd8d1fc5671fe6b2204756dd4a31fc0aad8eee46bc21b28af35"} Sep 08 13:16:41.551334 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.551312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfjng" event={"ID":"81d11a11-8353-4a7c-a0c6-6bd486a5a3b2","Type":"ContainerStarted","Data":"c40985766082db7f556c0eac609d042bd36022b13d35d131b64140006397e16d"} Sep 08 13:16:41.553215 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.553181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jr2dx" event={"ID":"c5ce15f1-4852-4b48-b87e-51fbfe76bbe9","Type":"ContainerStarted","Data":"9e9291597847cf9826196880f230173741a805f5a5efb39791933ebd1f81f15a"} Sep 08 13:16:41.555046 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.555028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:16:41.555478 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.555453 2564 generic.go:356] "Generic (PLEG): container finished" podID="9df611de-523f-40d6-bf4f-df1b92c97f0a" containerID="e5bee3f543fb1c1455152825e9d83ab3ef2a81517b66aaf75e6a28739af50672" exitCode=1 Sep 08 13:16:41.555583 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.555523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerDied","Data":"e5bee3f543fb1c1455152825e9d83ab3ef2a81517b66aaf75e6a28739af50672"} Sep 08 13:16:41.555663 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.555610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"e224532ab6404b2cf3dc16d0b17850385defedafcb576e746d50a9983165d742"} Sep 08 13:16:41.558706 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.558683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbgbj" event={"ID":"7f88ba5e-34a7-42f2-8e3a-b16a29d31380","Type":"ContainerStarted","Data":"ca1c2ec7097cd001292754940434c7dd6735472323b466e4f3e35bb151d03158"} Sep 08 13:16:41.560825 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.560798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55ltf" event={"ID":"b482797d-2aaa-4857-8784-dc50396e5f9a","Type":"ContainerStarted","Data":"ba9724174f3bad63cf024b9eb25477eb3d2590165ec82c8c5feaac5937f15f43"} Sep 08 13:16:41.562292 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.562274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" event={"ID":"f8fa79be-943f-412c-b434-00bfc7faf83c","Type":"ContainerStarted","Data":"789ab725ea24c5824f5102117ef55efece42acc2f322c75f77ea227295e964fe"} Sep 08 13:16:41.592961 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.592388 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lbgbj" podStartSLOduration=9.933118542 podStartE2EDuration="20.592362746s" totalImagesPullingTime="10.659244204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:41.591430633 +0000 UTC m=+21.630527225" watchObservedRunningTime="2026-09-08 13:16:41.592362746 +0000 UTC m=+21.631459323" Sep 08 13:16:41.608789 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.608744 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pfjng" podStartSLOduration=2.528979539 podStartE2EDuration="20.60873239s" totalImagesPullingTime="18.079752851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:41.608450936 +0000 UTC m=+21.647547550" watchObservedRunningTime="2026-09-08 13:16:41.60873239 +0000 UTC m=+21.647828965" Sep 08 13:16:41.626971 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.626928 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-55ltf" podStartSLOduration=2.21692929 podStartE2EDuration="20.626917051s" totalImagesPullingTime="18.409987761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:41.626905355 +0000 UTC m=+21.666001951" watchObservedRunningTime="2026-09-08 13:16:41.626917051 +0000 UTC m=+21.666013627" Sep 08 13:16:41.645680 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.645646 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x6bh9" podStartSLOduration=2.914003523 podStartE2EDuration="20.64563544s" totalImagesPullingTime="17.731631917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:41.645489585 +0000 UTC m=+21.684586181" watchObservedRunningTime="2026-09-08 13:16:41.64563544 +0000 UTC m=+21.684732016" Sep 08 13:16:41.662718 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:41.662680 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jr2dx" podStartSLOduration=2.5331737629999997 podStartE2EDuration="20.662665262s" totalImagesPullingTime="18.129491499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:41.662595467 +0000 UTC m=+21.701692068" watchObservedRunningTime="2026-09-08 13:16:41.662665262 +0000 UTC m=+21.701761839" Sep 08 13:16:42.169836 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.169800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:42.170489 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.170468 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:42.473764 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.473687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:42.473922 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:42.473828 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:42.473922 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.473879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:42.474037 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:42.473990 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:42.566714 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.566674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzj8h" event={"ID":"6cd628b8-041b-4817-87ea-98709f7b22b5","Type":"ContainerStarted","Data":"2b52aeeb2c29d0cabd911209d51acb7897f7bc75eedf39988a317a1b8881bb3e"} Sep 08 13:16:42.572127 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.572102 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:16:42.572678 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.572650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"e1d8e1ae3cf22fd03882dbb8623ec11d025e8700e6aaf64de036be970420584f"} Sep 08 13:16:42.572772 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.572735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"eeeaa6a10b3a41910eab0b3a04c2501e1e08bf5dedb13f2c7c14848790b95035"} Sep 08 13:16:42.572824 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.572794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"31b7d8fc58704d7fbbc21dff4964d2bf07d47f8c372ba8fe9e2817ddd5f76a23"} Sep 08 13:16:42.572892 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.572841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"1b0942bb2aa15658c0acf088318709efa7ad230be12057dc1b36b59cb776f900"} Sep 08 13:16:42.574831 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.574660 2564 generic.go:356] "Generic (PLEG): container finished" podID="d65868f21f02702a8ee57e1048429807" containerID="cb413dc75d4c554f629923395e285ea430bc21a375b56e33a5c407b6f52cd72c" exitCode=0 Sep 08 13:16:42.574965 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.574945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"d65868f21f02702a8ee57e1048429807","Type":"ContainerDied","Data":"cb413dc75d4c554f629923395e285ea430bc21a375b56e33a5c407b6f52cd72c"} Sep 08 13:16:42.575260 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.575241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:42.575802 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.575781 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lbgbj" Sep 08 13:16:42.604979 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.603534 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzj8h" podStartSLOduration=3.473927775 podStartE2EDuration="21.603516446s" totalImagesPullingTime="18.129588671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:42.584781214 +0000 UTC m=+22.623877803" watchObservedRunningTime="2026-09-08 13:16:42.603516446 +0000 UTC m=+22.642613024" Sep 08 13:16:42.999343 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:42.999271 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 13:16:43.356705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.356539 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T13:16:42.999292212Z","UUID":"95d0fff8-8298-41db-9852-5100cf4ea4e4","Handler":null,"Name":"","Endpoint":""} Sep 08 13:16:43.358248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.358223 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 13:16:43.358393 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.358264 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 13:16:43.474412 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.474378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:43.474616 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:43.474502 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:43.580176 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.580142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" event={"ID":"c9d65c5c-54bb-4e12-b239-3252d586c4ee","Type":"ContainerStarted","Data":"b7c3ef37af5411350dc9a19a174a31cde6aa7661dab8fd80973d9986dae0ea30"} Sep 08 13:16:43.582447 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.582379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"d65868f21f02702a8ee57e1048429807","Type":"ContainerStarted","Data":"51b8bc0cec115e559fa41fda367e6d657f349ed03adaee0195c95be44b43a8f2"} Sep 08 13:16:43.598135 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:43.598087 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" podStartSLOduration=21.59807396 podStartE2EDuration="21.59807396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:43.597944292 +0000 UTC m=+23.637040869" watchObservedRunningTime="2026-09-08 13:16:43.59807396 +0000 UTC m=+23.637170537" Sep 08 13:16:44.473933 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.473854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:44.473933 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.473854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:44.474143 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:44.473996 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:44.474143 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:44.474056 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:44.587017 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.586971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" event={"ID":"c9d65c5c-54bb-4e12-b239-3252d586c4ee","Type":"ContainerStarted","Data":"8d54c4258a6fbf8d303b308c914408797f3b07d2da28cc445e1b2eac97ca071c"} Sep 08 13:16:44.588751 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.588721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" event={"ID":"f022263899a55b4e99919ae6d5833641","Type":"ContainerStarted","Data":"74fb67855a0f2d1565dfe33bc3541842504c059a6a6fcb446ebc92134be27354"} Sep 08 13:16:44.592242 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.592223 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:16:44.592701 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.592673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"6a3d2798050b8721abf2f8016882a3591f5cb09cd673efd6d8864060b8160475"} Sep 08 13:16:44.608502 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.608448 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jmgr" podStartSLOduration=2.562883141 podStartE2EDuration="23.608430133s" totalImagesPullingTime="21.045546992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:44.605298391 +0000 UTC m=+24.644394965" watchObservedRunningTime="2026-09-08 13:16:44.608430133 +0000 UTC m=+24.647526709" Sep 08 13:16:44.619698 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:44.619663 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" podStartSLOduration=22.619649726 podStartE2EDuration="22.619649726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:44.619328592 +0000 UTC m=+24.658425158" watchObservedRunningTime="2026-09-08 13:16:44.619649726 +0000 UTC m=+24.658746302" Sep 08 13:16:45.474104 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:45.474068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:45.474276 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:45.474181 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:46.474220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.473364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:46.474220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.473364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:46.474220 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:46.473486 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:46.474220 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:46.473595 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:46.599295 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.599264 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="49a86f00fbb8d40d039740eff49eeea10ee72f84b15fea3ecd0d6d9a5d9d6f9f" exitCode=0 Sep 08 13:16:46.599453 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.599356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"49a86f00fbb8d40d039740eff49eeea10ee72f84b15fea3ecd0d6d9a5d9d6f9f"} Sep 08 13:16:46.606149 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.605974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:16:46.606596 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.606562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"3dfb2db594d9a0b51c96d05cdfd06b1b05bda86fb1c406fa8bbb3c727d409490"} Sep 08 13:16:46.606842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.606800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:46.606993 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.606976 2564 scope.go:117] "RemoveContainer" containerID="e5bee3f543fb1c1455152825e9d83ab3ef2a81517b66aaf75e6a28739af50672" Sep 08 13:16:46.622731 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:46.622715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:47.474137 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.474108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:47.474266 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:47.474241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:47.612089 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.612054 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="e8e7a9885dcc51a6316a5172d2ce96e301f3b307fe6ff0e1c950254c78fa3440" exitCode=0 Sep 08 13:16:47.612198 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.612165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"e8e7a9885dcc51a6316a5172d2ce96e301f3b307fe6ff0e1c950254c78fa3440"} Sep 08 13:16:47.620602 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.618277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:16:47.620713 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.620620 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" event={"ID":"9df611de-523f-40d6-bf4f-df1b92c97f0a","Type":"ContainerStarted","Data":"2c1070e78815cbfc3baaf2045519f203013d75a8634f1c6f5716d69f6df9af99"} Sep 08 13:16:47.620883 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.620848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:47.620963 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.620939 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:47.639713 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.639683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:16:47.660909 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:47.660853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" podStartSLOduration=7.359678135 podStartE2EDuration="26.660836242s" totalImagesPullingTime="19.301158107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:47.659474598 +0000 UTC m=+27.698571174" watchObservedRunningTime="2026-09-08 13:16:47.660836242 +0000 UTC m=+27.699932818" Sep 08 13:16:48.418492 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.418464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8s4x"] Sep 08 13:16:48.418634 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.418591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:48.418698 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:48.418675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:48.420948 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.420924 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvgrg"] Sep 08 13:16:48.421056 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.421007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:48.421100 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:48.421086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:48.426713 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.426657 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2lqn"] Sep 08 13:16:48.426813 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.426742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:48.426935 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:48.426815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:48.628090 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.628059 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="9a7a1f1a80d88575a16d549266d5f4a1418ac4b70a6fd848f28bd2f2b5010dcb" exitCode=0 Sep 08 13:16:48.628893 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:48.628146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"9a7a1f1a80d88575a16d549266d5f4a1418ac4b70a6fd848f28bd2f2b5010dcb"} Sep 08 13:16:50.475452 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:50.475157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:50.475853 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:50.475239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:50.475853 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:50.475507 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:50.475853 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:50.475598 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:50.475853 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:50.475282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:50.475853 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:50.475693 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:52.476826 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:52.476799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:52.477176 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:52.476895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:52.477176 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:52.476902 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:16:52.477176 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:52.476919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:52.477176 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:52.476991 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8s4x" podUID="79e40337-b49a-4e31-acb9-c5f3ec741ee7" Sep 08 13:16:52.477176 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:52.477056 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgrg" podUID="cc050c15-aeaf-4499-934d-8c32c0f324f0" Sep 08 13:16:53.153610 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:53.153580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:53.153744 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:53.153628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:53.153744 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.153733 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:53.153744 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.153735 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:53.153843 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.153782 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:25.153769799 +0000 UTC m=+65.192866353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:16:53.153843 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.153795 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret podName:cc050c15-aeaf-4499-934d-8c32c0f324f0 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:25.153788843 +0000 UTC m=+65.192885397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret") pod "global-pull-secret-syncer-rvgrg" (UID: "cc050c15-aeaf-4499-934d-8c32c0f324f0") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:16:53.254237 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:53.254212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:53.254340 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.254320 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:16:53.254340 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.254335 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:16:53.254420 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.254344 2564 projected.go:196] Error preparing data for projected volume kube-api-access-czhlq for pod openshift-network-diagnostics/network-check-target-p8s4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:53.254420 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:53.254389 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq podName:79e40337-b49a-4e31-acb9-c5f3ec741ee7 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:25.25437588 +0000 UTC m=+65.293472440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czhlq" (UniqueName: "kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq") pod "network-check-target-p8s4x" (UID: "79e40337-b49a-4e31-acb9-c5f3ec741ee7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:16:53.642141 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:53.642070 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="6e68dced1460b5a5c00d65203b1f2ef57bf2e942da5f18ecdfe631d7a23ce076" exitCode=0 Sep 08 13:16:53.642141 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:53.642109 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"6e68dced1460b5a5c00d65203b1f2ef57bf2e942da5f18ecdfe631d7a23ce076"} Sep 08 13:16:54.244204 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.244176 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeReady" Sep 08 13:16:54.244359 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.244297 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 13:16:54.290187 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.290162 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6tqtf"] Sep 08 13:16:54.317651 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.317622 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9nqvj"] Sep 08 13:16:54.317795 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.317775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.321796 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.321774 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 13:16:54.321898 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.321839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 13:16:54.321898 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.321872 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwlvq\"" Sep 08 13:16:54.333377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.333355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tqtf"] Sep 08 13:16:54.333616 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.333392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nqvj"] Sep 08 13:16:54.333616 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.333475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.339513 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.339496 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t98tn\"" Sep 08 13:16:54.339796 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.339779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 13:16:54.339947 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.339932 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 13:16:54.340022 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.339978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 13:16:54.461120 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131718e9-02ae-48a0-80fb-9fdcabc9a211-cert\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.461244 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7l44\" (UniqueName: \"kubernetes.io/projected/131718e9-02ae-48a0-80fb-9fdcabc9a211-kube-api-access-f7l44\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.461244 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gwwv\" (UniqueName: \"kubernetes.io/projected/50bb7cc5-31df-4e79-b1f5-0087136c79a4-kube-api-access-7gwwv\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.461244 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bb7cc5-31df-4e79-b1f5-0087136c79a4-config-volume\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.461379 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.461379 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.461293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bb7cc5-31df-4e79-b1f5-0087136c79a4-tmp-dir\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.477186 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.477163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:16:54.477313 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.477299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:16:54.477357 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.477321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:16:54.480195 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480169 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 13:16:54.480195 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 13:16:54.480382 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480332 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 13:16:54.480382 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g794g\"" Sep 08 13:16:54.480382 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mxg9n\"" Sep 08 13:16:54.480516 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.480392 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 13:16:54.562085 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.562205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bb7cc5-31df-4e79-b1f5-0087136c79a4-tmp-dir\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.562205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131718e9-02ae-48a0-80fb-9fdcabc9a211-cert\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.562205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l44\" (UniqueName: \"kubernetes.io/projected/131718e9-02ae-48a0-80fb-9fdcabc9a211-kube-api-access-f7l44\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.562205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gwwv\" (UniqueName: \"kubernetes.io/projected/50bb7cc5-31df-4e79-b1f5-0087136c79a4-kube-api-access-7gwwv\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.562372 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:54.562205 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:16:54.562372 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bb7cc5-31df-4e79-b1f5-0087136c79a4-config-volume\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.562372 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:54.562268 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:55.062249015 +0000 UTC m=+35.101345569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:16:54.562510 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bb7cc5-31df-4e79-b1f5-0087136c79a4-tmp-dir\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.562749 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.562721 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bb7cc5-31df-4e79-b1f5-0087136c79a4-config-volume\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.566084 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.566068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/131718e9-02ae-48a0-80fb-9fdcabc9a211-cert\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.571053 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.571033 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gwwv\" (UniqueName: \"kubernetes.io/projected/50bb7cc5-31df-4e79-b1f5-0087136c79a4-kube-api-access-7gwwv\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:54.571185 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.571168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l44\" (UniqueName: \"kubernetes.io/projected/131718e9-02ae-48a0-80fb-9fdcabc9a211-kube-api-access-f7l44\") pod \"ingress-canary-9nqvj\" (UID: \"131718e9-02ae-48a0-80fb-9fdcabc9a211\") " pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.641742 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.641724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nqvj" Sep 08 13:16:54.647533 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.647510 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbe6f66f-652f-477d-a01d-04a47b11b2a3" containerID="4370848eb697f49da15d4502ed83c3ebf762a8726f2ade3c2bc31639ed1aac90" exitCode=0 Sep 08 13:16:54.647827 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.647541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerDied","Data":"4370848eb697f49da15d4502ed83c3ebf762a8726f2ade3c2bc31639ed1aac90"} Sep 08 13:16:54.957697 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:54.957467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nqvj"] Sep 08 13:16:54.960760 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:16:54.960736 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131718e9_02ae_48a0_80fb_9fdcabc9a211.slice/crio-10a193eedbc2f1dbc4d7278ec5874c4610f08197a60c11a4cc3ae579f7e295ad WatchSource:0}: Error finding container 10a193eedbc2f1dbc4d7278ec5874c4610f08197a60c11a4cc3ae579f7e295ad: Status 404 returned error can't find the container with id 10a193eedbc2f1dbc4d7278ec5874c4610f08197a60c11a4cc3ae579f7e295ad Sep 08 13:16:55.066207 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:55.066180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:55.066349 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:55.066286 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:16:55.066349 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:55.066335 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:56.066321945 +0000 UTC m=+36.105418503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:16:55.653972 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:55.653934 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" event={"ID":"fbe6f66f-652f-477d-a01d-04a47b11b2a3","Type":"ContainerStarted","Data":"7cbdb13576e2ebecf6563b4cbf1a5cee4b62c4b2e3371caecdc01d22e407401e"} Sep 08 13:16:55.655183 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:55.655159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nqvj" event={"ID":"131718e9-02ae-48a0-80fb-9fdcabc9a211","Type":"ContainerStarted","Data":"10a193eedbc2f1dbc4d7278ec5874c4610f08197a60c11a4cc3ae579f7e295ad"} Sep 08 13:16:55.678992 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:55.678940 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5rvzc" podStartSLOduration=6.139621538 podStartE2EDuration="34.678919141s" totalImagesPullingTime="28.539297603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.677688283 +0000 UTC m=+35.716784873" watchObservedRunningTime="2026-09-08 13:16:55.678919141 +0000 UTC m=+35.718015708" Sep 08 13:16:56.075252 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:56.075207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:56.075433 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:56.075349 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:16:56.075433 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:56.075417 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:58.075397571 +0000 UTC m=+38.114494149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:16:57.662248 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:57.662011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nqvj" event={"ID":"131718e9-02ae-48a0-80fb-9fdcabc9a211","Type":"ContainerStarted","Data":"7be1b7591f4c7468aee94ba9abe0ee88a61068451ecf216ac3b8b87814fdc4e9"} Sep 08 13:16:57.680318 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:57.680267 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9nqvj" podStartSLOduration=1.242748118 podStartE2EDuration="3.680252499s" totalImagesPullingTime="2.437504381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:57.679658285 +0000 UTC m=+37.718754895" watchObservedRunningTime="2026-09-08 13:16:57.680252499 +0000 UTC m=+37.719349100" Sep 08 13:16:58.088790 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:16:58.088756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:16:58.088935 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:58.088871 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:16:58.088935 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:16:58.088921 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:02.088908263 +0000 UTC m=+42.128004817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:17:00.749762 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.749728 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v"] Sep 08 13:17:00.783994 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.783962 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt"] Sep 08 13:17:00.784133 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.784073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:00.786879 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.786855 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 13:17:00.787000 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.786860 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 13:17:00.787000 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.786907 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 13:17:00.787834 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.787815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sjfss\"" Sep 08 13:17:00.787931 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.787843 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 08 13:17:00.797931 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.797910 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv"] Sep 08 13:17:00.798036 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.798022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:00.801102 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.801085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 08 13:17:00.812016 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.811998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v"] Sep 08 13:17:00.812080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.812023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt"] Sep 08 13:17:00.812080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.812043 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv"] Sep 08 13:17:00.812173 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.812096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.814998 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.814976 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 08 13:17:00.815084 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.815003 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 08 13:17:00.815084 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.815045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 08 13:17:00.815084 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.815073 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 08 13:17:00.906856 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:00.906856 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c15364-16bb-46fe-a025-57d5a24b5391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f6gw\" (UniqueName: \"kubernetes.io/projected/d6c15364-16bb-46fe-a025-57d5a24b5391-kube-api-access-7f6gw\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ad6b67-f9a0-48d4-966e-b9ade84c6042-tmp\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.906987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ad6b67-f9a0-48d4-966e-b9ade84c6042-klusterlet-config\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:00.907039 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.907036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907251 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.907059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:00.907251 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.907112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcfw\" (UniqueName: \"kubernetes.io/projected/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-kube-api-access-8bcfw\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:00.907251 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:00.907131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm64q\" (UniqueName: \"kubernetes.io/projected/82ad6b67-f9a0-48d4-966e-b9ade84c6042-kube-api-access-hm64q\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.007862 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.007862 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.007862 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f6gw\" (UniqueName: \"kubernetes.io/projected/d6c15364-16bb-46fe-a025-57d5a24b5391-kube-api-access-7f6gw\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ad6b67-f9a0-48d4-966e-b9ade84c6042-tmp\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ad6b67-f9a0-48d4-966e-b9ade84c6042-klusterlet-config\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.007982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcfw\" (UniqueName: \"kubernetes.io/projected/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-kube-api-access-8bcfw\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm64q\" (UniqueName: \"kubernetes.io/projected/82ad6b67-f9a0-48d4-966e-b9ade84c6042-kube-api-access-hm64q\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.008099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:01.008431 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c15364-16bb-46fe-a025-57d5a24b5391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.008855 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008836 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ad6b67-f9a0-48d4-966e-b9ade84c6042-tmp\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.009009 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.008984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6c15364-16bb-46fe-a025-57d5a24b5391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.011547 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.011525 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ad6b67-f9a0-48d4-966e-b9ade84c6042-klusterlet-config\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.011680 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.011528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.011680 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.011633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.011835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.011687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.011835 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.011694 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:01.012025 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.012007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6c15364-16bb-46fe-a025-57d5a24b5391-ca\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.016080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.016056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcfw\" (UniqueName: \"kubernetes.io/projected/8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6-kube-api-access-8bcfw\") pod \"managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v\" (UID: \"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:01.016243 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.016225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f6gw\" (UniqueName: \"kubernetes.io/projected/d6c15364-16bb-46fe-a025-57d5a24b5391-kube-api-access-7f6gw\") pod \"cluster-proxy-proxy-agent-55bfc4bd98-9gsqv\" (UID: \"d6c15364-16bb-46fe-a025-57d5a24b5391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.016338 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.016316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm64q\" (UniqueName: \"kubernetes.io/projected/82ad6b67-f9a0-48d4-966e-b9ade84c6042-kube-api-access-hm64q\") pod \"klusterlet-addon-workmgr-7469db77f7-lhwdt\" (UID: \"82ad6b67-f9a0-48d4-966e-b9ade84c6042\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.107165 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.107133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" Sep 08 13:17:01.113460 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.113434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:01.119577 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.119550 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:17:01.420425 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.420393 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v"] Sep 08 13:17:01.424851 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:17:01.424828 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f5ae3e1_7a2d_4b4f_a357_24e185de3bc6.slice/crio-ec946ef3825bb8ee19e69af2d61cece6f65eebb093cd7c7549790bbf2063777d WatchSource:0}: Error finding container ec946ef3825bb8ee19e69af2d61cece6f65eebb093cd7c7549790bbf2063777d: Status 404 returned error can't find the container with id ec946ef3825bb8ee19e69af2d61cece6f65eebb093cd7c7549790bbf2063777d Sep 08 13:17:01.453377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.453348 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt"] Sep 08 13:17:01.456209 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:17:01.456182 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad6b67_f9a0_48d4_966e_b9ade84c6042.slice/crio-60e2f61e12e514bed412553dfc06991f8446c046b1ce708e25196ec11d678c1a WatchSource:0}: Error finding container 60e2f61e12e514bed412553dfc06991f8446c046b1ce708e25196ec11d678c1a: Status 404 returned error can't find the container with id 60e2f61e12e514bed412553dfc06991f8446c046b1ce708e25196ec11d678c1a Sep 08 13:17:01.493024 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.492995 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv"] Sep 08 13:17:01.495994 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:17:01.495971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6c15364_16bb_46fe_a025_57d5a24b5391.slice/crio-5da144cd454f0d12f0ca3ff4ea29f4bf0611a20537f783f2e3a1767ebe156776 WatchSource:0}: Error finding container 5da144cd454f0d12f0ca3ff4ea29f4bf0611a20537f783f2e3a1767ebe156776: Status 404 returned error can't find the container with id 5da144cd454f0d12f0ca3ff4ea29f4bf0611a20537f783f2e3a1767ebe156776 Sep 08 13:17:01.672188 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.672101 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerStarted","Data":"5da144cd454f0d12f0ca3ff4ea29f4bf0611a20537f783f2e3a1767ebe156776"} Sep 08 13:17:01.673208 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.673184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" event={"ID":"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6","Type":"ContainerStarted","Data":"ec946ef3825bb8ee19e69af2d61cece6f65eebb093cd7c7549790bbf2063777d"} Sep 08 13:17:01.674273 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:01.674255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" event={"ID":"82ad6b67-f9a0-48d4-966e-b9ade84c6042","Type":"ContainerStarted","Data":"60e2f61e12e514bed412553dfc06991f8446c046b1ce708e25196ec11d678c1a"} Sep 08 13:17:02.118483 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:02.118319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:17:02.119028 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:02.118483 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:02.119028 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:02.118597 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:10.118562573 +0000 UTC m=+50.157672847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:17:09.699365 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.699328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerStarted","Data":"72d62b67d57d1623b2735e697c364c6e0d2bc74c18f267d142db8156f56b7c4b"} Sep 08 13:17:09.699828 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.699375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerStarted","Data":"6148da08482335a9b2ae4d5dd2fe7d81ccba2c3f4aebec2b68b18d34b2170cc5"} Sep 08 13:17:09.699828 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.699392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerStarted","Data":"32748ab951bb9f11f6e23a242e82de22b66899faf3dc548e53bd85db9c7ea9e4"} Sep 08 13:17:09.700824 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.700797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" event={"ID":"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6","Type":"ContainerStarted","Data":"a4388bc71768e4937560042c549af3f42c7f733e351dcc764c500397355a6e49"} Sep 08 13:17:09.702150 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.702130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" event={"ID":"82ad6b67-f9a0-48d4-966e-b9ade84c6042","Type":"ContainerStarted","Data":"2d2abe0d7f0ae80ee5b4ee6da68ac7a930837c967a7aff45cdefdb099e5e0507"} Sep 08 13:17:09.702243 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.702198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:09.703983 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.703966 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:17:09.722203 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.722167 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" podStartSLOduration=2.532701581 podStartE2EDuration="9.722156122s" totalImagesPullingTime="7.189454541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:09.721025542 +0000 UTC m=+49.760122118" watchObservedRunningTime="2026-09-08 13:17:09.722156122 +0000 UTC m=+49.761252712" Sep 08 13:17:09.756055 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.756023 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" podStartSLOduration=2.495423499 podStartE2EDuration="9.756010785s" totalImagesPullingTime="7.260587286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:09.755416361 +0000 UTC m=+49.794512936" watchObservedRunningTime="2026-09-08 13:17:09.756010785 +0000 UTC m=+49.795107360" Sep 08 13:17:09.756133 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:09.756081 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" podStartSLOduration=2.511404922 podStartE2EDuration="9.75607714s" totalImagesPullingTime="7.244672218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:09.738629312 +0000 UTC m=+49.777725910" watchObservedRunningTime="2026-09-08 13:17:09.75607714 +0000 UTC m=+49.795173716" Sep 08 13:17:10.180542 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:10.180497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:17:10.180758 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:10.180695 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:10.180832 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:10.180777 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:26.180755244 +0000 UTC m=+66.219851815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:17:19.640287 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:19.640260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mdfg" Sep 08 13:17:25.188353 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.188310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:17:25.188742 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.188406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:17:25.191694 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.191675 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 13:17:25.191750 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.191691 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 13:17:25.199023 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:25.199000 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 13:17:25.199114 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:25.199052 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:18:29.199035048 +0000 UTC m=+129.238131603 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : secret "metrics-daemon-secret" not found Sep 08 13:17:25.201024 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.201003 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc050c15-aeaf-4499-934d-8c32c0f324f0-original-pull-secret\") pod \"global-pull-secret-syncer-rvgrg\" (UID: \"cc050c15-aeaf-4499-934d-8c32c0f324f0\") " pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:17:25.288934 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.288910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:17:25.291853 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.291836 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 13:17:25.302687 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.302668 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 13:17:25.313403 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.313373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czhlq\" (UniqueName: \"kubernetes.io/projected/79e40337-b49a-4e31-acb9-c5f3ec741ee7-kube-api-access-czhlq\") pod \"network-check-target-p8s4x\" (UID: \"79e40337-b49a-4e31-acb9-c5f3ec741ee7\") " pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:17:25.386852 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.386821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgrg" Sep 08 13:17:25.394280 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.394260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g794g\"" Sep 08 13:17:25.401641 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.401625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:17:25.659065 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.659018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvgrg"] Sep 08 13:17:25.663387 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:17:25.663360 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc050c15_aeaf_4499_934d_8c32c0f324f0.slice/crio-52761193db32c53038437e8445759101549c2608e5ceab997bf51b3efef6053a WatchSource:0}: Error finding container 52761193db32c53038437e8445759101549c2608e5ceab997bf51b3efef6053a: Status 404 returned error can't find the container with id 52761193db32c53038437e8445759101549c2608e5ceab997bf51b3efef6053a Sep 08 13:17:25.679701 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.679677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8s4x"] Sep 08 13:17:25.682464 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:17:25.682442 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e40337_b49a_4e31_acb9_c5f3ec741ee7.slice/crio-79ccf82d4bef7b2d6a3a64cf4c00efb002a2024597e118ce0ff2538a41961ea2 WatchSource:0}: Error finding container 79ccf82d4bef7b2d6a3a64cf4c00efb002a2024597e118ce0ff2538a41961ea2: Status 404 returned error can't find the container with id 79ccf82d4bef7b2d6a3a64cf4c00efb002a2024597e118ce0ff2538a41961ea2 Sep 08 13:17:25.751281 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.751251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8s4x" event={"ID":"79e40337-b49a-4e31-acb9-c5f3ec741ee7","Type":"ContainerStarted","Data":"79ccf82d4bef7b2d6a3a64cf4c00efb002a2024597e118ce0ff2538a41961ea2"} Sep 08 13:17:25.752366 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:25.752346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvgrg" event={"ID":"cc050c15-aeaf-4499-934d-8c32c0f324f0","Type":"ContainerStarted","Data":"52761193db32c53038437e8445759101549c2608e5ceab997bf51b3efef6053a"} Sep 08 13:17:26.194373 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:26.194290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:17:26.194736 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:26.194406 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:26.194736 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:26.194463 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:58.194446657 +0000 UTC m=+98.233543211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:17:29.767326 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:29.767294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8s4x" event={"ID":"79e40337-b49a-4e31-acb9-c5f3ec741ee7","Type":"ContainerStarted","Data":"37cdd26a03df8015730af1b1c2be45b875da023112c3eeef77b082ef8a986990"} Sep 08 13:17:29.767778 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:29.767419 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:17:29.785983 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:29.785937 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p8s4x" podStartSLOduration=65.684073274 podStartE2EDuration="1m8.785919113s" totalImagesPullingTime="3.101845839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:29.784537391 +0000 UTC m=+69.823633990" watchObservedRunningTime="2026-09-08 13:17:29.785919113 +0000 UTC m=+69.825015690" Sep 08 13:17:30.772915 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:30.772881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvgrg" event={"ID":"cc050c15-aeaf-4499-934d-8c32c0f324f0","Type":"ContainerStarted","Data":"60411c56cc5208182e0f1fa66b9910120938b5bfd0c6eee11819bda3bf0c657d"} Sep 08 13:17:30.791490 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:30.791434 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rvgrg" podStartSLOduration=64.7854078 podStartE2EDuration="1m9.791413915s" totalImagesPullingTime="5.006006115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:30.79061766 +0000 UTC m=+70.829714255" watchObservedRunningTime="2026-09-08 13:17:30.791413915 +0000 UTC m=+70.830510491" Sep 08 13:17:58.200812 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:17:58.200695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:17:58.201214 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:58.200875 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:58.201214 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:17:58.200956 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:02.200938464 +0000 UTC m=+162.240035024 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:18:00.775201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:00.775169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p8s4x" Sep 08 13:18:29.209790 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:29.209731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:18:29.210287 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:29.209891 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 13:18:29.210287 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:29.209961 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs podName:99a3fb34-38a0-4789-a65c-5c93c8f2f785 nodeName:}" failed. No retries permitted until 2026-09-08 13:20:31.20994597 +0000 UTC m=+251.249042528 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs") pod "network-metrics-daemon-j2lqn" (UID: "99a3fb34-38a0-4789-a65c-5c93c8f2f785") : secret "metrics-daemon-secret" not found Sep 08 13:18:57.326414 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.326366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6tqtf" podUID="50bb7cc5-31df-4e79-b1f5-0087136c79a4" Sep 08 13:18:57.496608 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.496558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-j2lqn" podUID="99a3fb34-38a0-4789-a65c-5c93c8f2f785" Sep 08 13:18:57.670356 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.670283 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rf7hh"] Sep 08 13:18:57.673349 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.673327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.676099 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.676080 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpczc\"" Sep 08 13:18:57.676192 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.676098 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 13:18:57.677038 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.677019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 13:18:57.677106 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.677044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 13:18:57.677106 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.677058 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 13:18:57.685635 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.685610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rf7hh"] Sep 08 13:18:57.811423 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.811393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.811560 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.811501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.811560 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.811525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbj56\" (UniqueName: \"kubernetes.io/projected/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-api-access-wbj56\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.811560 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.811550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f984c4-1231-4ecc-8583-6c2703df407e-data-volume\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.811712 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.811586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f984c4-1231-4ecc-8583-6c2703df407e-crio-socket\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912364 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912364 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbj56\" (UniqueName: \"kubernetes.io/projected/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-api-access-wbj56\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912558 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f984c4-1231-4ecc-8583-6c2703df407e-data-volume\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912558 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f984c4-1231-4ecc-8583-6c2703df407e-crio-socket\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912558 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912558 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.912536 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:18:57.912821 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.912640 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:18:58.412621145 +0000 UTC m=+158.451717702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : configmap "kube-rbac-proxy" not found Sep 08 13:18:57.912821 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.912643 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:18:57.912821 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:57.912706 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:18:58.41269017 +0000 UTC m=+158.451786730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:18:57.912821 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f984c4-1231-4ecc-8583-6c2703df407e-crio-socket\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.912821 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.912754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f984c4-1231-4ecc-8583-6c2703df407e-data-volume\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:57.922983 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:57.922940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbj56\" (UniqueName: \"kubernetes.io/projected/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-api-access-wbj56\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:58.020333 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:58.020298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:18:58.415668 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:58.415632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:58.415668 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:58.415673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:58.416073 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:58.415753 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:18:58.416073 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:58.415773 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:18:58.416073 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:58.415819 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:18:59.41580301 +0000 UTC m=+159.454899584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : configmap "kube-rbac-proxy" not found Sep 08 13:18:58.416073 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:58.415836 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:18:59.415826992 +0000 UTC m=+159.454923545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:18:59.422224 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:59.422176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:59.422717 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:59.422269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:18:59.422717 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:59.422333 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:18:59.422717 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:59.422345 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:18:59.422717 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:59.422385 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:01.422370163 +0000 UTC m=+161.461466717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : configmap "kube-rbac-proxy" not found Sep 08 13:18:59.422717 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:18:59.422433 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:01.422413124 +0000 UTC m=+161.461509694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:18:59.842811 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:18:59.842780 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfjng_81d11a11-8353-4a7c-a0c6-6bd486a5a3b2/dns-node-resolver/0.log" Sep 08 13:19:00.638556 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:00.638528 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jr2dx_c5ce15f1-4852-4b48-b87e-51fbfe76bbe9/node-ca/0.log" Sep 08 13:19:01.435246 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:01.435204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:01.435246 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:01.435254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:01.435513 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:01.435335 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:01.435513 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:01.435386 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:01.435513 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:01.435408 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:05.43539108 +0000 UTC m=+165.474487646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : configmap "kube-rbac-proxy" not found Sep 08 13:19:01.435513 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:01.435482 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:05.435464068 +0000 UTC m=+165.474560638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:01.440652 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:01.440627 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nqvj_131718e9-02ae-48a0-80fb-9fdcabc9a211/serve-healthcheck-canary/0.log" Sep 08 13:19:02.244008 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:02.243969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:19:02.244394 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:02.244100 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:19:02.244394 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:02.244151 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls podName:50bb7cc5-31df-4e79-b1f5-0087136c79a4 nodeName:}" failed. No retries permitted until 2026-09-08 13:21:04.244138479 +0000 UTC m=+284.283235033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls") pod "dns-default-6tqtf" (UID: "50bb7cc5-31df-4e79-b1f5-0087136c79a4") : secret "dns-default-metrics-tls" not found Sep 08 13:19:05.463785 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:05.463754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:05.464150 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:05.463792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:05.464150 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:05.463882 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:05.464150 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:05.463905 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:05.464150 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:05.463949 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:13.463932374 +0000 UTC m=+173.503028929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : configmap "kube-rbac-proxy" not found Sep 08 13:19:05.464150 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:05.463966 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:13.4639582 +0000 UTC m=+173.503054753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:09.051079 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.051045 2564 generic.go:356] "Generic (PLEG): container finished" podID="82ad6b67-f9a0-48d4-966e-b9ade84c6042" containerID="2d2abe0d7f0ae80ee5b4ee6da68ac7a930837c967a7aff45cdefdb099e5e0507" exitCode=1 Sep 08 13:19:09.051492 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.051119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" event={"ID":"82ad6b67-f9a0-48d4-966e-b9ade84c6042","Type":"ContainerDied","Data":"2d2abe0d7f0ae80ee5b4ee6da68ac7a930837c967a7aff45cdefdb099e5e0507"} Sep 08 13:19:09.051492 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.051480 2564 scope.go:117] "RemoveContainer" containerID="2d2abe0d7f0ae80ee5b4ee6da68ac7a930837c967a7aff45cdefdb099e5e0507" Sep 08 13:19:09.052692 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.052668 2564 generic.go:356] "Generic (PLEG): container finished" podID="8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6" containerID="a4388bc71768e4937560042c549af3f42c7f733e351dcc764c500397355a6e49" exitCode=255 Sep 08 13:19:09.052810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.052700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" event={"ID":"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6","Type":"ContainerDied","Data":"a4388bc71768e4937560042c549af3f42c7f733e351dcc764c500397355a6e49"} Sep 08 13:19:09.052934 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.052921 2564 scope.go:117] "RemoveContainer" containerID="a4388bc71768e4937560042c549af3f42c7f733e351dcc764c500397355a6e49" Sep 08 13:19:09.703092 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:09.703048 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:19:10.057622 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:10.057544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f9cf7c8b-p9j4v" event={"ID":"8f5ae3e1-7a2d-4b4f-a357-24e185de3bc6","Type":"ContainerStarted","Data":"7dece78bef61234e67834a44dac638d2da24a4d49368549ea153b4056bd32d17"} Sep 08 13:19:10.059467 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:10.059443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" event={"ID":"82ad6b67-f9a0-48d4-966e-b9ade84c6042","Type":"ContainerStarted","Data":"6d1e6dd627274f6f11355e116009b4965fc8311dfd1a44faad286a437bfb7226"} Sep 08 13:19:10.059671 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:10.059657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:19:10.060289 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:10.060271 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7469db77f7-lhwdt" Sep 08 13:19:10.474968 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:10.474880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:19:13.521695 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:13.521599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:13.521695 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:13.521649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:13.522090 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:13.521762 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:13.522090 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:13.521816 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls podName:c8f984c4-1231-4ecc-8583-6c2703df407e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:29.521802033 +0000 UTC m=+189.560898586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rf7hh" (UID: "c8f984c4-1231-4ecc-8583-6c2703df407e") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:13.522167 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:13.522103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f984c4-1231-4ecc-8583-6c2703df407e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:29.534496 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:29.534443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:29.536712 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:29.536690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f984c4-1231-4ecc-8583-6c2703df407e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rf7hh\" (UID: \"c8f984c4-1231-4ecc-8583-6c2703df407e\") " pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:29.784309 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:29.784279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpczc\"" Sep 08 13:19:29.792693 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:29.792643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rf7hh" Sep 08 13:19:30.069888 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:30.069810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rf7hh"] Sep 08 13:19:30.073352 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:19:30.073306 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f984c4_1231_4ecc_8583_6c2703df407e.slice/crio-f5af3f949255d279a720d5f75e9798161c0d3db8a887b3a2692d7a6374e4523c WatchSource:0}: Error finding container f5af3f949255d279a720d5f75e9798161c0d3db8a887b3a2692d7a6374e4523c: Status 404 returned error can't find the container with id f5af3f949255d279a720d5f75e9798161c0d3db8a887b3a2692d7a6374e4523c Sep 08 13:19:30.119317 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:30.119286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rf7hh" event={"ID":"c8f984c4-1231-4ecc-8583-6c2703df407e","Type":"ContainerStarted","Data":"f5af3f949255d279a720d5f75e9798161c0d3db8a887b3a2692d7a6374e4523c"} Sep 08 13:19:31.120841 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:31.120792 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" podUID="d6c15364-16bb-46fe-a025-57d5a24b5391" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 13:19:31.123838 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:31.123811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rf7hh" event={"ID":"c8f984c4-1231-4ecc-8583-6c2703df407e","Type":"ContainerStarted","Data":"29e27b3edd7e01adfab93b8c2082aa89a2ce27453b57fea8daf1ba4dee202de4"} Sep 08 13:19:35.137749 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:35.137671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rf7hh" event={"ID":"c8f984c4-1231-4ecc-8583-6c2703df407e","Type":"ContainerStarted","Data":"fda8431f255da5c7096bac0ab46aba590f5d1069f7245f995102e104b6fd476f"} Sep 08 13:19:38.149682 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:38.149648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rf7hh" event={"ID":"c8f984c4-1231-4ecc-8583-6c2703df407e","Type":"ContainerStarted","Data":"4ef4030f82b53880ecce9efd9ca08a0844d9dc709286bcf63f886acec668ea9e"} Sep 08 13:19:38.172815 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:38.172771 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rf7hh" podStartSLOduration=34.018849889 podStartE2EDuration="41.172756559s" totalImagesPullingTime="7.15390667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:18:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:38.170946693 +0000 UTC m=+198.210043301" watchObservedRunningTime="2026-09-08 13:19:38.172756559 +0000 UTC m=+198.211853135" Sep 08 13:19:41.120977 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.120937 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" podUID="d6c15364-16bb-46fe-a025-57d5a24b5391" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 13:19:41.292105 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.292074 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rbdg8"] Sep 08 13:19:41.295160 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.295144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.297745 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.297713 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4t6zk\"" Sep 08 13:19:41.297851 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.297764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 13:19:41.297851 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.297828 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 13:19:41.298284 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.298267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 13:19:41.298772 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.298744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 13:19:41.298905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.298752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 13:19:41.298905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.298802 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 13:19:41.313527 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313649 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-wtmp\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313649 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313753 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313753 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxsns\" (UniqueName: \"kubernetes.io/projected/f189c6b2-06d8-4d67-b506-d428d99563c5-kube-api-access-sxsns\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313753 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-root\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313864 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-sys\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313864 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-metrics-client-ca\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.313864 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.313841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-textfile\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414277 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-sys\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414277 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-metrics-client-ca\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414277 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-textfile\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414313 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-sys\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-wtmp\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxsns\" (UniqueName: \"kubernetes.io/projected/f189c6b2-06d8-4d67-b506-d428d99563c5-kube-api-access-sxsns\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-root\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-wtmp\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414666 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-textfile\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414953 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:41.414843 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 08 13:19:41.414953 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f189c6b2-06d8-4d67-b506-d428d99563c5-root\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414953 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:19:41.414911 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls podName:f189c6b2-06d8-4d67-b506-d428d99563c5 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:41.914891004 +0000 UTC m=+201.953987575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls") pod "node-exporter-rbdg8" (UID: "f189c6b2-06d8-4d67-b506-d428d99563c5") : secret "node-exporter-tls" not found Sep 08 13:19:41.414953 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-metrics-client-ca\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.414953 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.414924 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.416894 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.416873 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.426206 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.424979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxsns\" (UniqueName: \"kubernetes.io/projected/f189c6b2-06d8-4d67-b506-d428d99563c5-kube-api-access-sxsns\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.917927 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.917890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:41.920137 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:41.920116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f189c6b2-06d8-4d67-b506-d428d99563c5-node-exporter-tls\") pod \"node-exporter-rbdg8\" (UID: \"f189c6b2-06d8-4d67-b506-d428d99563c5\") " pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:42.204443 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:42.204355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbdg8" Sep 08 13:19:42.214409 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:19:42.214379 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf189c6b2_06d8_4d67_b506_d428d99563c5.slice/crio-4468ed7004ca00c30cbc743b2220685783057f4cfec9be8176d89fe3b809e65d WatchSource:0}: Error finding container 4468ed7004ca00c30cbc743b2220685783057f4cfec9be8176d89fe3b809e65d: Status 404 returned error can't find the container with id 4468ed7004ca00c30cbc743b2220685783057f4cfec9be8176d89fe3b809e65d Sep 08 13:19:43.165109 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:43.165070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbdg8" event={"ID":"f189c6b2-06d8-4d67-b506-d428d99563c5","Type":"ContainerStarted","Data":"4468ed7004ca00c30cbc743b2220685783057f4cfec9be8176d89fe3b809e65d"} Sep 08 13:19:47.180185 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.180148 2564 generic.go:356] "Generic (PLEG): container finished" podID="f189c6b2-06d8-4d67-b506-d428d99563c5" containerID="cc3033b39eb9ca15fc1a6d6778e7592ec6f4f568bd6495995f4fb8bdc8e3e4c3" exitCode=0 Sep 08 13:19:47.180681 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.180209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbdg8" event={"ID":"f189c6b2-06d8-4d67-b506-d428d99563c5","Type":"ContainerDied","Data":"cc3033b39eb9ca15fc1a6d6778e7592ec6f4f568bd6495995f4fb8bdc8e3e4c3"} Sep 08 13:19:47.551280 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.551249 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:19:47.554994 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.554975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.559872 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.559843 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 13:19:47.559987 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.559969 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 13:19:47.560066 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560010 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 13:19:47.560250 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vpnjj\"" Sep 08 13:19:47.560324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560302 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 13:19:47.560512 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 13:19:47.560512 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 13:19:47.560663 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.560518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 13:19:47.561133 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 13:19:47.561235 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 13:19:47.561298 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561268 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 13:19:47.561357 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 13:19:47.561357 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561331 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 13:19:47.561465 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-651kpgh6mmrgp\"" Sep 08 13:19:47.561810 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.561752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 13:19:47.562466 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.562433 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 13:19:47.567122 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.567103 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 13:19:47.575269 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.575248 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:19:47.660098 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660255 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660850 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660850 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.660850 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.660664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjtg\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761450 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761450 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjtg\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761732 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.761937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.761986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.762220 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.763111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.762962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.764337 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.764300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.764905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.764879 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.765165 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.765143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.765636 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.765191 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.765765 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.765641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766004 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.765984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766512 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766363 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766471 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766118 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.766806 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.766760 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.767223 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.767198 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.767504 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.767483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.767881 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.767863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.768693 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.768677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.771429 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.771408 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjtg\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg\") pod \"prometheus-k8s-0\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:47.868504 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:47.868430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:19:48.153308 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:48.153228 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:19:48.156945 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:19:48.156920 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0ddfc0_8124_4519_b439_1db3f9114bf9.slice/crio-a331e5abe6fbe25c8286327a4392c735666eba4a903002b86f2e4d4a565cfad2 WatchSource:0}: Error finding container a331e5abe6fbe25c8286327a4392c735666eba4a903002b86f2e4d4a565cfad2: Status 404 returned error can't find the container with id a331e5abe6fbe25c8286327a4392c735666eba4a903002b86f2e4d4a565cfad2 Sep 08 13:19:48.185100 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:48.185076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbdg8" event={"ID":"f189c6b2-06d8-4d67-b506-d428d99563c5","Type":"ContainerStarted","Data":"9adf8100131d7bc2166c6f941f724db40050e9470ea7dd52738f40c027c7930d"} Sep 08 13:19:48.185400 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:48.185129 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbdg8" event={"ID":"f189c6b2-06d8-4d67-b506-d428d99563c5","Type":"ContainerStarted","Data":"4f0332193a5e185345c343805e416cfc113fe17f0c0be39bd3536ca82fceae5b"} Sep 08 13:19:48.186341 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:48.186319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"a331e5abe6fbe25c8286327a4392c735666eba4a903002b86f2e4d4a565cfad2"} Sep 08 13:19:48.207193 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:48.207142 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rbdg8" podStartSLOduration=3.081397491 podStartE2EDuration="7.207127883s" totalImagesPullingTime="4.063597894s" totalInitContainerRuntime="62.132498ms" isStatefulPod=true podCreationTimestamp="2026-09-08 13:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:48.206201775 +0000 UTC m=+208.245298351" watchObservedRunningTime="2026-09-08 13:19:48.207127883 +0000 UTC m=+208.246224458" Sep 08 13:19:50.198417 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:50.198387 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a" exitCode=0 Sep 08 13:19:50.198792 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:50.198450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a"} Sep 08 13:19:51.121542 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:51.121500 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" podUID="d6c15364-16bb-46fe-a025-57d5a24b5391" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 13:19:51.121767 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:51.121586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" Sep 08 13:19:51.122072 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:51.122040 2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"72d62b67d57d1623b2735e697c364c6e0d2bc74c18f267d142db8156f56b7c4b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 08 13:19:51.122140 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:51.122091 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" podUID="d6c15364-16bb-46fe-a025-57d5a24b5391" containerName="service-proxy" containerID="cri-o://72d62b67d57d1623b2735e697c364c6e0d2bc74c18f267d142db8156f56b7c4b" gracePeriod=30 Sep 08 13:19:52.209372 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:52.209336 2564 generic.go:356] "Generic (PLEG): container finished" podID="d6c15364-16bb-46fe-a025-57d5a24b5391" containerID="72d62b67d57d1623b2735e697c364c6e0d2bc74c18f267d142db8156f56b7c4b" exitCode=2 Sep 08 13:19:52.209856 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:52.209407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerDied","Data":"72d62b67d57d1623b2735e697c364c6e0d2bc74c18f267d142db8156f56b7c4b"} Sep 08 13:19:52.209856 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:52.209461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bfc4bd98-9gsqv" event={"ID":"d6c15364-16bb-46fe-a025-57d5a24b5391","Type":"ContainerStarted","Data":"e95b2bdd0655c26d5ce608d82cf398374d3730d92a75bced541faa2c576d4a24"} Sep 08 13:19:54.219456 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:54.219411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055"} Sep 08 13:19:54.219859 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:54.219530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60"} Sep 08 13:19:56.230417 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:56.230379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede"} Sep 08 13:19:56.230795 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:56.230490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331"} Sep 08 13:19:56.230795 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:56.230530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067"} Sep 08 13:19:56.230795 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:56.230586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerStarted","Data":"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e"} Sep 08 13:19:56.264237 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:56.264189 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.259788023 podStartE2EDuration="9.264174542s" totalImagesPullingTime="5.98531858s" totalInitContainerRuntime="19.067939ms" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:56.262396728 +0000 UTC m=+216.301493321" watchObservedRunningTime="2026-09-08 13:19:56.264174542 +0000 UTC m=+216.303271118" Sep 08 13:19:57.869478 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:19:57.869447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:20:28.809727 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:28.809692 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfjng_81d11a11-8353-4a7c-a0c6-6bd486a5a3b2/dns-node-resolver/0.log" Sep 08 13:20:31.210015 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:31.209975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:20:31.212383 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:31.212359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99a3fb34-38a0-4789-a65c-5c93c8f2f785-metrics-certs\") pod \"network-metrics-daemon-j2lqn\" (UID: \"99a3fb34-38a0-4789-a65c-5c93c8f2f785\") " pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:20:31.478581 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:31.478489 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mxg9n\"" Sep 08 13:20:31.486151 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:31.486133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2lqn" Sep 08 13:20:31.756506 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:31.756475 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2lqn"] Sep 08 13:20:31.760445 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:20:31.760415 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a3fb34_38a0_4789_a65c_5c93c8f2f785.slice/crio-3f934ac28d53f454b4d65e5e670295a7ad6649a8abe9d2934f7af147fc2a8e9d WatchSource:0}: Error finding container 3f934ac28d53f454b4d65e5e670295a7ad6649a8abe9d2934f7af147fc2a8e9d: Status 404 returned error can't find the container with id 3f934ac28d53f454b4d65e5e670295a7ad6649a8abe9d2934f7af147fc2a8e9d Sep 08 13:20:32.349786 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:32.349751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lqn" event={"ID":"99a3fb34-38a0-4789-a65c-5c93c8f2f785","Type":"ContainerStarted","Data":"3f934ac28d53f454b4d65e5e670295a7ad6649a8abe9d2934f7af147fc2a8e9d"} Sep 08 13:20:35.361676 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:35.361637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lqn" event={"ID":"99a3fb34-38a0-4789-a65c-5c93c8f2f785","Type":"ContainerStarted","Data":"7f9590ac1efc1f8e1b6fe2a3494783629add8d1243182809c8d9489b3ce38185"} Sep 08 13:20:35.362085 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:35.361692 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2lqn" event={"ID":"99a3fb34-38a0-4789-a65c-5c93c8f2f785","Type":"ContainerStarted","Data":"263c50fa0d0e21bc63a2b336fcd0c24a1186ce3ddb67984cf3df5edc1ff2e0fa"} Sep 08 13:20:35.380513 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:35.380469 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j2lqn" podStartSLOduration=251.465809466 podStartE2EDuration="4m14.380456106s" totalImagesPullingTime="2.91464664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:35.379139435 +0000 UTC m=+255.418236022" watchObservedRunningTime="2026-09-08 13:20:35.380456106 +0000 UTC m=+255.419552681" Sep 08 13:20:47.869671 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:47.869561 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:20:47.889723 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:47.889695 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:20:48.422622 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:20:48.422545 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:01.021050 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:01.021004 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6tqtf" podUID="50bb7cc5-31df-4e79-b1f5-0087136c79a4" Sep 08 13:21:01.452269 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:01.452190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:04.252226 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:04.252179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:04.254414 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:04.254396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bb7cc5-31df-4e79-b1f5-0087136c79a4-metrics-tls\") pod \"dns-default-6tqtf\" (UID: \"50bb7cc5-31df-4e79-b1f5-0087136c79a4\") " pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:04.456351 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:04.456317 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwlvq\"" Sep 08 13:21:04.463554 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:04.463534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:04.737205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:04.737174 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tqtf"] Sep 08 13:21:04.740253 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:21:04.740222 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bb7cc5_31df_4e79_b1f5_0087136c79a4.slice/crio-33d800a46ab4a171d37b9fa1b09bbb44643eb0de68d36fc898b840e44df8b43f WatchSource:0}: Error finding container 33d800a46ab4a171d37b9fa1b09bbb44643eb0de68d36fc898b840e44df8b43f: Status 404 returned error can't find the container with id 33d800a46ab4a171d37b9fa1b09bbb44643eb0de68d36fc898b840e44df8b43f Sep 08 13:21:05.466618 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:05.466576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tqtf" event={"ID":"50bb7cc5-31df-4e79-b1f5-0087136c79a4","Type":"ContainerStarted","Data":"33d800a46ab4a171d37b9fa1b09bbb44643eb0de68d36fc898b840e44df8b43f"} Sep 08 13:21:06.026159 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026124 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:06.026591 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026525 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" containerID="cri-o://119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" gracePeriod=600 Sep 08 13:21:06.026591 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026550 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="thanos-sidecar" containerID="cri-o://ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e" gracePeriod=600 Sep 08 13:21:06.026724 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026585 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy" containerID="cri-o://e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331" gracePeriod=600 Sep 08 13:21:06.026724 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026614 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="config-reloader" containerID="cri-o://7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055" gracePeriod=600 Sep 08 13:21:06.026724 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026613 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-web" containerID="cri-o://6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067" gracePeriod=600 Sep 08 13:21:06.026724 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.026716 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede" gracePeriod=600 Sep 08 13:21:06.480699 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.480614 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tqtf" event={"ID":"50bb7cc5-31df-4e79-b1f5-0087136c79a4","Type":"ContainerStarted","Data":"770cb7f1c8e3f7a9ec7d704f2e37ad0dedf1264ec42a0de0e0ac1d3c2274e72d"} Sep 08 13:21:06.489908 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.489872 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067" exitCode=0 Sep 08 13:21:06.489908 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.489904 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e" exitCode=0 Sep 08 13:21:06.489908 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.489914 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055" exitCode=0 Sep 08 13:21:06.490178 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.490002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067"} Sep 08 13:21:06.490178 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.490074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e"} Sep 08 13:21:06.490178 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:06.490118 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055"} Sep 08 13:21:07.498905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.498872 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tqtf" event={"ID":"50bb7cc5-31df-4e79-b1f5-0087136c79a4","Type":"ContainerStarted","Data":"8e2270e75d264fc7132f826028dfd26805b6c77f2b335f83ad65c550ba17ff3b"} Sep 08 13:21:07.499359 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.499088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:07.502818 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.502787 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede" exitCode=0 Sep 08 13:21:07.502818 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.502815 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331" exitCode=0 Sep 08 13:21:07.502992 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.502854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede"} Sep 08 13:21:07.502992 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.502926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331"} Sep 08 13:21:07.522707 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:07.522655 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6tqtf" podStartSLOduration=251.925139276 podStartE2EDuration="4m13.52264s" totalImagesPullingTime="1.597500724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:07.520966208 +0000 UTC m=+287.560062801" watchObservedRunningTime="2026-09-08 13:21:07.52264 +0000 UTC m=+287.561736576" Sep 08 13:21:08.410067 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:08.410012 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:08.410984 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:08.410956 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:08.411875 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:08.411847 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:08.411947 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:08.411891 2564 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" probeResult="unknown" Sep 08 13:21:13.409557 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:13.409508 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:13.410516 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:13.410477 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:13.411389 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:13.411354 2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 08 13:21:13.411478 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:13.411404 2564 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" probeResult="unknown" Sep 08 13:21:13.677917 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.677893 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:13.726858 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.726824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.726879 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.726912 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727015 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727052 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727087 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727160 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727201 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727192 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727224 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727257 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727290 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727316 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727351 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727379 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjjtg\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727416 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727440 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727441 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727475 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727505 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727537 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy\") pod \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\" (UID: \"ab0ddfc0-8124-4519-b439-1db3f9114bf9\") " Sep 08 13:21:13.727842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727560 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.727842 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727788 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.728285 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.727986 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 13:21:13.728383 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.728356 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.728636 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.728454 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.728759 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.728680 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.728854 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.728827 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.729154 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.729123 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.729718 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.729691 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:13.731217 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.731189 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.732546 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.732521 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out" (OuterVolumeSpecName: "config-out") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 13:21:13.732686 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.732653 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.732819 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.732694 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.732819 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.732717 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.732920 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.732817 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg" (OuterVolumeSpecName: "kube-api-access-pjjtg") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "kube-api-access-pjjtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:21:13.733172 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.733142 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:21:13.733484 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.733458 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.733589 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.733537 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.733702 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.733680 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config" (OuterVolumeSpecName: "config") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.734224 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.734202 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.741417 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.741395 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config" (OuterVolumeSpecName: "web-config") pod "ab0ddfc0-8124-4519-b439-1db3f9114bf9" (UID: "ab0ddfc0-8124-4519-b439-1db3f9114bf9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:13.828377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828341 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-metrics-client-certs\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828370 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjjtg\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-kube-api-access-pjjtg\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828379 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config-out\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828377 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828389 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828398 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828409 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-configmap-metrics-client-ca\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828418 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-kube-rbac-proxy\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828426 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-db\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828434 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828464 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-web-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828473 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828482 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab0ddfc0-8124-4519-b439-1db3f9114bf9-tls-assets\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828492 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828500 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828509 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828517 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab0ddfc0-8124-4519-b439-1db3f9114bf9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828525 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828535 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-secret-grpc-tls\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:13.828675 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:13.828542 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab0ddfc0-8124-4519-b439-1db3f9114bf9-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Sep 08 13:21:14.532430 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.532396 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" exitCode=0 Sep 08 13:21:14.532832 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.532453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60"} Sep 08 13:21:14.532832 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.532472 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.532832 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.532523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab0ddfc0-8124-4519-b439-1db3f9114bf9","Type":"ContainerDied","Data":"a331e5abe6fbe25c8286327a4392c735666eba4a903002b86f2e4d4a565cfad2"} Sep 08 13:21:14.532832 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.532558 2564 scope.go:117] "RemoveContainer" containerID="8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede" Sep 08 13:21:14.540602 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.540581 2564 scope.go:117] "RemoveContainer" containerID="e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331" Sep 08 13:21:14.547387 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.547195 2564 scope.go:117] "RemoveContainer" containerID="6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067" Sep 08 13:21:14.553625 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.553596 2564 scope.go:117] "RemoveContainer" containerID="ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e" Sep 08 13:21:14.557523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.557500 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:14.561653 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.561632 2564 scope.go:117] "RemoveContainer" containerID="7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055" Sep 08 13:21:14.561906 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.561888 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:14.568340 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.568322 2564 scope.go:117] "RemoveContainer" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" Sep 08 13:21:14.575232 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.575214 2564 scope.go:117] "RemoveContainer" containerID="72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a" Sep 08 13:21:14.581749 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.581733 2564 scope.go:117] "RemoveContainer" containerID="8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede" Sep 08 13:21:14.582030 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.582010 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede\": container with ID starting with 8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede not found: ID does not exist" containerID="8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede" Sep 08 13:21:14.582072 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582040 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede"} err="failed to get container status \"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede\": rpc error: code = NotFound desc = could not find container \"8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede\": container with ID starting with 8f65037f0ad928488ec3f4e532343bddf0cafaa533f897db103ad435088e2ede not found: ID does not exist" Sep 08 13:21:14.582072 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582059 2564 scope.go:117] "RemoveContainer" containerID="e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331" Sep 08 13:21:14.582292 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.582277 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331\": container with ID starting with e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331 not found: ID does not exist" containerID="e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331" Sep 08 13:21:14.582335 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582297 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331"} err="failed to get container status \"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331\": rpc error: code = NotFound desc = could not find container \"e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331\": container with ID starting with e2e3e4c9c1f242e314aacac176411a5aa88475d246e8a740c04721f723165331 not found: ID does not exist" Sep 08 13:21:14.582335 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582311 2564 scope.go:117] "RemoveContainer" containerID="6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067" Sep 08 13:21:14.582534 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.582516 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067\": container with ID starting with 6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067 not found: ID does not exist" containerID="6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067" Sep 08 13:21:14.582615 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582547 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067"} err="failed to get container status \"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067\": rpc error: code = NotFound desc = could not find container \"6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067\": container with ID starting with 6fc125d2579c5d0e9d6582be0cd6b3722859186c5edfe5a853c7746b25122067 not found: ID does not exist" Sep 08 13:21:14.582615 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582592 2564 scope.go:117] "RemoveContainer" containerID="ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e" Sep 08 13:21:14.582871 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.582848 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e\": container with ID starting with ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e not found: ID does not exist" containerID="ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e" Sep 08 13:21:14.582905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582880 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e"} err="failed to get container status \"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e\": rpc error: code = NotFound desc = could not find container \"ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e\": container with ID starting with ff8b12af4ee58896e323c7125f213f62cc8813dff6c87983a9afec293b13312e not found: ID does not exist" Sep 08 13:21:14.582905 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.582897 2564 scope.go:117] "RemoveContainer" containerID="7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055" Sep 08 13:21:14.583162 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.583143 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055\": container with ID starting with 7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055 not found: ID does not exist" containerID="7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055" Sep 08 13:21:14.583205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.583167 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055"} err="failed to get container status \"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055\": rpc error: code = NotFound desc = could not find container \"7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055\": container with ID starting with 7d40676e386046e34831879b9c04f88c6a0320fca277164d3218d7119bec8055 not found: ID does not exist" Sep 08 13:21:14.583205 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.583181 2564 scope.go:117] "RemoveContainer" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" Sep 08 13:21:14.583419 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.583403 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60\": container with ID starting with 119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60 not found: ID does not exist" containerID="119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60" Sep 08 13:21:14.583481 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.583425 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60"} err="failed to get container status \"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60\": rpc error: code = NotFound desc = could not find container \"119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60\": container with ID starting with 119fa0348a8dfc39878aa5b2d75a4b0cf4933a6b295aa40adc2941ef68ddff60 not found: ID does not exist" Sep 08 13:21:14.583481 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.583448 2564 scope.go:117] "RemoveContainer" containerID="72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a" Sep 08 13:21:14.583679 ip-10-0-128-91 kubenswrapper[2564]: E0908 13:21:14.583660 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a\": container with ID starting with 72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a not found: ID does not exist" containerID="72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a" Sep 08 13:21:14.583715 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.583684 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a"} err="failed to get container status \"72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a\": rpc error: code = NotFound desc = could not find container \"72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a\": container with ID starting with 72c9c4519baf8ed7b6d60fb95a148d4ada049d7100429595953eda87c8b3ba1a not found: ID does not exist" Sep 08 13:21:14.589662 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589641 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:14.589861 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589849 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-thanos" Sep 08 13:21:14.589897 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589862 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-thanos" Sep 08 13:21:14.589897 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589873 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="config-reloader" Sep 08 13:21:14.589897 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589879 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="config-reloader" Sep 08 13:21:14.589897 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589884 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy" Sep 08 13:21:14.589897 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589889 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589899 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589905 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589911 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="thanos-sidecar" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589916 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="thanos-sidecar" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589921 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-web" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589926 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-web" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589933 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="init-config-reloader" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589938 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="init-config-reloader" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589975 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-web" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589983 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="prometheus" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589989 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="config-reloader" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589994 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.589999 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="thanos-sidecar" Sep 08 13:21:14.590041 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.590005 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" containerName="kube-rbac-proxy-thanos" Sep 08 13:21:14.594296 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.594282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.597155 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 08 13:21:14.597303 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597191 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 08 13:21:14.597303 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597205 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 08 13:21:14.597303 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597200 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 08 13:21:14.597303 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 08 13:21:14.597615 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597521 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 08 13:21:14.597676 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597656 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 08 13:21:14.597779 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597761 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 08 13:21:14.597902 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.597888 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 08 13:21:14.598182 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.598168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 08 13:21:14.598422 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.598409 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 08 13:21:14.599111 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.599097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-651kpgh6mmrgp\"" Sep 08 13:21:14.599425 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.599396 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 13:21:14.599705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.599400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 08 13:21:14.599705 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.599516 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vpnjj\"" Sep 08 13:21:14.600713 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.600696 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 08 13:21:14.606877 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.606853 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 08 13:21:14.609622 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.609594 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:14.633778 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.633720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.633903 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.633810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.633903 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.633851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.633987 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.633909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.633987 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.633948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634045 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634080 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634138 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634183 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634217 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634217 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzn62\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-kube-api-access-tzn62\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634281 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634281 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634337 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634337 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634337 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634422 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634422 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.634422 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.634401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735437 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735437 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735437 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735437 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzn62\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-kube-api-access-tzn62\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.735776 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736324 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.735870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736523 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.736346 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736608 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.736535 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736808 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.736765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.736937 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.736889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.737674 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.737375 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.738717 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.738541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.738717 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.738546 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.739090 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.739061 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.739610 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.739242 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.739711 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.739615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.739711 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.739678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.739953 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.739925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.740018 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.740006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.740378 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.740356 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.740847 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.740824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.741296 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.741276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.741336 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.741308 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.742018 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.741998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.742088 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.742059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.745874 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.745853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzn62\" (UniqueName: \"kubernetes.io/projected/26dbfbc8-1d61-40f8-969d-cd78e9a689f5-kube-api-access-tzn62\") pod \"prometheus-k8s-0\" (UID: \"26dbfbc8-1d61-40f8-969d-cd78e9a689f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:14.908456 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:14.908404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:15.197505 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:15.197479 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 08 13:21:15.199973 ip-10-0-128-91 kubenswrapper[2564]: W0908 13:21:15.199948 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26dbfbc8_1d61_40f8_969d_cd78e9a689f5.slice/crio-8236eecb4c7e49d26def036ee4102b9481f85ac5b7f3184ebcd45a058e2bc401 WatchSource:0}: Error finding container 8236eecb4c7e49d26def036ee4102b9481f85ac5b7f3184ebcd45a058e2bc401: Status 404 returned error can't find the container with id 8236eecb4c7e49d26def036ee4102b9481f85ac5b7f3184ebcd45a058e2bc401 Sep 08 13:21:15.538975 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:15.538945 2564 generic.go:356] "Generic (PLEG): container finished" podID="26dbfbc8-1d61-40f8-969d-cd78e9a689f5" containerID="875e044a11445a2506c13f47080cb674796a5a9b7819acdb5a88a44e76636655" exitCode=0 Sep 08 13:21:15.539351 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:15.538992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerDied","Data":"875e044a11445a2506c13f47080cb674796a5a9b7819acdb5a88a44e76636655"} Sep 08 13:21:15.539351 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:15.539040 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"8236eecb4c7e49d26def036ee4102b9481f85ac5b7f3184ebcd45a058e2bc401"} Sep 08 13:21:16.479511 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.479479 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0ddfc0-8124-4519-b439-1db3f9114bf9" path="/var/lib/kubelet/pods/ab0ddfc0-8124-4519-b439-1db3f9114bf9/volumes" Sep 08 13:21:16.545490 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"709399f0aa82875097f0c9fd093307ad6fd06fac27caf2c62033fd0786326a0c"} Sep 08 13:21:16.545882 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"2095b12f1d5e800ab0f567396951c9faf1ee248b00dd0a9155e2c053a7cc594e"} Sep 08 13:21:16.545882 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545546 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"79997b24c7ad8d61e99e156f55ed009b1ace8601e345b1a98e77810fdd6354f2"} Sep 08 13:21:16.545882 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"308a20f1d783f8e33029bcfde05e01609f0e141f12bfe515c9cd6164a37b263c"} Sep 08 13:21:16.545882 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"7a3304c8fe05f2e282cd9bccbca16def1d58131381b56f45c3fd81229eb32d6d"} Sep 08 13:21:16.545882 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.545653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26dbfbc8-1d61-40f8-969d-cd78e9a689f5","Type":"ContainerStarted","Data":"02933eac2aa60d853815b308dd6cb5855a238e4dc805241b4da1ff8739b853f9"} Sep 08 13:21:16.580637 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:16.580310 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.562164108 podStartE2EDuration="2.580286869s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.122761ms" isStatefulPod=false podCreationTimestamp="2026-09-08 13:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:16.578978376 +0000 UTC m=+296.618075008" watchObservedRunningTime="2026-09-08 13:21:16.580286869 +0000 UTC m=+296.619383446" Sep 08 13:21:17.508344 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:17.508305 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6tqtf" Sep 08 13:21:19.909091 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:19.909046 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:21:20.323073 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:20.323047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:21:20.325733 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:20.325712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:21:20.326302 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:21:20.326287 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 13:22:14.909587 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:22:14.909482 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:22:14.924455 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:22:14.924426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:22:15.762698 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:22:15.762669 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 08 13:26:20.348512 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:26:20.348483 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:26:20.349071 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:26:20.348737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:31:20.370118 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:31:20.370042 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:31:20.370763 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:31:20.370726 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:36:20.391313 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:36:20.391281 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:36:20.392585 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:36:20.392551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:41:20.413439 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:41:20.413408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:41:20.415102 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:41:20.415081 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:46:20.435228 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:46:20.435200 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:46:20.437024 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:46:20.437003 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:51:20.455532 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:51:20.455500 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:51:20.457787 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:51:20.457767 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:56:20.481770 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:56:20.481741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 13:56:20.483146 ip-10-0-128-91 kubenswrapper[2564]: I0908 13:56:20.483126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:01:20.502641 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:01:20.502555 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:01:20.504296 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:01:20.504275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:06:20.523114 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:06:20.523084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:06:20.525708 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:06:20.525689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:11:20.545692 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:20.545663 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:11:20.548296 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:20.548276 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:11:50.582438 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:50.582356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rvgrg_cc050c15-aeaf-4499-934d-8c32c0f324f0/global-pull-secret-syncer/0.log" Sep 08 14:11:50.675153 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:50.675127 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lbgbj_7f88ba5e-34a7-42f2-8e3a-b16a29d31380/konnectivity-agent/0.log" Sep 08 14:11:50.765752 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:50.765723 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_f022263899a55b4e99919ae6d5833641/haproxy/0.log" Sep 08 14:11:55.236961 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.236926 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbdg8_f189c6b2-06d8-4d67-b506-d428d99563c5/node-exporter/0.log" Sep 08 14:11:55.260195 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.260176 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbdg8_f189c6b2-06d8-4d67-b506-d428d99563c5/kube-rbac-proxy/0.log" Sep 08 14:11:55.286875 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.286849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbdg8_f189c6b2-06d8-4d67-b506-d428d99563c5/init-textfile/0.log" Sep 08 14:11:55.503963 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.503935 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/prometheus/0.log" Sep 08 14:11:55.524494 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.524471 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/config-reloader/0.log" Sep 08 14:11:55.546558 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.546536 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/thanos-sidecar/0.log" Sep 08 14:11:55.575201 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.575182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/kube-rbac-proxy-web/0.log" Sep 08 14:11:55.601265 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.601247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/kube-rbac-proxy/0.log" Sep 08 14:11:55.626043 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.626015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/kube-rbac-proxy-thanos/0.log" Sep 08 14:11:55.651300 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:55.651279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26dbfbc8-1d61-40f8-969d-cd78e9a689f5/init-config-reloader/0.log" Sep 08 14:11:59.782800 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.782759 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd"] Sep 08 14:11:59.785961 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.785941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.788634 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.788615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tcsfc\"/\"default-dockercfg-dms7m\"" Sep 08 14:11:59.788901 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.788880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tcsfc\"/\"openshift-service-ca.crt\"" Sep 08 14:11:59.789698 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.789675 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tcsfc\"/\"kube-root-ca.crt\"" Sep 08 14:11:59.795118 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.795096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd"] Sep 08 14:11:59.905826 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.905794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-sys\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.905826 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.905824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-proc\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.906068 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.905849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-lib-modules\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.906068 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.905899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-podres\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.906068 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.905956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mj24\" (UniqueName: \"kubernetes.io/projected/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-kube-api-access-6mj24\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:11:59.906222 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.906207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tqtf_50bb7cc5-31df-4e79-b1f5-0087136c79a4/dns/0.log" Sep 08 14:11:59.927307 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:11:59.927289 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tqtf_50bb7cc5-31df-4e79-b1f5-0087136c79a4/kube-rbac-proxy/0.log" Sep 08 14:12:00.006769 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-lib-modules\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.006769 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-podres\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mj24\" (UniqueName: \"kubernetes.io/projected/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-kube-api-access-6mj24\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-sys\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-lib-modules\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-proc\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.007000 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-sys\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.007024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-proc\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.007038 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.006960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-podres\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.015504 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.015482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mj24\" (UniqueName: \"kubernetes.io/projected/9fc5bac9-0562-456e-8f97-d595e2b4e0bc-kube-api-access-6mj24\") pod \"perf-node-gather-daemonset-4xnqd\" (UID: \"9fc5bac9-0562-456e-8f97-d595e2b4e0bc\") " pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.091578 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.091489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfjng_81d11a11-8353-4a7c-a0c6-6bd486a5a3b2/dns-node-resolver/0.log" Sep 08 14:12:00.096665 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.096646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.366866 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.366793 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd"] Sep 08 14:12:00.370057 ip-10-0-128-91 kubenswrapper[2564]: W0908 14:12:00.370031 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fc5bac9_0562_456e_8f97_d595e2b4e0bc.slice/crio-a8532c85aaa2b05282fb7ee6e879426900026f77cbdace7cd70370468501c6ec WatchSource:0}: Error finding container a8532c85aaa2b05282fb7ee6e879426900026f77cbdace7cd70370468501c6ec: Status 404 returned error can't find the container with id a8532c85aaa2b05282fb7ee6e879426900026f77cbdace7cd70370468501c6ec Sep 08 14:12:00.656439 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.656361 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jr2dx_c5ce15f1-4852-4b48-b87e-51fbfe76bbe9/node-ca/0.log" Sep 08 14:12:00.810506 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.810475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" event={"ID":"9fc5bac9-0562-456e-8f97-d595e2b4e0bc","Type":"ContainerStarted","Data":"d3f90dc86cc1769ffded57137c576158cb79f6218ab8f27e79a3783c22e5988e"} Sep 08 14:12:00.810891 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.810521 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" event={"ID":"9fc5bac9-0562-456e-8f97-d595e2b4e0bc","Type":"ContainerStarted","Data":"a8532c85aaa2b05282fb7ee6e879426900026f77cbdace7cd70370468501c6ec"} Sep 08 14:12:00.810891 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.810551 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:00.828826 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:00.828771 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" podStartSLOduration=1.828757407 podStartE2EDuration="1.828757407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:12:00.827484285 +0000 UTC m=+3340.866580883" watchObservedRunningTime="2026-09-08 14:12:00.828757407 +0000 UTC m=+3340.867853982" Sep 08 14:12:01.792545 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:01.792517 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nqvj_131718e9-02ae-48a0-80fb-9fdcabc9a211/serve-healthcheck-canary/0.log" Sep 08 14:12:02.276108 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:02.276087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rf7hh_c8f984c4-1231-4ecc-8583-6c2703df407e/kube-rbac-proxy/0.log" Sep 08 14:12:02.302387 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:02.302365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rf7hh_c8f984c4-1231-4ecc-8583-6c2703df407e/exporter/0.log" Sep 08 14:12:02.325576 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:02.325546 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rf7hh_c8f984c4-1231-4ecc-8583-6c2703df407e/extractor/0.log" Sep 08 14:12:06.823355 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:06.823327 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tcsfc/perf-node-gather-daemonset-4xnqd" Sep 08 14:12:11.042838 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.042810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-55ltf_b482797d-2aaa-4857-8784-dc50396e5f9a/kube-multus/0.log" Sep 08 14:12:11.068788 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.068762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/kube-multus-additional-cni-plugins/0.log" Sep 08 14:12:11.090352 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.090328 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/egress-router-binary-copy/0.log" Sep 08 14:12:11.118847 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.118817 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/cni-plugins/0.log" Sep 08 14:12:11.142756 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.142731 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/bond-cni-plugin/0.log" Sep 08 14:12:11.164107 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.164080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/routeoverride-cni/0.log" Sep 08 14:12:11.188216 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.188192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/whereabouts-cni-bincopy/0.log" Sep 08 14:12:11.210674 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.210655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5rvzc_fbe6f66f-652f-477d-a01d-04a47b11b2a3/whereabouts-cni/0.log" Sep 08 14:12:11.827745 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.827716 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j2lqn_99a3fb34-38a0-4789-a65c-5c93c8f2f785/network-metrics-daemon/0.log" Sep 08 14:12:11.856561 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:11.856534 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j2lqn_99a3fb34-38a0-4789-a65c-5c93c8f2f785/kube-rbac-proxy/0.log" Sep 08 14:12:12.588879 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.588853 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-controller/0.log" Sep 08 14:12:12.608230 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.608209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/1.log" Sep 08 14:12:12.608353 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.608209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovn-acl-logging/0.log" Sep 08 14:12:12.627822 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.627803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/kube-rbac-proxy-node/0.log" Sep 08 14:12:12.649008 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.648988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 14:12:12.667084 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.667066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/northd/0.log" Sep 08 14:12:12.688513 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.688478 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/nbdb/0.log" Sep 08 14:12:12.708713 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.708695 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/sbdb/0.log" Sep 08 14:12:12.742755 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:12.742735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5mdfg_9df611de-523f-40d6-bf4f-df1b92c97f0a/ovnkube-controller/0.log" Sep 08 14:12:14.258428 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:14.258404 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p8s4x_79e40337-b49a-4e31-acb9-c5f3ec741ee7/network-check-target-container/0.log" Sep 08 14:12:15.230465 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:15.230443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xzj8h_6cd628b8-041b-4817-87ea-98709f7b22b5/iptables-alerter/0.log" Sep 08 14:12:15.916222 ip-10-0-128-91 kubenswrapper[2564]: I0908 14:12:15.916192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-x6bh9_f8fa79be-943f-412c-b434-00bfc7faf83c/tuned/0.log"