Sep 09 20:59:30.471093 ip-10-0-137-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 20:59:30.471104 ip-10-0-137-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 20:59:30.471111 ip-10-0-137-243 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 20:59:30.471343 ip-10-0-137-243 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 20:59:40.574207 ip-10-0-137-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 20:59:40.574226 ip-10-0-137-243 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 08d4a4b2698644eaa111883c69b2f2bd -- Sep 09 21:01:35.068868 ip-10-0-137-243 systemd[1]: Starting Kubernetes Kubelet... Sep 09 21:01:35.503032 ip-10-0-137-243 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 21:01:35.503032 ip-10-0-137-243 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 21:01:35.503032 ip-10-0-137-243 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 21:01:35.503032 ip-10-0-137-243 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 21:01:35.503032 ip-10-0-137-243 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 21:01:35.505146 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.505054 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 21:01:35.510295 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510279 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.510295 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510295 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510299 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510302 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510305 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510309 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510312 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510315 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510319 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510322 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510324 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510327 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510330 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510332 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510335 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510339 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510343 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510346 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510349 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510352 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510355 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.510363 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510358 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510360 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510363 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510365 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510369 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510372 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510374 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510377 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510380 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510382 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510385 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510389 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510392 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510395 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510398 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510400 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510403 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510406 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510409 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510412 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.510869 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510414 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510417 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510420 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510422 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510424 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510427 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510430 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510432 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510434 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510437 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510439 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510442 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510445 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510450 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510454 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510457 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510460 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510463 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510465 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.511366 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510468 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510471 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510473 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510475 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510478 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510480 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510483 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510485 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510488 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510490 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510493 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510496 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510506 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510509 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510511 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510514 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510516 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510519 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510521 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510524 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.511882 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510526 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510529 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510531 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510534 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510536 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510539 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510543 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510547 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510549 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510564 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510567 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510569 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510573 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510575 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510577 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510580 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510582 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510585 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.510587 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.512367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511357 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511365 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511369 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511372 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511375 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511379 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511382 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511385 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511388 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511390 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511393 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511396 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511399 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511401 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511404 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511406 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511409 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511411 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511414 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511416 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.512839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511419 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511422 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511425 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511428 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511432 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511435 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511438 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511441 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511444 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511446 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511449 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511452 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511455 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511458 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511461 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511463 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511466 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511469 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511472 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.513346 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511474 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511477 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511480 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511482 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511485 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511488 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511490 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511493 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511495 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511498 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511500 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511502 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511505 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511508 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511510 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511513 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511515 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511518 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511520 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511524 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.513837 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511526 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511529 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511531 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511534 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511536 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511541 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511545 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511548 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511566 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511569 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511572 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511577 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511580 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511582 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511585 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511589 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511592 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511599 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511601 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.514335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511604 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511606 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511609 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511611 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511614 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511617 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511619 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511622 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511624 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511627 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511630 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511632 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511634 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511637 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511639 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511643 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511646 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511649 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511651 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.514861 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.511654 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512025 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512029 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512032 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512035 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512038 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512043 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512046 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512049 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512054 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512057 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512060 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512063 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512066 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512068 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512071 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512073 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512076 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512079 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.515336 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512082 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512084 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512087 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512090 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512093 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512095 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512098 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512100 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512103 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512105 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512108 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512110 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512112 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512115 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512117 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512120 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512123 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512126 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512128 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512131 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.515902 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512134 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512136 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512140 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512143 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512145 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512148 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512151 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512153 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512156 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512158 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512161 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512163 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512166 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512169 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512171 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512173 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512176 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512179 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512181 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512185 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.516388 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512188 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512190 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512193 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512195 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512197 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512200 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512203 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512207 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512210 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512213 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512215 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512218 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512221 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512223 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512227 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512230 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512232 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512235 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512237 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.516965 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512239 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512242 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512244 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512247 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512249 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512252 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512254 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512257 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512259 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512262 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512265 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512267 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512269 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512272 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512274 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512276 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512279 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512281 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512285 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512288 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.517438 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512290 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.512292 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512373 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512416 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512424 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512429 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512434 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512439 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512443 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512447 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512451 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512454 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512457 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512461 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512464 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512466 2580 flags.go:64] FLAG: --cgroup-root="" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512469 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512472 2580 flags.go:64] FLAG: --client-ca-file="" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512475 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512477 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512482 2580 flags.go:64] FLAG: --cluster-domain="" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512485 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512488 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512491 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 21:01:35.517939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512494 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512498 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512500 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512503 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512506 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512509 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512513 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512516 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512519 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512521 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512529 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512532 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512535 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512538 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512541 2580 flags.go:64] FLAG: --enable-server="true" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512545 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512549 2580 flags.go:64] FLAG: --event-burst="100" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512580 2580 flags.go:64] FLAG: --event-qps="50" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512585 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512588 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512591 2580 flags.go:64] FLAG: --eviction-hard="" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512595 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512598 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512601 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512604 2580 flags.go:64] FLAG: --eviction-soft="" Sep 09 21:01:35.518513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512607 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512610 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512612 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512615 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512618 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512621 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512624 2580 flags.go:64] FLAG: --feature-gates="" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512627 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512630 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512633 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512636 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512639 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512642 2580 flags.go:64] FLAG: --help="false" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512646 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512649 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512651 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512654 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512658 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512661 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512664 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512666 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512669 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512672 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 21:01:35.519135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512676 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512679 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512682 2580 flags.go:64] FLAG: --kube-reserved="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512685 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512687 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512690 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512693 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512695 2580 flags.go:64] FLAG: --lock-file="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512698 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512701 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512704 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512709 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512712 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512714 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512717 2580 flags.go:64] FLAG: --logging-format="text" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512720 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512723 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512726 2580 flags.go:64] FLAG: --manifest-url="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512728 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512733 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512735 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512739 2580 flags.go:64] FLAG: --max-pods="110" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512743 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512746 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512749 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 21:01:35.519752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512752 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512755 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512758 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512761 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512785 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512789 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512792 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512795 2580 flags.go:64] FLAG: --pod-cidr="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512798 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512804 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512807 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512810 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512812 2580 flags.go:64] FLAG: --port="10250" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512815 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512818 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc49943efc661dd3" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512821 2580 flags.go:64] FLAG: --qos-reserved="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512824 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512827 2580 flags.go:64] FLAG: --register-node="true" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512829 2580 flags.go:64] FLAG: --register-with-taints="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512833 2580 flags.go:64] FLAG: --registry-burst="10" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512836 2580 flags.go:64] FLAG: --registry-qps="5" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512838 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512848 2580 flags.go:64] FLAG: --reserved-memory="" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512852 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512856 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 21:01:35.520687 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512859 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512862 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512865 2580 flags.go:64] FLAG: --runonce="false" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512869 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512872 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512875 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512878 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512880 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512883 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512886 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512889 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512892 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512895 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512899 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512902 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512905 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512908 2580 flags.go:64] FLAG: --system-cgroups="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512912 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512917 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512919 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512922 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512926 2580 flags.go:64] FLAG: --tls-min-version="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512929 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512932 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512935 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 21:01:35.521793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512938 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512941 2580 flags.go:64] FLAG: --v="2" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512945 2580 flags.go:64] FLAG: --version="false" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512949 2580 flags.go:64] FLAG: --vmodule="" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512953 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.512956 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513072 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513076 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513079 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513083 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513086 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513089 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513092 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513094 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513097 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513100 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513102 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513105 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513108 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513110 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513114 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.522888 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513118 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513121 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513123 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513127 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513129 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513132 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513135 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513137 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513140 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513143 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513147 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513150 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513153 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513156 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513159 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513161 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513166 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513172 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513176 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.523537 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513179 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513182 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513185 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513187 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513190 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513192 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513195 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513197 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513200 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513202 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513204 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513207 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513211 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513213 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513216 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513219 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513222 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513225 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513227 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513230 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.524141 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513233 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513235 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513238 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513240 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513243 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513246 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513248 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513251 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513254 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513257 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513260 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513262 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513265 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513267 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513270 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513273 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513275 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513278 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513280 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.525074 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513282 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513285 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513288 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513291 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513293 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513297 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513299 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513301 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513304 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513306 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513309 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513312 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513314 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513316 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513319 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513321 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513324 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513326 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513329 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513331 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.525879 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513334 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513336 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513339 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513341 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513344 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.513347 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.514313 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.523084 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.523112 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.523921 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.523935 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524073 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524082 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524088 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524093 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.526416 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524100 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524106 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524111 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524116 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524121 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524126 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524131 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524136 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524140 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524144 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524148 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524152 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524155 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524159 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524164 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524168 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524172 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524176 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524180 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524184 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.526815 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524188 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524192 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524196 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524201 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524205 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524217 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524222 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524227 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524231 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524234 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524239 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524243 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524247 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524251 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524255 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524259 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524263 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524267 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524271 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524276 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.527318 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524280 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524284 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524288 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524294 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524300 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524305 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524309 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524314 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524318 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524323 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524327 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524331 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524335 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524339 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524343 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524347 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524350 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524355 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524367 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.527839 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524371 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524376 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524380 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524384 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524389 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524392 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524396 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524400 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524404 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524407 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524411 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524416 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524420 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524424 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524428 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524432 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524436 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524440 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524444 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.528302 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524448 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524452 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524456 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524460 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524464 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524468 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524472 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524479 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524484 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524488 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524492 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524497 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524501 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524513 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524517 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524522 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.528802 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524525 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.524533 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524792 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524802 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524807 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524811 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524816 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524820 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524824 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524828 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524832 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524836 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524840 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524847 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524854 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 21:01:35.529208 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524858 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524863 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524868 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524872 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524876 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524881 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524885 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524889 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524893 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524897 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524901 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524905 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524911 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524915 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524920 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524931 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524937 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524943 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524947 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 21:01:35.529604 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524951 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524955 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524959 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524964 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524968 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524972 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524976 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524980 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524984 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524988 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524992 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.524996 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525001 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525004 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525009 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525013 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525017 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525021 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525025 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525029 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 21:01:35.530080 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525033 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525037 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525041 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525045 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525049 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525053 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525057 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525061 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525065 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525079 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525083 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525087 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525090 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525094 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525098 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525102 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525106 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525110 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525114 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525121 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 21:01:35.530587 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525127 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525132 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525136 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525141 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525145 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525149 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525153 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525158 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525163 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525167 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525172 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525176 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525180 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525184 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525188 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525192 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525196 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525201 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525205 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 21:01:35.531075 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525209 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525213 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525217 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525228 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525232 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525237 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525241 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:35.525245 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.525253 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.525456 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.527623 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.528729 2580 server.go:1019] "Starting client certificate rotation" Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.528833 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 21:01:35.531615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.528878 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 21:01:35.531943 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.531250 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 21:01:35.535481 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.535456 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 21:01:35.542477 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.542458 2580 log.go:25] "Validated CRI v1 runtime API" Sep 09 21:01:35.545282 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.545268 2580 log.go:25] "Validated CRI v1 image API" Sep 09 21:01:35.546225 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.546208 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 21:01:35.554677 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.554655 2580 fs.go:135] Filesystem UUIDs: map[00b6cd98-a917-4b8d-9f13-0f438be849d0:/dev/nvme0n1p3 11964ec6-a7ba-400f-8223-d8b9d065056d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 09 21:01:35.554737 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.554677 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 21:01:35.559794 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.559679 2580 manager.go:216] Machine: {Timestamp:2026-09-09 21:01:35.558391107 +0000 UTC m=+0.363279173 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098045 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd20ceaf6356bfb2f8f67c59ead2a SystemUUID:ec2cd20c-eaf6-356b-fb2f-8f67c59ead2a BootID:08d4a4b2-6986-44ea-a111-883c69b2f2bd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:f3:3e:ec:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:f3:3e:ec:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:19:fc:25:07:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 21:01:35.559794 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.559788 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 21:01:35.559893 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.559869 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 21:01:35.562830 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.562799 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 21:01:35.562988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.562834 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 21:01:35.563530 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.563519 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 21:01:35.563580 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.563532 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 21:01:35.563580 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.563546 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 21:01:35.563886 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.563872 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 21:01:35.564205 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.564192 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 21:01:35.565387 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.565376 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 21:01:35.569735 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569723 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 09 21:01:35.569888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569878 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 21:01:35.569925 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569908 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 09 21:01:35.569925 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569922 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 21:01:35.569986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569942 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 21:01:35.569986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569951 2580 kubelet.go:398] "Adding apiserver pod source" Sep 09 21:01:35.569986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.569961 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 21:01:35.570483 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.570469 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 21:01:35.570543 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.570489 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 21:01:35.573379 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.573352 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 21:01:35.580238 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580201 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 21:01:35.580345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580251 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 21:01:35.580500 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580485 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 21:01:35.580548 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580509 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 21:01:35.580548 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580527 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 21:01:35.580548 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580536 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 21:01:35.580704 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580549 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 21:01:35.580704 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.580584 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 21:01:35.581147 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581127 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 21:01:35.581231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581152 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 21:01:35.581231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581169 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 21:01:35.581231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581178 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 21:01:35.581231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581193 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 21:01:35.581231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.581205 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 21:01:35.582455 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.582434 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 21:01:35.582505 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.582461 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 21:01:35.585507 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.585486 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 21:01:35.585701 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.585679 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 21:01:35.585970 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.585945 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 21:01:35.586619 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.586608 2580 server.go:1268] "Started kubelet" Sep 09 21:01:35.586715 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.586675 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 21:01:35.586778 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.586690 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 21:01:35.586778 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.586754 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 21:01:35.587636 ip-10-0-137-243 systemd[1]: Started Kubernetes Kubelet. Sep 09 21:01:35.587988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.587737 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 21:01:35.590403 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.590243 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 09 21:01:35.591393 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.591376 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mkt6z" Sep 09 21:01:35.593136 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.593113 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 21:01:35.593452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.593437 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 21:01:35.594130 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594098 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 21:01:35.594533 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.594512 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.594613 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.593683 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-243.ec2.internal.18d3c2d4a6fb99e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-243.ec2.internal,UID:ip-10-0-137-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-243.ec2.internal,},FirstTimestamp:2026-09-09 21:01:35.586580969 +0000 UTC m=+0.391469016,LastTimestamp:2026-09-09 21:01:35.586580969 +0000 UTC m=+0.391469016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-243.ec2.internal,}" Sep 09 21:01:35.594712 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594699 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 21:01:35.594789 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594772 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 21:01:35.594892 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594710 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 21:01:35.594947 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594902 2580 factory.go:55] Registering systemd factory Sep 09 21:01:35.594947 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594927 2580 factory.go:223] Registration of the systemd container factory successfully Sep 09 21:01:35.595042 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594968 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 09 21:01:35.595042 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.594976 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 09 21:01:35.595213 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595199 2580 factory.go:153] Registering CRI-O factory Sep 09 21:01:35.595213 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595213 2580 factory.go:223] Registration of the crio container factory successfully Sep 09 21:01:35.595288 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595266 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 21:01:35.595288 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595287 2580 factory.go:103] Registering Raw factory Sep 09 21:01:35.595375 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595301 2580 manager.go:1196] Started watching for new ooms in manager Sep 09 21:01:35.595650 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.595637 2580 manager.go:349] Starting recovery of all containers Sep 09 21:01:35.602097 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.602010 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mkt6z" Sep 09 21:01:35.603982 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.603965 2580 manager.go:354] Recovery completed Sep 09 21:01:35.605214 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.605182 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 21:01:35.605338 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.605291 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 21:01:35.611113 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.611096 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.612729 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.612711 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.612809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.612746 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.612809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.612760 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.613344 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.613327 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 21:01:35.613344 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.613344 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 21:01:35.613461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.613361 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 09 21:01:35.613461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.613343 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.614134 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.614117 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.614215 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.614149 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.614215 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.614165 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.614943 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.614877 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-243.ec2.internal.18d3c2d4a88a981c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-243.ec2.internal,UID:ip-10-0-137-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-243.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-243.ec2.internal,},FirstTimestamp:2026-09-09 21:01:35.612729372 +0000 UTC m=+0.417617424,LastTimestamp:2026-09-09 21:01:35.612729372 +0000 UTC m=+0.417617424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-243.ec2.internal,}" Sep 09 21:01:35.615384 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.615371 2580 policy_none.go:49] "None policy: Start" Sep 09 21:01:35.615625 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.615577 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 21:01:35.615625 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.615595 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 21:01:35.617535 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.617523 2580 policy_none.go:47] "Start" Sep 09 21:01:35.660229 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660210 2580 manager.go:337] "Starting Device Plugin manager" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.660250 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660264 2580 server.go:87] "Starting device plugin registration server" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660741 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660755 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660862 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660941 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.660948 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.661475 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 21:01:35.679524 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.661520 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.694791 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.694758 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 21:01:35.696195 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.696177 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 21:01:35.696267 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.696243 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 21:01:35.696308 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.696270 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 21:01:35.696354 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.696315 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 21:01:35.698990 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.698973 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 21:01:35.761316 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.761208 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.762254 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.762234 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.762362 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.762268 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.762362 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.762283 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.762362 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.762311 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.771447 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.771412 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.771447 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.771446 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-243.ec2.internal\": node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.786736 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.786711 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.796638 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.796618 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal"] Sep 09 21:01:35.796708 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.796687 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.797779 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.797763 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.797891 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.797792 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.797891 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.797804 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.799965 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.799952 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.800111 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.800169 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800131 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.800711 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800693 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.800711 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800704 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.800843 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800721 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.800843 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800727 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.800843 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800731 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.800843 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.800736 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.803045 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.803029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.803131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.803064 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 21:01:35.803829 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.803809 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientMemory" Sep 09 21:01:35.803917 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.803840 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 21:01:35.803917 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.803850 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeHasSufficientPID" Sep 09 21:01:35.827262 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.827230 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-243.ec2.internal\" not found" node="ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.831594 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.831576 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-243.ec2.internal\" not found" node="ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.886961 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.886930 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.896470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.896442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.896470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.896472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/796a00e702ae2d3b69b1ebe3e73739bc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-243.ec2.internal\" (UID: \"796a00e702ae2d3b69b1ebe3e73739bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.896669 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.896489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.987369 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:35.987326 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:35.996746 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/796a00e702ae2d3b69b1ebe3e73739bc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-243.ec2.internal\" (UID: \"796a00e702ae2d3b69b1ebe3e73739bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.996823 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.996823 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.996823 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/796a00e702ae2d3b69b1ebe3e73739bc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-243.ec2.internal\" (UID: \"796a00e702ae2d3b69b1ebe3e73739bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.996914 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996845 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:35.996914 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:35.996848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea04a6b24f833108c08b618518cd306c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal\" (UID: \"ea04a6b24f833108c08b618518cd306c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:36.088235 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.088151 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.129641 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.129605 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:36.134498 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.134408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:36.189195 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.189162 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.289693 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.289656 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.390269 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.390236 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.490948 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.490913 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.528392 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.528359 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 21:01:36.528887 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.528537 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 21:01:36.591525 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.591499 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.605596 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.605550 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:56:36 +0000 UTC" deadline="2028-03-02 01:49:52.562789744 +0000 UTC" Sep 09 21:01:36.605596 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.605593 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12940h48m15.957200382s" Sep 09 21:01:36.691907 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.691839 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:36.763821 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:36.763789 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796a00e702ae2d3b69b1ebe3e73739bc.slice/crio-6a0f13b312faeae1f914075a3137ff8dbd6218fd1fbd9e660c191b84684fbdad WatchSource:0}: Error finding container 6a0f13b312faeae1f914075a3137ff8dbd6218fd1fbd9e660c191b84684fbdad: Status 404 returned error can't find the container with id 6a0f13b312faeae1f914075a3137ff8dbd6218fd1fbd9e660c191b84684fbdad Sep 09 21:01:36.764035 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:36.764013 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea04a6b24f833108c08b618518cd306c.slice/crio-bbf6ec44afe587c996ae1d68132bd1d90df3b02fd7df415a49fb1ad7bda73010 WatchSource:0}: Error finding container bbf6ec44afe587c996ae1d68132bd1d90df3b02fd7df415a49fb1ad7bda73010: Status 404 returned error can't find the container with id bbf6ec44afe587c996ae1d68132bd1d90df3b02fd7df415a49fb1ad7bda73010 Sep 09 21:01:36.767751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:36.767723 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:01:36.792910 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:36.792881 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:38.278658 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:38.278629 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-243.ec2.internal\" not found" Sep 09 21:01:38.279757 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.279741 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 21:01:38.379830 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.379745 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" Sep 09 21:01:38.383813 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.383794 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 21:01:38.390701 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.390684 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 21:01:38.392486 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.392472 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" Sep 09 21:01:38.404608 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.404595 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 21:01:38.430803 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.430775 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 21:01:38.956729 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.956698 2580 apiserver.go:52] "Watching apiserver" Sep 09 21:01:38.967343 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.967318 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 21:01:38.967772 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.967748 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-9bvmr","openshift-multus/multus-additional-cni-plugins-7szbv","openshift-multus/multus-vq2g9","openshift-multus/network-metrics-daemon-77bkx","openshift-network-diagnostics/network-check-target-wqq5t","kube-system/konnectivity-agent-rgr7z","openshift-cluster-node-tuning-operator/tuned-vvgxz","openshift-dns/node-resolver-lnkd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal","openshift-network-operator/iptables-alerter-k6dhd","openshift-ovn-kubernetes/ovnkube-node-5r84f","kube-system/global-pull-secret-syncer-smz62","kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx"] Sep 09 21:01:38.970315 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.970296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.972684 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.972646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.973297 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.973223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.973297 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.973232 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8tklf\"" Sep 09 21:01:38.973297 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.973246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 21:01:38.974925 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.974905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.975037 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.975027 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 21:01:38.976329 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976310 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 21:01:38.976445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 21:01:38.976445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976421 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 21:01:38.976550 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976516 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.976780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 21:01:38.976780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.976761 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wr5v7\"" Sep 09 21:01:38.977170 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.977151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.977393 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.977368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:38.977477 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:38.977456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:38.977543 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.977509 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 21:01:38.977823 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.977805 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 21:01:38.978599 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.978330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 21:01:38.978599 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.978477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rrfjq\"" Sep 09 21:01:38.978859 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.978840 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 21:01:38.980020 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.980002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:38.980114 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:38.980068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:38.982436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.982236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:38.985008 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.984992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:38.986268 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.986249 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 21:01:38.986630 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.986611 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 21:01:38.986743 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.986621 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mkp7c\"" Sep 09 21:01:38.987323 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.987305 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.987409 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.987384 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 21:01:38.987759 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.987735 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 21:01:38.987839 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.987793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnj4k\"" Sep 09 21:01:38.988043 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.988026 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:38.990300 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.990280 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jnlkr\"" Sep 09 21:01:38.990550 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.990533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:38.990625 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.990588 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.991464 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-modprobe-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.991545 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-kubernetes\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.991545 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-systemd\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.991545 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-var-lib-kubelet\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.991658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991555 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 21:01:38.991658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5fx\" (UniqueName: \"kubernetes.io/projected/7064e13b-b7fc-4419-870a-fd56582ad5bb-kube-api-access-xb5fx\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.991658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-multus\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.991658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991629 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 21:01:38.991658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-kubelet\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-systemd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-cnibin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-hostroot\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-etc-kubernetes\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.991864 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e25e491-7653-49b7-bf57-b0123eb7a7fc-konnectivity-ca\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-kubelet\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-netns\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-env-overrides\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e25e491-7653-49b7-bf57-b0123eb7a7fc-agent-certs\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.991996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-run\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-slash\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-cni-binary-copy\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-socket-dir-parent\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992131 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6gbq\" (UniqueName: \"kubernetes.io/projected/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-kube-api-access-k6gbq\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-multus-certs\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-etc-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovn-node-metrics-cert\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjdz\" (UniqueName: \"kubernetes.io/projected/7731ac9c-4179-4f4f-8a5c-344262d7e141-kube-api-access-wtjdz\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-conf\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-config\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-k8s-cni-cncf-io\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-daemon-config\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-host\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-tmp\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysconfig\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-lib-modules\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.992752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-log-socket\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-bin\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-script-lib\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.992989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-systemd-units\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-node-log\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-ovn\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-netd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-netns\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-bin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dc8\" (UniqueName: \"kubernetes.io/projected/74f66f5e-7af4-4907-963d-a0eee2716b9e-kube-api-access-z8dc8\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-tuned\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-system-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-conf-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-var-lib-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:38.993338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:38.994143 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.993437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-sys\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:38.994880 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.994685 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-td852\"" Sep 09 21:01:38.994997 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.994978 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 21:01:38.995338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.995320 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 21:01:38.996452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.996429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:38.998369 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.998350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:38.999217 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.999200 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nkfc7\"" Sep 09 21:01:38.999351 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.999329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 21:01:38.999424 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.999383 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 21:01:38.999648 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:38.999633 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 21:01:39.000746 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.000729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.000840 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.000794 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:39.001402 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.001384 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 21:01:39.001499 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.001429 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 21:01:39.001586 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.001568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 21:01:39.001702 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.001664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mbmcs\"" Sep 09 21:01:39.022129 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.022107 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rzdn2" Sep 09 21:01:39.034017 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.033995 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rzdn2" Sep 09 21:01:39.081146 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.081114 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 21:01:39.085842 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.085797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" event={"ID":"ea04a6b24f833108c08b618518cd306c","Type":"ContainerStarted","Data":"bbf6ec44afe587c996ae1d68132bd1d90df3b02fd7df415a49fb1ad7bda73010"} Sep 09 21:01:39.086873 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.086856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" event={"ID":"796a00e702ae2d3b69b1ebe3e73739bc","Type":"ContainerStarted","Data":"6a0f13b312faeae1f914075a3137ff8dbd6218fd1fbd9e660c191b84684fbdad"} Sep 09 21:01:39.094225 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-config\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094225 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-k8s-cni-cncf-io\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-daemon-config\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-host\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-tmp\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhxh\" (UniqueName: \"kubernetes.io/projected/abdb95d3-dfee-40c7-9f55-79764bd356ee-kube-api-access-clhxh\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysconfig\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-lib-modules\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-log-socket\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-k8s-cni-cncf-io\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.094422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-bin\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-script-lib\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-kubelet-config\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-system-cni-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abdb95d3-dfee-40c7-9f55-79764bd356ee-serviceca\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-systemd-units\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-node-log\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cq76\" (UniqueName: \"kubernetes.io/projected/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-kube-api-access-6cq76\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-iptables-alerter-script\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-host-slash\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58c8p\" (UniqueName: \"kubernetes.io/projected/16400934-09ae-4dae-a47c-3d021a55b445-kube-api-access-58c8p\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-ovn\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-netd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-netns\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-bin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.094827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dc8\" (UniqueName: \"kubernetes.io/projected/74f66f5e-7af4-4907-963d-a0eee2716b9e-kube-api-access-z8dc8\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rsgj\" (UniqueName: \"kubernetes.io/projected/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kube-api-access-9rsgj\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-tuned\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-socket-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-sys-fs\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-system-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.094999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-conf-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-tmp-dir\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-var-lib-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-registration-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-binary-copy\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-sys\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-modprobe-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.095544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-kubernetes\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-systemd\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-var-lib-kubelet\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5fx\" (UniqueName: \"kubernetes.io/projected/7064e13b-b7fc-4419-870a-fd56582ad5bb-kube-api-access-xb5fx\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-multus\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-daemon-config\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-kubelet\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-systemd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-cnibin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-hostroot\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-config\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-etc-kubernetes\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e25e491-7653-49b7-bf57-b0123eb7a7fc-konnectivity-ca\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095836 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-netns\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095955 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-systemd-units\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-bin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.096346 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.095985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-var-lib-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-hosts-file\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-sys\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-dbus\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-kubelet\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-netns\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-cni-multus\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096144 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-modprobe-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-env-overrides\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-node-log\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-kubernetes\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e25e491-7653-49b7-bf57-b0123eb7a7fc-agent-certs\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096225 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-var-lib-kubelet\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-run\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-slash\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-systemd\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096313 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-var-lib-kubelet\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-cni-binary-copy\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.096346 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-socket-dir-parent\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-kubelet\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-device-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-system-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-lib-modules\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abdb95d3-dfee-40c7-9f55-79764bd356ee-host\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-netns\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096477 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6gbq\" (UniqueName: \"kubernetes.io/projected/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-kube-api-access-k6gbq\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-systemd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-cnibin\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096544 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-log-socket\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.097883 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-host\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096565 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-run\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-cni-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-etc-kubernetes\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7731ac9c-4179-4f4f-8a5c-344262d7e141-cni-binary-copy\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096835 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-slash\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.096876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-conf-dir\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-multus-socket-dir-parent\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-bin\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-cnibin\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-multus-certs\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-hostroot\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-etc-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovn-node-metrics-cert\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.098896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjdz\" (UniqueName: \"kubernetes.io/projected/7731ac9c-4179-4f4f-8a5c-344262d7e141-kube-api-access-wtjdz\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-host-cni-netd\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e25e491-7653-49b7-bf57-b0123eb7a7fc-konnectivity-ca\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-conf\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgsp\" (UniqueName: \"kubernetes.io/projected/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-kube-api-access-xrgsp\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097543 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-etc-openvswitch\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-env-overrides\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovnkube-script-lib\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.097658 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:01:39.597637441 +0000 UTC m=+3.017410640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysconfig\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097713 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7731ac9c-4179-4f4f-8a5c-344262d7e141-host-run-multus-certs\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-conf\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097965 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-sysctl-d\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.099767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.097988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7064e13b-b7fc-4419-870a-fd56582ad5bb-run-ovn\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.101006 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.100930 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-etc-tuned\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.101167 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.101135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7064e13b-b7fc-4419-870a-fd56582ad5bb-ovn-node-metrics-cert\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.101234 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.101167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e25e491-7653-49b7-bf57-b0123eb7a7fc-agent-certs\") pod \"konnectivity-agent-rgr7z\" (UID: \"2e25e491-7653-49b7-bf57-b0123eb7a7fc\") " pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:39.101700 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.101662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74f66f5e-7af4-4907-963d-a0eee2716b9e-tmp\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.102796 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.102776 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:39.102899 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.102802 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:39.102899 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.102818 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:39.102899 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.102877 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:39.602858497 +0000 UTC m=+3.022631675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:39.105132 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.105075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dc8\" (UniqueName: \"kubernetes.io/projected/74f66f5e-7af4-4907-963d-a0eee2716b9e-kube-api-access-z8dc8\") pod \"tuned-vvgxz\" (UID: \"74f66f5e-7af4-4907-963d-a0eee2716b9e\") " pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.105345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.105323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5fx\" (UniqueName: \"kubernetes.io/projected/7064e13b-b7fc-4419-870a-fd56582ad5bb-kube-api-access-xb5fx\") pod \"ovnkube-node-5r84f\" (UID: \"7064e13b-b7fc-4419-870a-fd56582ad5bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.106559 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.106517 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6gbq\" (UniqueName: \"kubernetes.io/projected/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-kube-api-access-k6gbq\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:39.110685 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.110655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjdz\" (UniqueName: \"kubernetes.io/projected/7731ac9c-4179-4f4f-8a5c-344262d7e141-kube-api-access-wtjdz\") pod \"multus-vq2g9\" (UID: \"7731ac9c-4179-4f4f-8a5c-344262d7e141\") " pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.197761 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-device-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.197761 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abdb95d3-dfee-40c7-9f55-79764bd356ee-host\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-cnibin\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197858 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-device-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgsp\" (UniqueName: \"kubernetes.io/projected/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-kube-api-access-xrgsp\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-cnibin\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhxh\" (UniqueName: \"kubernetes.io/projected/abdb95d3-dfee-40c7-9f55-79764bd356ee-kube-api-access-clhxh\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.197848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abdb95d3-dfee-40c7-9f55-79764bd356ee-host\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.197994 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.197928 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-kubelet-config\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-system-cni-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-system-cni-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.198105 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:39.698073404 +0000 UTC m=+3.117846596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198094 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-kubelet-config\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abdb95d3-dfee-40c7-9f55-79764bd356ee-serviceca\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cq76\" (UniqueName: \"kubernetes.io/projected/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-kube-api-access-6cq76\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-iptables-alerter-script\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-host-slash\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58c8p\" (UniqueName: \"kubernetes.io/projected/16400934-09ae-4dae-a47c-3d021a55b445-kube-api-access-58c8p\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsgj\" (UniqueName: \"kubernetes.io/projected/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kube-api-access-9rsgj\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-socket-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-host-slash\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-sys-fs\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.198461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-tmp-dir\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-registration-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-binary-copy\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-hosts-file\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-dbus\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abdb95d3-dfee-40c7-9f55-79764bd356ee-serviceca\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198701 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-registration-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-dbus\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-iptables-alerter-script\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-hosts-file\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-sys-fs\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198804 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad27daf1-cbac-4048-96dd-0adc7f087dd1-socket-dir\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198969 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-tmp-dir\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.199080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.198967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16400934-09ae-4dae-a47c-3d021a55b445-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199689 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.199155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.199689 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.199217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16400934-09ae-4dae-a47c-3d021a55b445-cni-binary-copy\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.207788 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.207717 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgsp\" (UniqueName: \"kubernetes.io/projected/ae3b6e2c-f6a2-45af-bed1-32a2eb303504-kube-api-access-xrgsp\") pod \"iptables-alerter-k6dhd\" (UID: \"ae3b6e2c-f6a2-45af-bed1-32a2eb303504\") " pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.216596 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.216567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsgj\" (UniqueName: \"kubernetes.io/projected/ad27daf1-cbac-4048-96dd-0adc7f087dd1-kube-api-access-9rsgj\") pod \"aws-ebs-csi-driver-node-stgpx\" (UID: \"ad27daf1-cbac-4048-96dd-0adc7f087dd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.216774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.216751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58c8p\" (UniqueName: \"kubernetes.io/projected/16400934-09ae-4dae-a47c-3d021a55b445-kube-api-access-58c8p\") pod \"multus-additional-cni-plugins-7szbv\" (UID: \"16400934-09ae-4dae-a47c-3d021a55b445\") " pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.217089 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.217070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhxh\" (UniqueName: \"kubernetes.io/projected/abdb95d3-dfee-40c7-9f55-79764bd356ee-kube-api-access-clhxh\") pod \"node-ca-9bvmr\" (UID: \"abdb95d3-dfee-40c7-9f55-79764bd356ee\") " pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.217132 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.217092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cq76\" (UniqueName: \"kubernetes.io/projected/f21e77d2-2b45-4b8a-93d7-9fc4d59aec23-kube-api-access-6cq76\") pod \"node-resolver-lnkd6\" (UID: \"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23\") " pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.263381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.263342 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 21:01:39.281776 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.281741 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" Sep 09 21:01:39.288857 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.288830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:01:39.300454 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.300427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vq2g9" Sep 09 21:01:39.307250 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.307229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:01:39.313152 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.313126 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" Sep 09 21:01:39.318008 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.317986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnkd6" Sep 09 21:01:39.324835 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.324812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7szbv" Sep 09 21:01:39.332695 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.332469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k6dhd" Sep 09 21:01:39.338398 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.338375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bvmr" Sep 09 21:01:39.601566 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.601533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:39.601773 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.601661 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:39.601773 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.601755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:01:40.601735242 +0000 UTC m=+4.021508421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:39.647367 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.647335 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7064e13b_b7fc_4419_870a_fd56582ad5bb.slice/crio-673ba5e74b0e49c470d5dc9dfd7f770014f6b455ecdc4cbaba7c9e4bcf25da50 WatchSource:0}: Error finding container 673ba5e74b0e49c470d5dc9dfd7f770014f6b455ecdc4cbaba7c9e4bcf25da50: Status 404 returned error can't find the container with id 673ba5e74b0e49c470d5dc9dfd7f770014f6b455ecdc4cbaba7c9e4bcf25da50 Sep 09 21:01:39.648766 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.648540 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16400934_09ae_4dae_a47c_3d021a55b445.slice/crio-9a57c185df249baf389f87c1f44c65576fdf1aab9204960201aa592dcdf01139 WatchSource:0}: Error finding container 9a57c185df249baf389f87c1f44c65576fdf1aab9204960201aa592dcdf01139: Status 404 returned error can't find the container with id 9a57c185df249baf389f87c1f44c65576fdf1aab9204960201aa592dcdf01139 Sep 09 21:01:39.650459 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.650402 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdb95d3_dfee_40c7_9f55_79764bd356ee.slice/crio-a9a0103d126498472843e54ba6fd33f7de6d98ea1c8b2b52b9d7a16202ea493a WatchSource:0}: Error finding container a9a0103d126498472843e54ba6fd33f7de6d98ea1c8b2b52b9d7a16202ea493a: Status 404 returned error can't find the container with id a9a0103d126498472843e54ba6fd33f7de6d98ea1c8b2b52b9d7a16202ea493a Sep 09 21:01:39.673868 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.673835 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f66f5e_7af4_4907_963d_a0eee2716b9e.slice/crio-1a3db279d1e19a73d79edd4c25d7e0a4eac4c3067bad385471f6240249838949 WatchSource:0}: Error finding container 1a3db279d1e19a73d79edd4c25d7e0a4eac4c3067bad385471f6240249838949: Status 404 returned error can't find the container with id 1a3db279d1e19a73d79edd4c25d7e0a4eac4c3067bad385471f6240249838949 Sep 09 21:01:39.674753 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.674515 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad27daf1_cbac_4048_96dd_0adc7f087dd1.slice/crio-e54506b5d951881857c5d97d129ada8f7ade29d556c415be068a54e9fe1ba839 WatchSource:0}: Error finding container e54506b5d951881857c5d97d129ada8f7ade29d556c415be068a54e9fe1ba839: Status 404 returned error can't find the container with id e54506b5d951881857c5d97d129ada8f7ade29d556c415be068a54e9fe1ba839 Sep 09 21:01:39.675619 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.675597 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3b6e2c_f6a2_45af_bed1_32a2eb303504.slice/crio-8c09c94cb7f6aa13cb75f61d0f7675091e9687d179c46491e96ec105dd57989e WatchSource:0}: Error finding container 8c09c94cb7f6aa13cb75f61d0f7675091e9687d179c46491e96ec105dd57989e: Status 404 returned error can't find the container with id 8c09c94cb7f6aa13cb75f61d0f7675091e9687d179c46491e96ec105dd57989e Sep 09 21:01:39.676980 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.676761 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7731ac9c_4179_4f4f_8a5c_344262d7e141.slice/crio-6595c1e51d6e29fe2a942b57e18debb71bdb1edeee2fcb7558d3a813c2c77ed2 WatchSource:0}: Error finding container 6595c1e51d6e29fe2a942b57e18debb71bdb1edeee2fcb7558d3a813c2c77ed2: Status 404 returned error can't find the container with id 6595c1e51d6e29fe2a942b57e18debb71bdb1edeee2fcb7558d3a813c2c77ed2 Sep 09 21:01:39.678407 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.678315 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21e77d2_2b45_4b8a_93d7_9fc4d59aec23.slice/crio-6fbe97e911117fa7e550e112fe680f6761230b8f45baa0fef060f723b1ce7d2b WatchSource:0}: Error finding container 6fbe97e911117fa7e550e112fe680f6761230b8f45baa0fef060f723b1ce7d2b: Status 404 returned error can't find the container with id 6fbe97e911117fa7e550e112fe680f6761230b8f45baa0fef060f723b1ce7d2b Sep 09 21:01:39.680179 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:01:39.679182 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e25e491_7653_49b7_bf57_b0123eb7a7fc.slice/crio-d48a65371c5bacbc6ef7cd5f16f162e6421b00a2426c561dc9cc7c6b5b082876 WatchSource:0}: Error finding container d48a65371c5bacbc6ef7cd5f16f162e6421b00a2426c561dc9cc7c6b5b082876: Status 404 returned error can't find the container with id d48a65371c5bacbc6ef7cd5f16f162e6421b00a2426c561dc9cc7c6b5b082876 Sep 09 21:01:39.702044 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.701895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:39.702044 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:39.701950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702044 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702056 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702073 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702086 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702114 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:40.702096183 +0000 UTC m=+4.121869376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:39.702208 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:39.702130 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:40.702121651 +0000 UTC m=+4.121894828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:40.037621 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.037584 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:56:39 +0000 UTC" deadline="2028-06-02 13:51:43.19389825 +0000 UTC" Sep 09 21:01:40.037621 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.037616 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15160h50m3.156285478s" Sep 09 21:01:40.082048 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.082014 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:40.082201 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.082117 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:40.089541 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.089511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" event={"ID":"74f66f5e-7af4-4907-963d-a0eee2716b9e","Type":"ContainerStarted","Data":"1a3db279d1e19a73d79edd4c25d7e0a4eac4c3067bad385471f6240249838949"} Sep 09 21:01:40.090604 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.090578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bvmr" event={"ID":"abdb95d3-dfee-40c7-9f55-79764bd356ee","Type":"ContainerStarted","Data":"a9a0103d126498472843e54ba6fd33f7de6d98ea1c8b2b52b9d7a16202ea493a"} Sep 09 21:01:40.091659 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.091637 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerStarted","Data":"9a57c185df249baf389f87c1f44c65576fdf1aab9204960201aa592dcdf01139"} Sep 09 21:01:40.092908 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.092888 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vq2g9" event={"ID":"7731ac9c-4179-4f4f-8a5c-344262d7e141","Type":"ContainerStarted","Data":"6595c1e51d6e29fe2a942b57e18debb71bdb1edeee2fcb7558d3a813c2c77ed2"} Sep 09 21:01:40.094169 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.094147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k6dhd" event={"ID":"ae3b6e2c-f6a2-45af-bed1-32a2eb303504","Type":"ContainerStarted","Data":"8c09c94cb7f6aa13cb75f61d0f7675091e9687d179c46491e96ec105dd57989e"} Sep 09 21:01:40.095441 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.095415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"673ba5e74b0e49c470d5dc9dfd7f770014f6b455ecdc4cbaba7c9e4bcf25da50"} Sep 09 21:01:40.100444 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.098727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" event={"ID":"ea04a6b24f833108c08b618518cd306c","Type":"ContainerStarted","Data":"feaf9552755cd12ed1f73acb1386a7a00c3b10af979e8ba740117a16dda673d0"} Sep 09 21:01:40.103192 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.103170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rgr7z" event={"ID":"2e25e491-7653-49b7-bf57-b0123eb7a7fc","Type":"ContainerStarted","Data":"d48a65371c5bacbc6ef7cd5f16f162e6421b00a2426c561dc9cc7c6b5b082876"} Sep 09 21:01:40.104327 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.104302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnkd6" event={"ID":"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23","Type":"ContainerStarted","Data":"6fbe97e911117fa7e550e112fe680f6761230b8f45baa0fef060f723b1ce7d2b"} Sep 09 21:01:40.105558 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.105525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" event={"ID":"ad27daf1-cbac-4048-96dd-0adc7f087dd1","Type":"ContainerStarted","Data":"e54506b5d951881857c5d97d129ada8f7ade29d556c415be068a54e9fe1ba839"} Sep 09 21:01:40.607269 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.607227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:40.607446 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.607424 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:40.607533 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.607499 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:01:42.607478067 +0000 UTC m=+6.027251249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.708684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:40.708743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.708981 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.709046 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:42.709026935 +0000 UTC m=+6.128800129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.709450 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.709471 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.709484 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:40.709574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:40.709531 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:42.709515479 +0000 UTC m=+6.129288671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:41.038173 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.038110 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:56:39 +0000 UTC" deadline="2028-03-20 07:01:38.614652196 +0000 UTC" Sep 09 21:01:41.038173 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.038170 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13377h59m57.576486001s" Sep 09 21:01:41.081844 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.081812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:41.082038 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.081823 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:41.082038 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:41.081960 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:41.082038 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:41.082019 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:41.121318 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.121282 2580 generic.go:356] "Generic (PLEG): container finished" podID="ea04a6b24f833108c08b618518cd306c" containerID="feaf9552755cd12ed1f73acb1386a7a00c3b10af979e8ba740117a16dda673d0" exitCode=0 Sep 09 21:01:41.121484 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.121371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" event={"ID":"ea04a6b24f833108c08b618518cd306c","Type":"ContainerDied","Data":"feaf9552755cd12ed1f73acb1386a7a00c3b10af979e8ba740117a16dda673d0"} Sep 09 21:01:41.128787 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:41.128263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" event={"ID":"796a00e702ae2d3b69b1ebe3e73739bc","Type":"ContainerStarted","Data":"07362b51a7178e91338f0198d4c44a39ee360b84870a44ca3a7f97bb7a0a8149"} Sep 09 21:01:42.082096 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.082062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:42.082560 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.082202 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:42.143731 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.143580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" event={"ID":"ea04a6b24f833108c08b618518cd306c","Type":"ContainerStarted","Data":"bad36ab5c3289b8e5598dad1b602526a90fd45737ada547da8cc8969ccea2ca8"} Sep 09 21:01:42.163774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.162996 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-243.ec2.internal" podStartSLOduration=4.162972815 podStartE2EDuration="4.162972815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:41.16216898 +0000 UTC m=+4.581942180" watchObservedRunningTime="2026-09-09 21:01:42.162972815 +0000 UTC m=+5.582746016" Sep 09 21:01:42.624570 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.624528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:42.624812 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.624725 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:42.624812 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.624788 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:01:46.624769194 +0000 UTC m=+10.044542385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:42.725789 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.725728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:42.725789 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:42.725784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:42.726046 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.725901 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:42.726046 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.725964 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:46.725946166 +0000 UTC m=+10.145719346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:42.726383 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.726352 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:42.726383 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.726382 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:42.726516 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.726394 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:42.726516 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:42.726437 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:46.726422095 +0000 UTC m=+10.146195277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:43.083033 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:43.082777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:43.083033 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:43.082895 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:43.083033 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:43.082906 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:43.083033 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:43.083026 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:44.082254 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:44.082201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:44.082444 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:44.082330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:45.082749 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:45.082186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:45.082749 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:45.082270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:45.082749 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:45.082449 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:45.082749 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:45.082573 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:46.082449 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:46.082415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:46.082623 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.082550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:46.657287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:46.657178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:46.657734 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.657382 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:46.657734 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.657456 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:01:54.657437343 +0000 UTC m=+18.077210536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:46.758303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:46.758355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758468 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758501 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758525 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:54.758509531 +0000 UTC m=+18.178282734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758532 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758546 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:46.758905 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:46.758598 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:01:54.758583099 +0000 UTC m=+18.178356295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:47.083503 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:47.083472 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:47.083709 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:47.083595 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:47.084071 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:47.084051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:47.084175 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:47.084155 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:48.082570 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:48.082538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:48.083034 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:48.082726 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:49.082807 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:49.082778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:49.083233 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:49.082887 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:49.083233 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:49.082782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:49.083233 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:49.083180 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:50.082103 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:50.082063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:50.082278 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:50.082219 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:51.084467 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:51.084376 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:51.084467 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:51.084401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:51.084972 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:51.084512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:51.084972 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:51.084620 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:52.081998 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:52.081964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:52.082179 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:52.082094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:53.082518 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:53.082421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:53.083054 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:53.082568 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:53.083054 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:53.082621 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:53.083054 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:53.082734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:54.082194 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:54.082155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:54.082375 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.082263 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:54.720367 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:54.720277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:54.720845 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.720450 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:54.720845 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.720517 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:02:10.720501008 +0000 UTC m=+34.140274188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:01:54.821385 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:54.821354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:54.821385 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:54.821393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821499 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821519 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821546 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:10.821537547 +0000 UTC m=+34.241310723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821560 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:54.821624 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:54.821608 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:10.821592386 +0000 UTC m=+34.241365581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:01:55.081878 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:55.081847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:55.081878 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:55.081874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:55.082124 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:55.081996 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:55.082124 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:55.082004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:56.082187 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:56.082155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:56.082589 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:56.082277 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:57.083342 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:57.083303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:57.083801 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:57.083430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:57.083801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:57.083496 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:57.083801 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:57.083625 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:58.082057 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:58.082021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:01:58.082254 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:58.082148 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:01:59.082143 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.081956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:01:59.083206 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.082021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:01:59.083206 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:59.082222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:01:59.083206 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:01:59.082316 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:01:59.183438 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.183405 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bvmr" event={"ID":"abdb95d3-dfee-40c7-9f55-79764bd356ee","Type":"ContainerStarted","Data":"37346aa596ec5637d0b01ae464a30ccc5da1c628e23bca31773487ec4cd2f0d5"} Sep 09 21:01:59.185192 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.185166 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="687fa36ff13dfbeba1a24563f1621eabde8105c27db91c823e7f45bc2cc38f0c" exitCode=0 Sep 09 21:01:59.185325 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.185236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"687fa36ff13dfbeba1a24563f1621eabde8105c27db91c823e7f45bc2cc38f0c"} Sep 09 21:01:59.186741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.186718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vq2g9" event={"ID":"7731ac9c-4179-4f4f-8a5c-344262d7e141","Type":"ContainerStarted","Data":"b7a1d0606a2aa0f52eb3873fe27ebff02b4e6bbb051574f1a1938744a07b63ba"} Sep 09 21:01:59.189999 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.189978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"cf74a65a825dbb43d5e9727da8d466e39305311dbb438ad9e2f2ce93f48ad416"} Sep 09 21:01:59.190085 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.190052 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"ef03f5d46f083504fe0575b8f0ebbd9cc6739048ab9fbab541f88f6f90298ebe"} Sep 09 21:01:59.190141 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.190103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"e9a3fd5b2fece9dd9e6387bb472689e24f3352ac93190e177ea2ddc6768b2c0c"} Sep 09 21:01:59.190177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.190151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"0b7d64ce86335335878b3b45dc99a754b613156284598a6ea7f6bfa9dc624709"} Sep 09 21:01:59.190216 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.190201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"9ec7e333b26a90ad2cad04d85fd67b366b2ef2330d454a2db4ebb5edcbb9483a"} Sep 09 21:01:59.190250 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.190230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"dc1b94f7653ce4638c0ec2d8fdbc203d039b7c2c7843dd939864685d580f9f17"} Sep 09 21:01:59.191437 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.191415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rgr7z" event={"ID":"2e25e491-7653-49b7-bf57-b0123eb7a7fc","Type":"ContainerStarted","Data":"271f895fa45f4506a368412f864cc55d0ab5059426881f70a1cbe0c727100b97"} Sep 09 21:01:59.192923 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.192900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnkd6" event={"ID":"f21e77d2-2b45-4b8a-93d7-9fc4d59aec23","Type":"ContainerStarted","Data":"dd3de702ae488df8845bcb8d9fa66083655a670cc6f64e77974371be9edf7157"} Sep 09 21:01:59.194309 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.194289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" event={"ID":"ad27daf1-cbac-4048-96dd-0adc7f087dd1","Type":"ContainerStarted","Data":"463a7baf1cbdbd0e2b0dd57e31bfa77df5c46f5b6cb6822bb0105e0a724504b4"} Sep 09 21:01:59.195644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.195620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" event={"ID":"74f66f5e-7af4-4907-963d-a0eee2716b9e","Type":"ContainerStarted","Data":"30d28146da2ac6c5608b2ec5b9ad6478372b5e814991ed9e426b80b3332faa72"} Sep 09 21:01:59.205104 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.205062 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-243.ec2.internal" podStartSLOduration=21.205049953 podStartE2EDuration="21.205049953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:42.163741027 +0000 UTC m=+5.583514229" watchObservedRunningTime="2026-09-09 21:01:59.205049953 +0000 UTC m=+22.624823151" Sep 09 21:01:59.205459 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.205436 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bvmr" podStartSLOduration=3.75140831 podStartE2EDuration="22.205429915s" totalImagesPullingTime="18.454021605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:59.203848599 +0000 UTC m=+22.623621808" watchObservedRunningTime="2026-09-09 21:01:59.205429915 +0000 UTC m=+22.625203160" Sep 09 21:01:59.260984 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.260724 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vq2g9" podStartSLOduration=3.745748768 podStartE2EDuration="22.260704741s" totalImagesPullingTime="18.514955973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:59.232773561 +0000 UTC m=+22.652546761" watchObservedRunningTime="2026-09-09 21:01:59.260704741 +0000 UTC m=+22.680477944" Sep 09 21:01:59.261195 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.261164 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rgr7z" podStartSLOduration=3.820583879 podStartE2EDuration="22.261152371s" totalImagesPullingTime="18.440568492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:59.260463689 +0000 UTC m=+22.680236907" watchObservedRunningTime="2026-09-09 21:01:59.261152371 +0000 UTC m=+22.680925572" Sep 09 21:01:59.316398 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.316337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lnkd6" podStartSLOduration=3.8756679419999998 podStartE2EDuration="22.316315267s" totalImagesPullingTime="18.440647325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:59.283949516 +0000 UTC m=+22.703722715" watchObservedRunningTime="2026-09-09 21:01:59.316315267 +0000 UTC m=+22.736088467" Sep 09 21:01:59.340508 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.340407 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvgxz" podStartSLOduration=3.897822261 podStartE2EDuration="22.34038702s" totalImagesPullingTime="18.442564759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:59.339881787 +0000 UTC m=+22.759654992" watchObservedRunningTime="2026-09-09 21:01:59.34038702 +0000 UTC m=+22.760160225" Sep 09 21:01:59.591631 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:01:59.591544 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 21:02:00.058425 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.058241 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T21:01:59.591568013Z","UUID":"5e094101-412c-4b94-b5b4-05e272afa2ac","Handler":null,"Name":"","Endpoint":""} Sep 09 21:02:00.059986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.059961 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 21:02:00.060136 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.060000 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 21:02:00.082545 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.082518 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:00.083040 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:00.082628 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:00.201574 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.201497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k6dhd" event={"ID":"ae3b6e2c-f6a2-45af-bed1-32a2eb303504","Type":"ContainerStarted","Data":"d3de95cd75aeeeaaf129d1752017525a84c07c19788848f88508f850eaae74cf"} Sep 09 21:02:00.204775 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.204706 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" event={"ID":"ad27daf1-cbac-4048-96dd-0adc7f087dd1","Type":"ContainerStarted","Data":"f508486081f3aabe89d0ea97c4cf475a25f374165ee64abe39740616dd4f9454"} Sep 09 21:02:00.225848 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:00.225794 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k6dhd" podStartSLOduration=4.763790295 podStartE2EDuration="23.225779926s" totalImagesPullingTime="18.461989631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:00.225500777 +0000 UTC m=+23.645273975" watchObservedRunningTime="2026-09-09 21:02:00.225779926 +0000 UTC m=+23.645553124" Sep 09 21:02:01.082513 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:01.082483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:01.082653 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:01.082629 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:01.082995 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:01.082919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:01.083054 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:01.083032 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:01.212634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:01.212539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"652070db6cb6b2a5db558f521242cd9744eb612cc3ab7c7521b7a71b9bf01f00"} Sep 09 21:02:01.215714 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:01.215128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" event={"ID":"ad27daf1-cbac-4048-96dd-0adc7f087dd1","Type":"ContainerStarted","Data":"db01fdc1527624c4f63aa94be5e9269c0e7843587f2cdec06eff312063ab7472"} Sep 09 21:02:01.239485 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:01.239433 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stgpx" podStartSLOduration=3.283186906 podStartE2EDuration="24.239392126s" totalImagesPullingTime="20.95620522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:01.237921693 +0000 UTC m=+24.657694893" watchObservedRunningTime="2026-09-09 21:02:01.239392126 +0000 UTC m=+24.659165322" Sep 09 21:02:02.082139 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:02.082105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:02.082331 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:02.082210 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:03.081708 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.081652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:03.081708 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.081698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:03.082264 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:03.081815 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:03.082264 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:03.081927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:03.148582 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.148546 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:02:03.149262 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.149241 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:02:03.220959 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.220930 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:02:03.221434 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:03.221415 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rgr7z" Sep 09 21:02:04.082092 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:04.081905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:04.083120 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:04.082165 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:04.224523 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:04.224485 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="56bac6155d2827608b65aff155bb1ecce32c37c5737917960a0e617b9016aebc" exitCode=0 Sep 09 21:02:04.224700 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:04.224566 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"56bac6155d2827608b65aff155bb1ecce32c37c5737917960a0e617b9016aebc"} Sep 09 21:02:04.228701 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:04.228656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" event={"ID":"7064e13b-b7fc-4419-870a-fd56582ad5bb","Type":"ContainerStarted","Data":"98a90b3af76a4ed05df7c37351bc1a09032568e40189415b0c190dcd6ef3ed9a"} Sep 09 21:02:05.082692 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.082641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:05.082692 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.082658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:05.083278 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:05.082778 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:05.083278 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:05.082922 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:05.231800 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.231769 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:05.231981 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.231855 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:05.231981 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.231907 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:05.247424 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.247400 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:05.247572 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.247508 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:05.281783 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.281733 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" podStartSLOduration=9.76372096 podStartE2EDuration="28.281717395s" totalImagesPullingTime="18.517996435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:04.294116414 +0000 UTC m=+27.713889612" watchObservedRunningTime="2026-09-09 21:02:05.281717395 +0000 UTC m=+28.701490595" Sep 09 21:02:05.736240 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.736013 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqq5t"] Sep 09 21:02:05.736497 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.736366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:05.736497 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:05.736452 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:05.736717 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.736696 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77bkx"] Sep 09 21:02:05.736817 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.736805 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:05.736904 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:05.736888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:05.743011 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.742919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smz62"] Sep 09 21:02:05.743107 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:05.743015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:05.743155 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:05.743111 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:07.082343 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:07.082320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:07.082721 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:07.082404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:07.082721 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:07.082405 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:07.082721 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:07.082534 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:07.237985 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:07.237953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerStarted","Data":"af7cf477d6b3adbc4defb41ba2264733cdc284ff97d11ae374972f23a25e67c2"} Sep 09 21:02:08.082377 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:08.082346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:08.082777 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:08.082456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:08.242848 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:08.242763 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="af7cf477d6b3adbc4defb41ba2264733cdc284ff97d11ae374972f23a25e67c2" exitCode=0 Sep 09 21:02:08.242848 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:08.242816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"af7cf477d6b3adbc4defb41ba2264733cdc284ff97d11ae374972f23a25e67c2"} Sep 09 21:02:09.082112 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:09.082074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:09.082112 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:09.082066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:09.082355 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:09.082202 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wqq5t" podUID="4f4d7be3-b403-480c-b0bd-83b8771d6a17" Sep 09 21:02:09.082355 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:09.082317 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smz62" podUID="0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4" Sep 09 21:02:10.082789 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.082570 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:10.083178 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.082869 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77bkx" podUID="3f66cadf-60bf-4889-8aaa-8e7799cfe0ac" Sep 09 21:02:10.250423 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.250392 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="b21e2bc12cdcc5706df086b03ca76cbb20cd32ccc78d250e8838f38d1b240a8f" exitCode=0 Sep 09 21:02:10.250592 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.250443 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"b21e2bc12cdcc5706df086b03ca76cbb20cd32ccc78d250e8838f38d1b240a8f"} Sep 09 21:02:10.738129 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.738096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:10.738282 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.738204 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:02:10.738282 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.738254 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.738240706 +0000 UTC m=+66.158013882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 21:02:10.839282 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.839244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.839292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839387 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839405 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839423 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839437 2580 projected.go:196] Error preparing data for projected volume kube-api-access-2xr7j for pod openshift-network-diagnostics/network-check-target-wqq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:02:10.839467 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret podName:0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.839435906 +0000 UTC m=+66.259209100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret") pod "global-pull-secret-syncer-smz62" (UID: "0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4") : object "kube-system"/"original-pull-secret" not registered Sep 09 21:02:10.839804 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:10.839476 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j podName:4f4d7be3-b403-480c-b0bd-83b8771d6a17 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.83946559 +0000 UTC m=+66.259238766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xr7j" (UniqueName: "kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j") pod "network-check-target-wqq5t" (UID: "4f4d7be3-b403-480c-b0bd-83b8771d6a17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 21:02:10.917171 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.917094 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-243.ec2.internal" event="NodeReady" Sep 09 21:02:10.917326 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.917263 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 21:02:10.970278 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.970247 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-95lwl"] Sep 09 21:02:10.987910 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.987876 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bjwpr"] Sep 09 21:02:10.988083 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.988017 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:10.990510 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.990462 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 21:02:10.990645 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.990524 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 21:02:10.990645 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.990608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9vjrs\"" Sep 09 21:02:10.998651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.998630 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjwpr"] Sep 09 21:02:10.998766 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.998688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95lwl"] Sep 09 21:02:10.998766 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:10.998759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.001584 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.001563 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 21:02:11.001722 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.001588 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 21:02:11.001722 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.001686 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 21:02:11.001722 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.001563 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c4rmk\"" Sep 09 21:02:11.081682 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.081648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:11.081855 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.081648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:11.084836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.084682 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 21:02:11.084836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.084722 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 21:02:11.084836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.084770 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zv66x\"" Sep 09 21:02:11.085316 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.084852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 21:02:11.142425 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-tmp-dir\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.142425 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.142627 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8rs6\" (UniqueName: \"kubernetes.io/projected/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-kube-api-access-p8rs6\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.142627 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25c125c-6323-4dc6-a41b-11407e40e6e8-cert\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.142627 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvnkr\" (UniqueName: \"kubernetes.io/projected/a25c125c-6323-4dc6-a41b-11407e40e6e8-kube-api-access-tvnkr\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.142627 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.142614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-config-volume\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.243767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.243738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-config-volume\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.243949 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.243785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-tmp-dir\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.243949 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.243812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.243949 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.243837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8rs6\" (UniqueName: \"kubernetes.io/projected/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-kube-api-access-p8rs6\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.243949 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:11.243929 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:11.244111 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:11.243993 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:11.743971813 +0000 UTC m=+35.163744994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:11.244111 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.244012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25c125c-6323-4dc6-a41b-11407e40e6e8-cert\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.244111 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.244035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvnkr\" (UniqueName: \"kubernetes.io/projected/a25c125c-6323-4dc6-a41b-11407e40e6e8-kube-api-access-tvnkr\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.244276 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.244148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-tmp-dir\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.244440 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.244419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-config-volume\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.248308 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.248285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25c125c-6323-4dc6-a41b-11407e40e6e8-cert\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.253173 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.253143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8rs6\" (UniqueName: \"kubernetes.io/projected/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-kube-api-access-p8rs6\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.253572 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.253554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvnkr\" (UniqueName: \"kubernetes.io/projected/a25c125c-6323-4dc6-a41b-11407e40e6e8-kube-api-access-tvnkr\") pod \"ingress-canary-bjwpr\" (UID: \"a25c125c-6323-4dc6-a41b-11407e40e6e8\") " pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.307479 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.307448 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjwpr" Sep 09 21:02:11.621933 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.621899 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjwpr"] Sep 09 21:02:11.625641 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:02:11.625598 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25c125c_6323_4dc6_a41b_11407e40e6e8.slice/crio-da434847d2a3bfc003192c07eaf241f0662632bfd49cda67aa5cbc42c8093dc5 WatchSource:0}: Error finding container da434847d2a3bfc003192c07eaf241f0662632bfd49cda67aa5cbc42c8093dc5: Status 404 returned error can't find the container with id da434847d2a3bfc003192c07eaf241f0662632bfd49cda67aa5cbc42c8093dc5 Sep 09 21:02:11.748556 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:11.748513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:11.748762 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:11.748691 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:11.748823 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:11.748773 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:12.748751969 +0000 UTC m=+36.168525158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:12.082548 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:12.082510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:12.085703 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:12.085652 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 21:02:12.085703 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:12.085659 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgvxk\"" Sep 09 21:02:12.257972 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:12.257930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjwpr" event={"ID":"a25c125c-6323-4dc6-a41b-11407e40e6e8","Type":"ContainerStarted","Data":"da434847d2a3bfc003192c07eaf241f0662632bfd49cda67aa5cbc42c8093dc5"} Sep 09 21:02:12.756572 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:12.756532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:12.756799 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:12.756729 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:12.756871 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:12.756808 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:14.756784858 +0000 UTC m=+38.176558036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:14.772270 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:14.771982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:14.772733 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:14.772184 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:14.772733 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:14.772437 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:18.7724166 +0000 UTC m=+42.192189796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:16.269392 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:16.269354 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjwpr" event={"ID":"a25c125c-6323-4dc6-a41b-11407e40e6e8","Type":"ContainerStarted","Data":"2fefaca7157bc1c0cfc7927523782e5fa8ce20ce3cf0d651ff2f487cb5afa725"} Sep 09 21:02:16.272217 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:16.272185 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="1ba53c209ac39d6dc264a17534d707643298afdaee1b8c115ad399449364e06c" exitCode=0 Sep 09 21:02:16.272358 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:16.272225 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"1ba53c209ac39d6dc264a17534d707643298afdaee1b8c115ad399449364e06c"} Sep 09 21:02:16.288399 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:16.288357 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bjwpr" podStartSLOduration=1.9540346739999999 podStartE2EDuration="6.288344465s" totalImagesPullingTime="4.334309791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:16.287392131 +0000 UTC m=+39.707165331" watchObservedRunningTime="2026-09-09 21:02:16.288344465 +0000 UTC m=+39.708117663" Sep 09 21:02:17.277876 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:17.277837 2580 generic.go:356] "Generic (PLEG): container finished" podID="16400934-09ae-4dae-a47c-3d021a55b445" containerID="dba40e7096021d219ea90b8be6e3610c03acea5f1e99b6d39f95007b9e8595c4" exitCode=0 Sep 09 21:02:17.278253 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:17.277923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerDied","Data":"dba40e7096021d219ea90b8be6e3610c03acea5f1e99b6d39f95007b9e8595c4"} Sep 09 21:02:18.283700 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:18.283654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7szbv" event={"ID":"16400934-09ae-4dae-a47c-3d021a55b445","Type":"ContainerStarted","Data":"e4ba04c38eafb805226840cbd49cc3d2c51a3b626b2c490189293cc1792ccc6b"} Sep 09 21:02:18.316947 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:18.316904 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7szbv" podStartSLOduration=8.461797748 podStartE2EDuration="41.316887587s" totalImagesPullingTime="32.855089839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:18.314423471 +0000 UTC m=+41.734196669" watchObservedRunningTime="2026-09-09 21:02:18.316887587 +0000 UTC m=+41.736660786" Sep 09 21:02:18.799886 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:18.799850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:18.800053 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:18.799999 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:18.800102 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:18.800059 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:26.800044936 +0000 UTC m=+50.219818129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:26.857716 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:26.857647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:26.858109 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:26.857819 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:26.858109 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:26.857883 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.857869148 +0000 UTC m=+66.277642325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:34.208964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.208929 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc"] Sep 09 21:02:34.210888 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.210873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.214222 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.214189 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 09 21:02:34.214340 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.214194 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rg2pw\"" Sep 09 21:02:34.215353 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.215336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 09 21:02:34.215408 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.215336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 09 21:02:34.223712 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.223688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc"] Sep 09 21:02:34.308055 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.308023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.308208 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.308065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlgs\" (UniqueName: \"kubernetes.io/projected/325e88d2-9a38-412c-a31e-2f021e4e4f99-kube-api-access-7vlgs\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.322133 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.322107 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7848747c5b-jlb55"] Sep 09 21:02:34.324192 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.324174 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs"] Sep 09 21:02:34.324318 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.324301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.325945 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.325925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.327655 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.327636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 09 21:02:34.327895 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.327880 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 21:02:34.328003 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.327900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 09 21:02:34.328313 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.328298 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 09 21:02:34.328401 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.328388 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 09 21:02:34.328713 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.328698 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 21:02:34.330287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.330158 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lp7lt\"" Sep 09 21:02:34.330287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.330181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 21:02:34.330287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.330196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 21:02:34.330287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.330214 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 21:02:34.330287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.330238 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 21:02:34.331203 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.331184 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nz59z\"" Sep 09 21:02:34.342522 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.342501 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs"] Sep 09 21:02:34.347446 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.347425 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7848747c5b-jlb55"] Sep 09 21:02:34.408468 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.408434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.408658 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.408480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlgs\" (UniqueName: \"kubernetes.io/projected/325e88d2-9a38-412c-a31e-2f021e4e4f99-kube-api-access-7vlgs\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.408658 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.408575 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 21:02:34.408658 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.408633 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls podName:325e88d2-9a38-412c-a31e-2f021e4e4f99 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:34.908616858 +0000 UTC m=+58.328390055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-ztkhc" (UID: "325e88d2-9a38-412c-a31e-2f021e4e4f99") : secret "samples-operator-tls" not found Sep 09 21:02:34.416822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.416797 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq"] Sep 09 21:02:34.418812 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.418773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.421312 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.421272 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 21:02:34.421312 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.421275 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6tdn7\"" Sep 09 21:02:34.421462 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.421385 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 21:02:34.421905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.421890 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 21:02:34.422020 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.422003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 21:02:34.424527 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.424509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlgs\" (UniqueName: \"kubernetes.io/projected/325e88d2-9a38-412c-a31e-2f021e4e4f99-kube-api-access-7vlgs\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.433586 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.433562 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq"] Sep 09 21:02:34.509585 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.509585 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk5p6\" (UniqueName: \"kubernetes.io/projected/a70d1270-3709-4551-8f46-1f9a0fe195e2-kube-api-access-nk5p6\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-stats-auth\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c85e21d0-edbd-4339-90ce-804a99e119f8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prljk\" (UniqueName: \"kubernetes.io/projected/c85e21d0-edbd-4339-90ce-804a99e119f8-kube-api-access-prljk\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.509809 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7kwr\" (UniqueName: \"kubernetes.io/projected/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-kube-api-access-q7kwr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.509991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.509991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.509991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.509900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-default-certificate\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611126 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611126 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611255 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-default-certificate\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611255 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.611255 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk5p6\" (UniqueName: \"kubernetes.io/projected/a70d1270-3709-4551-8f46-1f9a0fe195e2-kube-api-access-nk5p6\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611255 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.611244 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.611269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:35.111252016 +0000 UTC m=+58.531025194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.611317 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:35.111297643 +0000 UTC m=+58.531070840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.611318 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.611359 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:35.111346741 +0000 UTC m=+58.531119922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-stats-auth\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.611430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c85e21d0-edbd-4339-90ce-804a99e119f8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.611956 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prljk\" (UniqueName: \"kubernetes.io/projected/c85e21d0-edbd-4339-90ce-804a99e119f8-kube-api-access-prljk\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.611956 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7kwr\" (UniqueName: \"kubernetes.io/projected/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-kube-api-access-q7kwr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.612049 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.611963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.612410 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.612389 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c85e21d0-edbd-4339-90ce-804a99e119f8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.613932 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.613910 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-stats-auth\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.614052 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.614035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.614166 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.614151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-default-certificate\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.621022 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.620995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk5p6\" (UniqueName: \"kubernetes.io/projected/a70d1270-3709-4551-8f46-1f9a0fe195e2-kube-api-access-nk5p6\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:34.621348 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.621325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7kwr\" (UniqueName: \"kubernetes.io/projected/13bfe6a6-4bf2-423a-a68a-b41019d1f2cc-kube-api-access-q7kwr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l97gq\" (UID: \"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.621896 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.621876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prljk\" (UniqueName: \"kubernetes.io/projected/c85e21d0-edbd-4339-90ce-804a99e119f8-kube-api-access-prljk\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:34.732285 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.732236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" Sep 09 21:02:34.914102 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:34.914070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:34.914276 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.914189 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 21:02:34.914276 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:34.914244 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls podName:325e88d2-9a38-412c-a31e-2f021e4e4f99 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:35.914228523 +0000 UTC m=+59.334001713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-ztkhc" (UID: "325e88d2-9a38-412c-a31e-2f021e4e4f99") : secret "samples-operator-tls" not found Sep 09 21:02:35.012438 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.012324 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq"] Sep 09 21:02:35.014817 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:02:35.014792 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bfe6a6_4bf2_423a_a68a_b41019d1f2cc.slice/crio-0ba0627cf6b1ea59f4a4fb372da5e19b036390bc88e39ac2e7d5bec3783211c8 WatchSource:0}: Error finding container 0ba0627cf6b1ea59f4a4fb372da5e19b036390bc88e39ac2e7d5bec3783211c8: Status 404 returned error can't find the container with id 0ba0627cf6b1ea59f4a4fb372da5e19b036390bc88e39ac2e7d5bec3783211c8 Sep 09 21:02:35.115236 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.115143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:35.115236 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.115179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:35.115236 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.115203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:35.115510 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.115309 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:35.115510 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.115313 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:35.115510 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.115377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:36.115352635 +0000 UTC m=+59.535125825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:35.115510 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.115401 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:36.115392735 +0000 UTC m=+59.535165918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:35.115510 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.115416 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:36.115407785 +0000 UTC m=+59.535180967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:35.322561 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.322526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" event={"ID":"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc","Type":"ContainerStarted","Data":"0ba0627cf6b1ea59f4a4fb372da5e19b036390bc88e39ac2e7d5bec3783211c8"} Sep 09 21:02:35.920331 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:35.920294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:35.920518 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.920495 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 21:02:35.920590 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:35.920578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls podName:325e88d2-9a38-412c-a31e-2f021e4e4f99 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:37.920555895 +0000 UTC m=+61.340329077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-ztkhc" (UID: "325e88d2-9a38-412c-a31e-2f021e4e4f99") : secret "samples-operator-tls" not found Sep 09 21:02:36.121786 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:36.121753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:36.121956 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:36.121794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:36.121956 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:36.121819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:36.121956 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:36.121930 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:36.121956 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:36.121939 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:36.121956 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:36.121950 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:38.121929045 +0000 UTC m=+61.541702247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:36.122217 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:36.121985 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:38.121970185 +0000 UTC m=+61.541743385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:36.122217 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:36.122006 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:38.121994931 +0000 UTC m=+61.541768108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:37.256096 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:37.256066 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5r84f" Sep 09 21:02:37.938099 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:37.938063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:37.938249 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:37.938208 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 21:02:37.938305 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:37.938271 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls podName:325e88d2-9a38-412c-a31e-2f021e4e4f99 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:41.938254627 +0000 UTC m=+65.358027825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-ztkhc" (UID: "325e88d2-9a38-412c-a31e-2f021e4e4f99") : secret "samples-operator-tls" not found Sep 09 21:02:38.139754 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:38.139719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:38.139939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:38.139768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:38.139939 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:38.139802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:38.139939 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:38.139889 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.139871348 +0000 UTC m=+65.559644541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:38.139939 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:38.139920 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:38.139939 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:38.139931 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:38.140147 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:38.139985 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.139968132 +0000 UTC m=+65.559741328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:38.140147 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:38.140001 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:42.139993565 +0000 UTC m=+65.559766741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:38.331630 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:38.331594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" event={"ID":"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc","Type":"ContainerStarted","Data":"b254f1b5570d2c24fd6cb09c9cd44d04933528c90296240da2fa17956722212e"} Sep 09 21:02:38.353391 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:38.353340 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" podStartSLOduration=1.913723338 podStartE2EDuration="4.353319678s" totalImagesPullingTime="2.43959634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:38.352418461 +0000 UTC m=+61.772191660" watchObservedRunningTime="2026-09-09 21:02:38.353319678 +0000 UTC m=+61.773092877" Sep 09 21:02:39.582682 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.582649 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bjzmj"] Sep 09 21:02:39.584587 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.584571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.587801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.587782 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 21:02:39.588483 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.588461 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 21:02:39.588810 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.588792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 21:02:39.588938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.588912 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2hhmg\"" Sep 09 21:02:39.592292 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.592276 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 21:02:39.618857 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.618823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjzmj"] Sep 09 21:02:39.753380 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.753339 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73b87e2f-9452-49ad-9e98-7cdf32040b8b-crio-socket\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.753555 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.753388 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73b87e2f-9452-49ad-9e98-7cdf32040b8b-data-volume\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.753555 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.753466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.753555 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.753489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxqd\" (UniqueName: \"kubernetes.io/projected/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-api-access-lrxqd\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.753555 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.753519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854839 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73b87e2f-9452-49ad-9e98-7cdf32040b8b-crio-socket\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854839 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73b87e2f-9452-49ad-9e98-7cdf32040b8b-data-volume\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854972 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854972 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxqd\" (UniqueName: \"kubernetes.io/projected/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-api-access-lrxqd\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854972 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73b87e2f-9452-49ad-9e98-7cdf32040b8b-crio-socket\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854972 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.854922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.854972 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:39.854957 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 21:02:39.855124 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:39.855028 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:40.355010748 +0000 UTC m=+63.774783943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : configmap "kube-rbac-proxy" not found Sep 09 21:02:39.855124 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:39.855052 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:39.855124 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:39.855106 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:40.355091004 +0000 UTC m=+63.774864201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:39.855224 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.855183 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73b87e2f-9452-49ad-9e98-7cdf32040b8b-data-volume\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:39.864466 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:39.864446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxqd\" (UniqueName: \"kubernetes.io/projected/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-api-access-lrxqd\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:40.359696 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:40.359654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:40.359831 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:40.359715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:40.359831 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:40.359780 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 21:02:40.359831 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:40.359813 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:40.359944 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:40.359838 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:41.35982155 +0000 UTC m=+64.779594745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : configmap "kube-rbac-proxy" not found Sep 09 21:02:40.359944 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:40.359870 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:41.359857688 +0000 UTC m=+64.779630882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:41.367624 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:41.367583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:41.367624 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:41.367637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:41.368146 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.367730 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 21:02:41.368146 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.367735 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:41.368146 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.367806 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:43.367784113 +0000 UTC m=+66.787557308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : configmap "kube-rbac-proxy" not found Sep 09 21:02:41.368146 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.367842 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:43.367831941 +0000 UTC m=+66.787605119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:41.971525 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:41.971475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:41.971711 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.971623 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 21:02:41.971777 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:41.971711 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls podName:325e88d2-9a38-412c-a31e-2f021e4e4f99 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:49.971690595 +0000 UTC m=+73.391463790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-ztkhc" (UID: "325e88d2-9a38-412c-a31e-2f021e4e4f99") : secret "samples-operator-tls" not found Sep 09 21:02:42.173420 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.173374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:42.173616 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.173428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:42.173616 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.173527 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:42.173616 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.173549 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:50.173527464 +0000 UTC m=+73.593300657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:42.173616 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.173578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:50.173563732 +0000 UTC m=+73.593336927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:42.173872 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.173616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:42.173872 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.173784 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:42.173872 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.173841 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:02:50.173826787 +0000 UTC m=+73.593599984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:42.337252 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.337225 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnkd6_f21e77d2-2b45-4b8a-93d7-9fc4d59aec23/dns-node-resolver/0.log" Sep 09 21:02:42.779286 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.779254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:02:42.782068 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.782042 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 21:02:42.790465 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.790446 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 21:02:42.790580 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.790507 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs podName:3f66cadf-60bf-4889-8aaa-8e7799cfe0ac nodeName:}" failed. No retries permitted until 2026-09-09 21:03:46.790486268 +0000 UTC m=+130.210259459 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs") pod "network-metrics-daemon-77bkx" (UID: "3f66cadf-60bf-4889-8aaa-8e7799cfe0ac") : secret "metrics-daemon-secret" not found Sep 09 21:02:42.880340 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.880302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:02:42.880605 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.880349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:42.880605 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.880452 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 21:02:42.880605 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.880478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:42.880605 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:42.880517 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls podName:c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9 nodeName:}" failed. No retries permitted until 2026-09-09 21:03:14.880501772 +0000 UTC m=+98.300274950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls") pod "dns-default-95lwl" (UID: "c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9") : secret "dns-default-metrics-tls" not found Sep 09 21:02:42.883481 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.883463 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 21:02:42.883530 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.883483 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 21:02:42.893329 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.893308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4-original-pull-secret\") pod \"global-pull-secret-syncer-smz62\" (UID: \"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4\") " pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:42.893643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.893629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 21:02:42.899813 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.899795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smz62" Sep 09 21:02:42.904249 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:42.904216 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xr7j\" (UniqueName: \"kubernetes.io/projected/4f4d7be3-b403-480c-b0bd-83b8771d6a17-kube-api-access-2xr7j\") pod \"network-check-target-wqq5t\" (UID: \"4f4d7be3-b403-480c-b0bd-83b8771d6a17\") " pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:43.172317 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.172223 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smz62"] Sep 09 21:02:43.175527 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:02:43.175500 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb84b9e_af4d_46eb_804c_1ebc3a68f8f4.slice/crio-40348fa018ffa42b28e0d4921e672cc3c99c95d646554e9753fd2287a7735ce2 WatchSource:0}: Error finding container 40348fa018ffa42b28e0d4921e672cc3c99c95d646554e9753fd2287a7735ce2: Status 404 returned error can't find the container with id 40348fa018ffa42b28e0d4921e672cc3c99c95d646554e9753fd2287a7735ce2 Sep 09 21:02:43.195695 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.195658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zv66x\"" Sep 09 21:02:43.203379 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.203365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:43.337420 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.337390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bvmr_abdb95d3-dfee-40c7-9f55-79764bd356ee/node-ca/0.log" Sep 09 21:02:43.345534 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.345510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smz62" event={"ID":"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4","Type":"ContainerStarted","Data":"40348fa018ffa42b28e0d4921e672cc3c99c95d646554e9753fd2287a7735ce2"} Sep 09 21:02:43.386041 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.386015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:43.386127 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.386056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:43.386168 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:43.386137 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 21:02:43.386168 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:43.386151 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:43.386228 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:43.386201 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:47.38618321 +0000 UTC m=+70.805956402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:43.386267 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:43.386241 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:47.38621487 +0000 UTC m=+70.805988046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : configmap "kube-rbac-proxy" not found Sep 09 21:02:43.476416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.476343 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wqq5t"] Sep 09 21:02:43.479108 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:02:43.479077 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4d7be3_b403_480c_b0bd_83b8771d6a17.slice/crio-47de1f75ddd952dcae92fd1282d9fcdd9acaaade5e1649695f38e670f0e764ab WatchSource:0}: Error finding container 47de1f75ddd952dcae92fd1282d9fcdd9acaaade5e1649695f38e670f0e764ab: Status 404 returned error can't find the container with id 47de1f75ddd952dcae92fd1282d9fcdd9acaaade5e1649695f38e670f0e764ab Sep 09 21:02:43.938327 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:43.938302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjwpr_a25c125c-6323-4dc6-a41b-11407e40e6e8/serve-healthcheck-canary/0.log" Sep 09 21:02:44.350315 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:44.350263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqq5t" event={"ID":"4f4d7be3-b403-480c-b0bd-83b8771d6a17","Type":"ContainerStarted","Data":"47de1f75ddd952dcae92fd1282d9fcdd9acaaade5e1649695f38e670f0e764ab"} Sep 09 21:02:44.940065 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:44.940030 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l97gq_13bfe6a6-4bf2-423a-a68a-b41019d1f2cc/kube-storage-version-migrator-operator/0.log" Sep 09 21:02:47.419073 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:47.419032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:47.419536 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:47.419096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:47.419536 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:47.419180 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 21:02:47.419536 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:47.419266 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:55.419242931 +0000 UTC m=+78.839016121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : configmap "kube-rbac-proxy" not found Sep 09 21:02:47.419536 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:47.419278 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:47.419536 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:47.419337 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:02:55.419319145 +0000 UTC m=+78.839092344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:48.364486 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:48.364448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wqq5t" event={"ID":"4f4d7be3-b403-480c-b0bd-83b8771d6a17","Type":"ContainerStarted","Data":"b00f3f8481d436bd373e25333172a3a2e23eaafb1201229494a376782c0a396e"} Sep 09 21:02:48.364749 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:48.364522 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:02:48.365940 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:48.365914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smz62" event={"ID":"0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4","Type":"ContainerStarted","Data":"a99965a8ebacf089f5f6880c6046a35a8f5e6d00474753c70d8f54616a3a261c"} Sep 09 21:02:48.389984 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:48.389934 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wqq5t" podStartSLOduration=66.649285984 podStartE2EDuration="1m11.389918894s" totalImagesPullingTime="4.74063291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:48.388917381 +0000 UTC m=+71.808690581" watchObservedRunningTime="2026-09-09 21:02:48.389918894 +0000 UTC m=+71.809692092" Sep 09 21:02:48.418098 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:48.418050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-smz62" podStartSLOduration=66.363113384 podStartE2EDuration="1m11.418036042s" totalImagesPullingTime="5.054922658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:48.416800851 +0000 UTC m=+71.836574050" watchObservedRunningTime="2026-09-09 21:02:48.418036042 +0000 UTC m=+71.837809240" Sep 09 21:02:50.041348 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.041313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:50.043774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.043756 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325e88d2-9a38-412c-a31e-2f021e4e4f99-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-ztkhc\" (UID: \"325e88d2-9a38-412c-a31e-2f021e4e4f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:50.121824 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.121793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rg2pw\"" Sep 09 21:02:50.130121 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.130105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" Sep 09 21:02:50.243135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.243094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:02:50.243307 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.243211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:50.243307 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.243246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:02:50.243307 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:50.243262 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:50.243475 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:50.243343 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls podName:c85e21d0-edbd-4339-90ce-804a99e119f8 nodeName:}" failed. No retries permitted until 2026-09-09 21:03:06.243322728 +0000 UTC m=+89.663095926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jckqs" (UID: "c85e21d0-edbd-4339-90ce-804a99e119f8") : secret "cluster-monitoring-operator-tls" not found Sep 09 21:02:50.243475 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:50.243370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:03:06.243352496 +0000 UTC m=+89.663125673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : configmap references non-existent config key: service-ca.crt Sep 09 21:02:50.243475 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:50.243452 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 21:02:50.243606 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:50.243508 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs podName:a70d1270-3709-4551-8f46-1f9a0fe195e2 nodeName:}" failed. No retries permitted until 2026-09-09 21:03:06.243491106 +0000 UTC m=+89.663264301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs") pod "router-default-7848747c5b-jlb55" (UID: "a70d1270-3709-4551-8f46-1f9a0fe195e2") : secret "router-metrics-certs-default" not found Sep 09 21:02:50.429967 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:50.429900 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc"] Sep 09 21:02:51.373831 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:51.373791 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" event={"ID":"325e88d2-9a38-412c-a31e-2f021e4e4f99","Type":"ContainerStarted","Data":"5960efd8d2bee8eb8ae2f690e0c9b554e699f39d542fb1aefc65b58e7c928496"} Sep 09 21:02:53.381882 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:53.381849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" event={"ID":"325e88d2-9a38-412c-a31e-2f021e4e4f99","Type":"ContainerStarted","Data":"4c7a64c8b33388e23b8540017b39be95071a8ba57f6b45339e7c303b66f6f0d8"} Sep 09 21:02:53.382271 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:53.381904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" event={"ID":"325e88d2-9a38-412c-a31e-2f021e4e4f99","Type":"ContainerStarted","Data":"f6f663195f728b5c1357a36207fe381e316d7c97323a622c64bf0ae63f539860"} Sep 09 21:02:53.402034 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:53.401985 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-ztkhc" podStartSLOduration=17.50889196 podStartE2EDuration="19.401969642s" totalImagesPullingTime="1.893077682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:02:53.401083359 +0000 UTC m=+76.820856559" watchObservedRunningTime="2026-09-09 21:02:53.401969642 +0000 UTC m=+76.821742840" Sep 09 21:02:55.486304 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:55.486260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:55.486830 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:55.486313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:02:55.486830 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:55.486406 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 21:02:55.486830 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:02:55.486462 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls podName:73b87e2f-9452-49ad-9e98-7cdf32040b8b nodeName:}" failed. No retries permitted until 2026-09-09 21:03:11.486447231 +0000 UTC m=+94.906220421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjzmj" (UID: "73b87e2f-9452-49ad-9e98-7cdf32040b8b") : secret "insights-runtime-extractor-tls" not found Sep 09 21:02:55.486948 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:02:55.486833 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73b87e2f-9452-49ad-9e98-7cdf32040b8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:03:06.264836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.264662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:06.264836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.264762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:03:06.265310 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.264850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:06.265450 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.265431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70d1270-3709-4551-8f46-1f9a0fe195e2-service-ca-bundle\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:06.267157 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.267133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a70d1270-3709-4551-8f46-1f9a0fe195e2-metrics-certs\") pod \"router-default-7848747c5b-jlb55\" (UID: \"a70d1270-3709-4551-8f46-1f9a0fe195e2\") " pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:06.267312 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.267294 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c85e21d0-edbd-4339-90ce-804a99e119f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jckqs\" (UID: \"c85e21d0-edbd-4339-90ce-804a99e119f8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:03:06.437436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.437403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nz59z\"" Sep 09 21:03:06.442309 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.442289 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lp7lt\"" Sep 09 21:03:06.445592 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.445574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:06.449982 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.449958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" Sep 09 21:03:06.734962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.734928 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs"] Sep 09 21:03:06.737706 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:06.737642 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7848747c5b-jlb55"] Sep 09 21:03:06.737981 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:06.737961 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85e21d0_edbd_4339_90ce_804a99e119f8.slice/crio-3d4b0f2ae7d463f7431552784753b04a99634dd2cdec744f46d9816d45984e92 WatchSource:0}: Error finding container 3d4b0f2ae7d463f7431552784753b04a99634dd2cdec744f46d9816d45984e92: Status 404 returned error can't find the container with id 3d4b0f2ae7d463f7431552784753b04a99634dd2cdec744f46d9816d45984e92 Sep 09 21:03:06.740207 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:06.740186 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70d1270_3709_4551_8f46_1f9a0fe195e2.slice/crio-b2c97ab7477ab6931165345c3c5ff84eb037e4d753ff33deaaeb67dd17ee8eed WatchSource:0}: Error finding container b2c97ab7477ab6931165345c3c5ff84eb037e4d753ff33deaaeb67dd17ee8eed: Status 404 returned error can't find the container with id b2c97ab7477ab6931165345c3c5ff84eb037e4d753ff33deaaeb67dd17ee8eed Sep 09 21:03:07.426088 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.426053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" event={"ID":"c85e21d0-edbd-4339-90ce-804a99e119f8","Type":"ContainerStarted","Data":"3d4b0f2ae7d463f7431552784753b04a99634dd2cdec744f46d9816d45984e92"} Sep 09 21:03:07.427534 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.427511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7848747c5b-jlb55" event={"ID":"a70d1270-3709-4551-8f46-1f9a0fe195e2","Type":"ContainerStarted","Data":"c44e75c7c39d00be328dedf15c1dc6a7cf99324210b1ccdc3b894f2b7677a944"} Sep 09 21:03:07.427631 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.427549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7848747c5b-jlb55" event={"ID":"a70d1270-3709-4551-8f46-1f9a0fe195e2","Type":"ContainerStarted","Data":"b2c97ab7477ab6931165345c3c5ff84eb037e4d753ff33deaaeb67dd17ee8eed"} Sep 09 21:03:07.446600 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.446575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:07.449137 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.449109 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:07.449137 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:07.449137 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:07.449137 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:07.449321 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.449160 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:07.461582 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:07.461539 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7848747c5b-jlb55" podStartSLOduration=33.461526682 podStartE2EDuration="33.461526682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:07.46010335 +0000 UTC m=+90.879876550" watchObservedRunningTime="2026-09-09 21:03:07.461526682 +0000 UTC m=+90.881299881" Sep 09 21:03:08.446730 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:08.446698 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:08.446730 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:08.446730 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:08.446730 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:08.447165 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:08.446747 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:09.436107 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:09.436057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" event={"ID":"c85e21d0-edbd-4339-90ce-804a99e119f8","Type":"ContainerStarted","Data":"0da1689ea915c3779764983e9c40d66d36be874b52035ae2c8cbdca6e6cab305"} Sep 09 21:03:09.447587 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:09.447561 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:09.447587 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:09.447587 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:09.447587 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:09.448021 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:09.447608 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:09.460575 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:09.460532 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jckqs" podStartSLOduration=32.944661549 podStartE2EDuration="35.46051636s" totalImagesPullingTime="2.515854811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:09.460064214 +0000 UTC m=+92.879837414" watchObservedRunningTime="2026-09-09 21:03:09.46051636 +0000 UTC m=+92.880289550" Sep 09 21:03:10.447475 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:10.447442 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:10.447475 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:10.447475 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:10.447475 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:10.447965 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:10.447512 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:11.447439 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.447403 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:11.447439 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:11.447439 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:11.447439 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:11.447925 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.447461 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:11.503628 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.503596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:03:11.506115 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.506087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73b87e2f-9452-49ad-9e98-7cdf32040b8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjzmj\" (UID: \"73b87e2f-9452-49ad-9e98-7cdf32040b8b\") " pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:03:11.694231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.694194 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjzmj" Sep 09 21:03:11.969096 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:11.969012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjzmj"] Sep 09 21:03:11.972203 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:11.972161 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b87e2f_9452_49ad_9e98_7cdf32040b8b.slice/crio-bcfd12494487e5d2dc9596a5f7e93936728f30c3602b9c48b5200c0008378777 WatchSource:0}: Error finding container bcfd12494487e5d2dc9596a5f7e93936728f30c3602b9c48b5200c0008378777: Status 404 returned error can't find the container with id bcfd12494487e5d2dc9596a5f7e93936728f30c3602b9c48b5200c0008378777 Sep 09 21:03:12.446745 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:12.446709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjzmj" event={"ID":"73b87e2f-9452-49ad-9e98-7cdf32040b8b","Type":"ContainerStarted","Data":"ddfb7679ebe26505ea4dc4f0826119f734f1b8262c3f0af398e965fd493c8f15"} Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:12.446775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjzmj" event={"ID":"73b87e2f-9452-49ad-9e98-7cdf32040b8b","Type":"ContainerStarted","Data":"bcfd12494487e5d2dc9596a5f7e93936728f30c3602b9c48b5200c0008378777"} Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:12.446775 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:12.446913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:12.446822 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:13.447129 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:13.447093 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:13.447129 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:13.447129 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:13.447129 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:13.447703 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:13.447154 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:13.451492 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:13.451457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjzmj" event={"ID":"73b87e2f-9452-49ad-9e98-7cdf32040b8b","Type":"ContainerStarted","Data":"ef816d8eed080b4141362635b8ebff2adc6e48a2670d59c36de9f7cb92d55af3"} Sep 09 21:03:14.447278 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:14.447246 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:14.447278 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:14.447278 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:14.447278 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:14.447793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:14.447306 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:14.928440 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:14.928415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:03:14.930937 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:14.930914 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9-metrics-tls\") pod \"dns-default-95lwl\" (UID: \"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9\") " pod="openshift-dns/dns-default-95lwl" Sep 09 21:03:15.202408 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.202324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9vjrs\"" Sep 09 21:03:15.209746 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.209727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95lwl" Sep 09 21:03:15.447681 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.447642 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:15.447681 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:15.447681 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:15.447681 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:15.448123 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.447722 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:15.460582 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.460506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjzmj" event={"ID":"73b87e2f-9452-49ad-9e98-7cdf32040b8b","Type":"ContainerStarted","Data":"4a8ec30e18bb81c6065dec776ccdae332fdc57d8026fb0e6985d8d0c6583d16e"} Sep 09 21:03:15.506729 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.506651 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bjzmj" podStartSLOduration=33.687179214 podStartE2EDuration="36.506630286s" totalImagesPullingTime="2.819451072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:02:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:15.491345408 +0000 UTC m=+98.911118606" watchObservedRunningTime="2026-09-09 21:03:15.506630286 +0000 UTC m=+98.926403487" Sep 09 21:03:15.507243 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:15.507225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95lwl"] Sep 09 21:03:15.510184 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:15.510161 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c9c8b8_8b0b_4278_ba0c_8e2acff39ff9.slice/crio-f028a6f2e320e13f2d459a645d742e5a988c4b1456de27268ed6da0424402b64 WatchSource:0}: Error finding container f028a6f2e320e13f2d459a645d742e5a988c4b1456de27268ed6da0424402b64: Status 404 returned error can't find the container with id f028a6f2e320e13f2d459a645d742e5a988c4b1456de27268ed6da0424402b64 Sep 09 21:03:16.446704 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:16.446655 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:16.447633 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:16.447611 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:16.447633 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:16.447633 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:16.447633 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:16.448001 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:16.447656 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:16.465439 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:16.465402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95lwl" event={"ID":"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9","Type":"ContainerStarted","Data":"f028a6f2e320e13f2d459a645d742e5a988c4b1456de27268ed6da0424402b64"} Sep 09 21:03:17.447283 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.447247 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:17.447283 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:17.447283 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:17.447283 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:17.447520 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.447309 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:17.470212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.470133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95lwl" event={"ID":"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9","Type":"ContainerStarted","Data":"23116e6fdf5eaab5f6ca7b28b76d5fe45fb20a85cee6d5b71644a0701c44a6d3"} Sep 09 21:03:17.470212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.470184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95lwl" event={"ID":"c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9","Type":"ContainerStarted","Data":"c68e82e153933f8e26c2719709939a097148adb70c3eeacca91a8466611d8b17"} Sep 09 21:03:17.470585 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.470280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-95lwl" Sep 09 21:03:17.493418 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:17.493365 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-95lwl" podStartSLOduration=65.797135744 podStartE2EDuration="1m7.49334793s" totalImagesPullingTime="1.696212186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:17.491921191 +0000 UTC m=+100.911694390" watchObservedRunningTime="2026-09-09 21:03:17.49334793 +0000 UTC m=+100.913121126" Sep 09 21:03:18.447436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:18.447399 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:18.447436 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:18.447436 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:18.447436 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:18.447689 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:18.447458 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:19.370755 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:19.370724 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wqq5t" Sep 09 21:03:19.447593 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:19.447561 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:19.447593 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:19.447593 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:19.447593 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:19.447840 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:19.447612 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:20.447055 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:20.447021 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:20.447055 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:20.447055 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:20.447055 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:20.447486 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:20.447074 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:21.027601 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.027570 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp"] Sep 09 21:03:21.059522 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.059487 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp"] Sep 09 21:03:21.059706 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.059611 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.062782 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.062760 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 21:03:21.062915 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.062787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 21:03:21.062915 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.062770 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 21:03:21.063960 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.063945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 09 21:03:21.178558 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.178522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58849f8d-226c-4513-96cd-565bb12d3502-klusterlet-config\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.178738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.178577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58849f8d-226c-4513-96cd-565bb12d3502-tmp\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.178738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.178601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zhtd\" (UniqueName: \"kubernetes.io/projected/58849f8d-226c-4513-96cd-565bb12d3502-kube-api-access-9zhtd\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.279530 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.279437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58849f8d-226c-4513-96cd-565bb12d3502-tmp\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.279530 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.279481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zhtd\" (UniqueName: \"kubernetes.io/projected/58849f8d-226c-4513-96cd-565bb12d3502-kube-api-access-9zhtd\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.279828 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.279616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58849f8d-226c-4513-96cd-565bb12d3502-klusterlet-config\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.279881 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.279860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58849f8d-226c-4513-96cd-565bb12d3502-tmp\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.282260 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.282239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58849f8d-226c-4513-96cd-565bb12d3502-klusterlet-config\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.296386 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.296355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zhtd\" (UniqueName: \"kubernetes.io/projected/58849f8d-226c-4513-96cd-565bb12d3502-kube-api-access-9zhtd\") pod \"klusterlet-addon-workmgr-fcfb5dc94-qgbfp\" (UID: \"58849f8d-226c-4513-96cd-565bb12d3502\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.302971 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.302948 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-mvf8z"] Sep 09 21:03:21.305380 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.305365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:21.308684 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.308646 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4hzb9\"" Sep 09 21:03:21.308768 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.308651 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 21:03:21.308993 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.308966 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 21:03:21.328966 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.328939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mvf8z"] Sep 09 21:03:21.368422 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.368389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:21.379981 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.379941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7x2\" (UniqueName: \"kubernetes.io/projected/b9ee2757-68dc-4640-af0c-e97babbfa080-kube-api-access-qz7x2\") pod \"downloads-85d98c998f-mvf8z\" (UID: \"b9ee2757-68dc-4640-af0c-e97babbfa080\") " pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:21.447398 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.447366 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:21.447398 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:21.447398 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:21.447398 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:21.447921 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.447431 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:21.480978 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.480944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7x2\" (UniqueName: \"kubernetes.io/projected/b9ee2757-68dc-4640-af0c-e97babbfa080-kube-api-access-qz7x2\") pod \"downloads-85d98c998f-mvf8z\" (UID: \"b9ee2757-68dc-4640-af0c-e97babbfa080\") " pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:21.492093 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.492068 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7x2\" (UniqueName: \"kubernetes.io/projected/b9ee2757-68dc-4640-af0c-e97babbfa080-kube-api-access-qz7x2\") pod \"downloads-85d98c998f-mvf8z\" (UID: \"b9ee2757-68dc-4640-af0c-e97babbfa080\") " pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:21.614909 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.614810 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:21.653269 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.653235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp"] Sep 09 21:03:21.656076 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:21.656049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58849f8d_226c_4513_96cd_565bb12d3502.slice/crio-4b93f45764fddfdd6f99e2ba510ca6d7388c4c082c77718b96635a2cbce90cd4 WatchSource:0}: Error finding container 4b93f45764fddfdd6f99e2ba510ca6d7388c4c082c77718b96635a2cbce90cd4: Status 404 returned error can't find the container with id 4b93f45764fddfdd6f99e2ba510ca6d7388c4c082c77718b96635a2cbce90cd4 Sep 09 21:03:21.891744 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:21.891622 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mvf8z"] Sep 09 21:03:21.894929 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:21.894904 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ee2757_68dc_4640_af0c_e97babbfa080.slice/crio-dcb288102aae25a7da5d0649ce46d38123e344a8e0ca8bcc7adf640058b5bd33 WatchSource:0}: Error finding container dcb288102aae25a7da5d0649ce46d38123e344a8e0ca8bcc7adf640058b5bd33: Status 404 returned error can't find the container with id dcb288102aae25a7da5d0649ce46d38123e344a8e0ca8bcc7adf640058b5bd33 Sep 09 21:03:22.447445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:22.447408 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:22.447445 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:22.447445 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:22.447445 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:22.447963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:22.447469 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:22.492362 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:22.492325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mvf8z" event={"ID":"b9ee2757-68dc-4640-af0c-e97babbfa080","Type":"ContainerStarted","Data":"dcb288102aae25a7da5d0649ce46d38123e344a8e0ca8bcc7adf640058b5bd33"} Sep 09 21:03:22.494097 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:22.494068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" event={"ID":"58849f8d-226c-4513-96cd-565bb12d3502","Type":"ContainerStarted","Data":"4b93f45764fddfdd6f99e2ba510ca6d7388c4c082c77718b96635a2cbce90cd4"} Sep 09 21:03:23.447181 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:23.447147 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:23.447181 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:23.447181 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:23.447181 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:23.447507 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:23.447208 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:24.447958 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.447923 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:24.447958 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:24.447958 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:24.447958 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:24.448552 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.447987 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:24.969554 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.969514 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-bb5nt"] Sep 09 21:03:24.971947 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.971927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:24.976381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.976120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 21:03:24.976381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.976120 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 21:03:24.976381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.976120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lcjz9\"" Sep 09 21:03:24.976381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.976120 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 21:03:24.983601 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:24.983538 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-bb5nt"] Sep 09 21:03:25.107954 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.107915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.108139 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.107964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmrwc\" (UniqueName: \"kubernetes.io/projected/fb864a4b-7667-4171-a426-641b35976341-kube-api-access-xmrwc\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.108139 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.107995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb864a4b-7667-4171-a426-641b35976341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.108139 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.108088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.208932 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.208892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.209118 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.208942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmrwc\" (UniqueName: \"kubernetes.io/projected/fb864a4b-7667-4171-a426-641b35976341-kube-api-access-xmrwc\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.209118 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.208975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb864a4b-7667-4171-a426-641b35976341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.209118 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.209014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.210245 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.210185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb864a4b-7667-4171-a426-641b35976341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.212036 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.212008 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.214134 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.214110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb864a4b-7667-4171-a426-641b35976341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.219588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.219530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmrwc\" (UniqueName: \"kubernetes.io/projected/fb864a4b-7667-4171-a426-641b35976341-kube-api-access-xmrwc\") pod \"prometheus-operator-6f4946db56-bb5nt\" (UID: \"fb864a4b-7667-4171-a426-641b35976341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.284786 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.284734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" Sep 09 21:03:25.447659 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.447623 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:25.447659 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:25.447659 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:25.447659 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:25.447986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:25.447709 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:26.135135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.134964 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-bb5nt"] Sep 09 21:03:26.138211 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:26.138177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb864a4b_7667_4171_a426_641b35976341.slice/crio-1fd5d98d17d2398d24f9b6dc7f7c699d781fc3b37fe6680b2682f1d1e2a51225 WatchSource:0}: Error finding container 1fd5d98d17d2398d24f9b6dc7f7c699d781fc3b37fe6680b2682f1d1e2a51225: Status 404 returned error can't find the container with id 1fd5d98d17d2398d24f9b6dc7f7c699d781fc3b37fe6680b2682f1d1e2a51225 Sep 09 21:03:26.447660 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.447565 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:26.447660 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:26.447660 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:26.447660 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:26.447928 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.447651 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:26.511921 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.511882 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" event={"ID":"fb864a4b-7667-4171-a426-641b35976341","Type":"ContainerStarted","Data":"1fd5d98d17d2398d24f9b6dc7f7c699d781fc3b37fe6680b2682f1d1e2a51225"} Sep 09 21:03:26.513270 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.513249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" event={"ID":"58849f8d-226c-4513-96cd-565bb12d3502","Type":"ContainerStarted","Data":"580918ee141e5fd469ae69ed9ed79a1cb36e0d498aac4f6455e9fd17f4f42dbc"} Sep 09 21:03:26.538000 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:26.537943 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" podStartSLOduration=1.302905907 podStartE2EDuration="5.537921208s" totalImagesPullingTime="4.235015301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:26.536812721 +0000 UTC m=+109.956585943" watchObservedRunningTime="2026-09-09 21:03:26.537921208 +0000 UTC m=+109.957694408" Sep 09 21:03:27.448124 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:27.448083 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:27.448124 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:27.448124 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:27.448124 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:27.448493 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:27.448151 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:27.476822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:27.476487 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-95lwl" Sep 09 21:03:27.521650 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:27.521618 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:27.522258 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:27.522235 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fcfb5dc94-qgbfp" Sep 09 21:03:28.447539 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:28.447496 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:28.447539 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:28.447539 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:28.447539 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:28.447881 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:28.447557 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:28.525368 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:28.525331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" event={"ID":"fb864a4b-7667-4171-a426-641b35976341","Type":"ContainerStarted","Data":"129edd8e6cd09309af244461689b5527f1e02b20a0aec799cdf5f46615461284"} Sep 09 21:03:28.525845 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:28.525419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" event={"ID":"fb864a4b-7667-4171-a426-641b35976341","Type":"ContainerStarted","Data":"4b6eb9808f48b490094bfc5a128a65d4d236c41886d40cdfaf9b607fe5f3258d"} Sep 09 21:03:28.552398 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:28.552345 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-bb5nt" podStartSLOduration=2.9010015449999997 podStartE2EDuration="4.552319241s" totalImagesPullingTime="1.651317696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:28.550489755 +0000 UTC m=+111.970262955" watchObservedRunningTime="2026-09-09 21:03:28.552319241 +0000 UTC m=+111.972092440" Sep 09 21:03:29.447353 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:29.447316 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:29.447353 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:29.447353 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:29.447353 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:29.447727 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:29.447375 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:30.344588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.344548 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nc954"] Sep 09 21:03:30.348293 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.348271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.351640 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.351612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 21:03:30.351799 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.351612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 21:03:30.351886 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.351865 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p4fsj\"" Sep 09 21:03:30.363251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.363225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nc954"] Sep 09 21:03:30.376254 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.376227 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wdr42"] Sep 09 21:03:30.379559 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.379529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.383877 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.383851 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 21:03:30.384135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.384118 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 21:03:30.384296 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.384169 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-brllz\"" Sep 09 21:03:30.384498 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.384482 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 21:03:30.447565 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.447531 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:30.447565 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:30.447565 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:30.447565 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:30.447886 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.447584 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:30.454909 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.454874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-tls\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455070 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.454927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-sys\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455070 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.454992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f672dd4f-1aa2-4b8b-813e-048a38d720b8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.455200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-wtmp\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-metrics-client-ca\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-textfile\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455332 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qpn\" (UniqueName: \"kubernetes.io/projected/f672dd4f-1aa2-4b8b-813e-048a38d720b8-kube-api-access-46qpn\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.455332 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.455332 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455300 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-root\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455444 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmzl\" (UniqueName: \"kubernetes.io/projected/5ab3f3da-5674-44e3-8409-25d17cc722b7-kube-api-access-pfmzl\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455444 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.455535 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.455535 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.455484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556170 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-tls\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556170 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-sys\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f672dd4f-1aa2-4b8b-813e-048a38d720b8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-wtmp\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-sys\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-metrics-client-ca\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-textfile\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qpn\" (UniqueName: \"kubernetes.io/projected/f672dd4f-1aa2-4b8b-813e-048a38d720b8-kube-api-access-46qpn\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-wtmp\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-root\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:03:30.556521 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmzl\" (UniqueName: \"kubernetes.io/projected/5ab3f3da-5674-44e3-8409-25d17cc722b7-kube-api-access-pfmzl\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:03:30.556602 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls podName:f672dd4f-1aa2-4b8b-813e-048a38d720b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:03:31.056578178 +0000 UTC m=+114.476351371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-nc954" (UID: "f672dd4f-1aa2-4b8b-813e-048a38d720b8") : secret "openshift-state-metrics-tls" not found Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.556780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ab3f3da-5674-44e3-8409-25d17cc722b7-root\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.557287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-textfile\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.557287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.556959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-metrics-client-ca\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.557287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.557119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f672dd4f-1aa2-4b8b-813e-048a38d720b8-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.557287 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.557265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.559544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.559509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-tls\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.559716 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.559603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ab3f3da-5674-44e3-8409-25d17cc722b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.559780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.559744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.573086 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.573061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qpn\" (UniqueName: \"kubernetes.io/projected/f672dd4f-1aa2-4b8b-813e-048a38d720b8-kube-api-access-46qpn\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:30.573349 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.573328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmzl\" (UniqueName: \"kubernetes.io/projected/5ab3f3da-5674-44e3-8409-25d17cc722b7-kube-api-access-pfmzl\") pod \"node-exporter-wdr42\" (UID: \"5ab3f3da-5674-44e3-8409-25d17cc722b7\") " pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.690386 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:30.690303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdr42" Sep 09 21:03:30.707650 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:30.707617 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab3f3da_5674_44e3_8409_25d17cc722b7.slice/crio-fc60fc301c76695ec0ce3ce3a11d08c47b136e816814ccb5436d1a72bfa9960f WatchSource:0}: Error finding container fc60fc301c76695ec0ce3ce3a11d08c47b136e816814ccb5436d1a72bfa9960f: Status 404 returned error can't find the container with id fc60fc301c76695ec0ce3ce3a11d08c47b136e816814ccb5436d1a72bfa9960f Sep 09 21:03:31.060447 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.060402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:31.063398 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.063364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f672dd4f-1aa2-4b8b-813e-048a38d720b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nc954\" (UID: \"f672dd4f-1aa2-4b8b-813e-048a38d720b8\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:31.259483 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.259453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" Sep 09 21:03:31.447502 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.447322 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:31.447502 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:31.447502 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:31.447502 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:31.447502 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.447380 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:31.538741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.538649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdr42" event={"ID":"5ab3f3da-5674-44e3-8409-25d17cc722b7","Type":"ContainerStarted","Data":"fc60fc301c76695ec0ce3ce3a11d08c47b136e816814ccb5436d1a72bfa9960f"} Sep 09 21:03:31.568149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:31.568116 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nc954"] Sep 09 21:03:31.745547 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:31.745462 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf672dd4f_1aa2_4b8b_813e_048a38d720b8.slice/crio-5c48e114b85adc3d7eab09a8bbf565045351e269c2a83d360ec07991171c4d00 WatchSource:0}: Error finding container 5c48e114b85adc3d7eab09a8bbf565045351e269c2a83d360ec07991171c4d00: Status 404 returned error can't find the container with id 5c48e114b85adc3d7eab09a8bbf565045351e269c2a83d360ec07991171c4d00 Sep 09 21:03:32.447199 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.447163 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:32.447199 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:32.447199 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:32.447199 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:32.447519 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.447233 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:32.544175 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.544135 2580 generic.go:356] "Generic (PLEG): container finished" podID="5ab3f3da-5674-44e3-8409-25d17cc722b7" containerID="2baf5db4154bce9e22d6e9627209c596dfe89a2dad70dc08083b798481ff1fbb" exitCode=0 Sep 09 21:03:32.544372 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.544216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdr42" event={"ID":"5ab3f3da-5674-44e3-8409-25d17cc722b7","Type":"ContainerDied","Data":"2baf5db4154bce9e22d6e9627209c596dfe89a2dad70dc08083b798481ff1fbb"} Sep 09 21:03:32.546371 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.546344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" event={"ID":"f672dd4f-1aa2-4b8b-813e-048a38d720b8","Type":"ContainerStarted","Data":"f62e21673ae7a6e40e99b6892faf90328ec38d58b84379c4b8e2e01cf3d1b846"} Sep 09 21:03:32.546478 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.546402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" event={"ID":"f672dd4f-1aa2-4b8b-813e-048a38d720b8","Type":"ContainerStarted","Data":"eba47c7a552bd3a9274b8ddf13ce8df27bee49f42dff70976e5b25a81291188a"} Sep 09 21:03:32.546478 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:32.546431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" event={"ID":"f672dd4f-1aa2-4b8b-813e-048a38d720b8","Type":"ContainerStarted","Data":"5c48e114b85adc3d7eab09a8bbf565045351e269c2a83d360ec07991171c4d00"} Sep 09 21:03:33.447585 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:33.447533 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:33.447585 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:33.447585 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:33.447585 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:33.448110 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:33.447615 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:34.447633 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.447593 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:34.447633 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:34.447633 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:34.447633 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:34.448173 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.447689 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:34.688344 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.688296 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-574d646cfd-jb8fx"] Sep 09 21:03:34.693138 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.693116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.697938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.697529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 21:03:34.697938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.697617 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8lgcib55vq48m\"" Sep 09 21:03:34.697938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.697639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fz74z\"" Sep 09 21:03:34.697938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.697791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 21:03:34.697938 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.697802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 21:03:34.698288 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.698032 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 21:03:34.712230 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.712210 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574d646cfd-jb8fx"] Sep 09 21:03:34.794161 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/09860b7e-9be9-4371-8d56-aaaee9045ea7-audit-log\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-client-certs\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794327 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-tls\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794501 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-metrics-server-audit-profiles\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794501 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-client-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.794501 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.794427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq6b5\" (UniqueName: \"kubernetes.io/projected/09860b7e-9be9-4371-8d56-aaaee9045ea7-kube-api-access-hq6b5\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895516 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-tls\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-metrics-server-audit-profiles\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-client-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6b5\" (UniqueName: \"kubernetes.io/projected/09860b7e-9be9-4371-8d56-aaaee9045ea7-kube-api-access-hq6b5\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/09860b7e-9be9-4371-8d56-aaaee9045ea7-audit-log\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-client-certs\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.895738 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.895730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.896146 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.896120 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/09860b7e-9be9-4371-8d56-aaaee9045ea7-audit-log\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.896388 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.896363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.896588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.896564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/09860b7e-9be9-4371-8d56-aaaee9045ea7-metrics-server-audit-profiles\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.898794 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.898751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-tls\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.898895 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.898833 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-secret-metrics-server-client-certs\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.899001 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.898974 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09860b7e-9be9-4371-8d56-aaaee9045ea7-client-ca-bundle\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:34.906361 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:34.906319 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq6b5\" (UniqueName: \"kubernetes.io/projected/09860b7e-9be9-4371-8d56-aaaee9045ea7-kube-api-access-hq6b5\") pod \"metrics-server-574d646cfd-jb8fx\" (UID: \"09860b7e-9be9-4371-8d56-aaaee9045ea7\") " pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:35.004701 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:35.004597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:35.447051 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:35.447012 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:35.447051 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:35.447051 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:35.447051 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:35.447332 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:35.447075 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:36.447765 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:36.447716 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:36.447765 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:36.447765 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:36.447765 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:36.448274 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:36.447788 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:37.446952 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:37.446916 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:37.446952 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:37.446952 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:37.446952 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:37.447244 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:37.446993 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:38.447030 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:38.446990 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:38.447030 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:38.447030 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:38.447030 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:38.447550 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:38.447061 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:39.302856 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.302783 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574d646cfd-jb8fx"] Sep 09 21:03:39.306774 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:39.306722 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09860b7e_9be9_4371_8d56_aaaee9045ea7.slice/crio-e45b85f2478d906870f93392f06d5720f1ea738fac80a1f4426d161e6a51325c WatchSource:0}: Error finding container e45b85f2478d906870f93392f06d5720f1ea738fac80a1f4426d161e6a51325c: Status 404 returned error can't find the container with id e45b85f2478d906870f93392f06d5720f1ea738fac80a1f4426d161e6a51325c Sep 09 21:03:39.447596 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.447555 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:39.447596 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:39.447596 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:39.447596 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:39.448161 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.447620 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:39.578393 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.578224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdr42" event={"ID":"5ab3f3da-5674-44e3-8409-25d17cc722b7","Type":"ContainerStarted","Data":"3a68ead8e5c03a5cf9d210365ca83afe89ace7ee8a0ce3e3a97ee73586d8afbc"} Sep 09 21:03:39.578393 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.578307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdr42" event={"ID":"5ab3f3da-5674-44e3-8409-25d17cc722b7","Type":"ContainerStarted","Data":"84c60fa4e37ec120234e798bf796e442bf85c230d80de741fea05cac838b9c24"} Sep 09 21:03:39.581572 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.581156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mvf8z" event={"ID":"b9ee2757-68dc-4640-af0c-e97babbfa080","Type":"ContainerStarted","Data":"e390cfb668d185b9f5a52ddc02be3dd4a82d1ddb3a062dabed91e003c54d402b"} Sep 09 21:03:39.581572 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.581357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:39.583320 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.583294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" event={"ID":"09860b7e-9be9-4371-8d56-aaaee9045ea7","Type":"ContainerStarted","Data":"e45b85f2478d906870f93392f06d5720f1ea738fac80a1f4426d161e6a51325c"} Sep 09 21:03:39.590081 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.590059 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-mvf8z" Sep 09 21:03:39.611256 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.611190 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wdr42" podStartSLOduration=8.437234835 podStartE2EDuration="9.611170191s" totalImagesPullingTime="1.091513604s" totalInitContainerRuntime="82.421752ms" isStatefulPod=true podCreationTimestamp="2026-09-09 21:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:39.609323267 +0000 UTC m=+123.029096495" watchObservedRunningTime="2026-09-09 21:03:39.611170191 +0000 UTC m=+123.030943391" Sep 09 21:03:39.639875 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:39.639821 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-mvf8z" podStartSLOduration=1.412707453 podStartE2EDuration="18.639804489s" totalImagesPullingTime="17.227097036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:39.638854896 +0000 UTC m=+123.058628096" watchObservedRunningTime="2026-09-09 21:03:39.639804489 +0000 UTC m=+123.059577688" Sep 09 21:03:40.447903 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:40.447867 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:40.447903 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:40.447903 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:40.447903 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:40.448490 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:40.447934 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:40.593403 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:40.593361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" event={"ID":"f672dd4f-1aa2-4b8b-813e-048a38d720b8","Type":"ContainerStarted","Data":"58402764014e273c0ea7ab63ea00720010500438035c86af1f3ca6a8c763ac35"} Sep 09 21:03:40.629618 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:40.629542 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nc954" podStartSLOduration=2.59949351 podStartE2EDuration="10.62951549s" totalImagesPullingTime="8.03002198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:40.621745794 +0000 UTC m=+124.041518993" watchObservedRunningTime="2026-09-09 21:03:40.62951549 +0000 UTC m=+124.049288689" Sep 09 21:03:41.447454 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:41.447415 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:41.447454 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:41.447454 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:41.447454 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:41.447757 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:41.447507 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:42.447503 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:42.447463 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:42.447503 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:42.447503 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:42.447503 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:42.447986 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:42.447529 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:42.603587 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:42.603546 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" event={"ID":"09860b7e-9be9-4371-8d56-aaaee9045ea7","Type":"ContainerStarted","Data":"d3ddd024d5a3553cef24b1a7b2afe8c4713bec89ecfb937cb0ab2f592a0c5e98"} Sep 09 21:03:42.627259 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:42.627196 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" podStartSLOduration=6.259084159 podStartE2EDuration="8.627172441s" totalImagesPullingTime="2.368088282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:42.625092169 +0000 UTC m=+126.044865369" watchObservedRunningTime="2026-09-09 21:03:42.627172441 +0000 UTC m=+126.046945643" Sep 09 21:03:43.447300 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:43.447263 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:43.447300 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:43.447300 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:43.447300 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:43.447905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:43.447321 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:44.447357 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:44.447318 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:44.447357 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:44.447357 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:44.447357 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:44.448025 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:44.447389 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:45.447185 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:45.447142 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:45.447185 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:45.447185 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:45.447185 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:45.447467 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:45.447217 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:46.447510 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.447466 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:46.447510 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:46.447510 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:46.447510 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:46.448104 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.447559 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:46.802921 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.802873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:03:46.805835 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.805804 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f66cadf-60bf-4889-8aaa-8e7799cfe0ac-metrics-certs\") pod \"network-metrics-daemon-77bkx\" (UID: \"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac\") " pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:03:46.901030 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.900992 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgvxk\"" Sep 09 21:03:46.908392 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:46.908358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77bkx" Sep 09 21:03:47.241693 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:47.241598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77bkx"] Sep 09 21:03:47.245838 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:47.245807 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f66cadf_60bf_4889_8aaa_8e7799cfe0ac.slice/crio-544d84b79aaf33a8b19884d6cffb7232777d1de693f078250eece73e1f737a21 WatchSource:0}: Error finding container 544d84b79aaf33a8b19884d6cffb7232777d1de693f078250eece73e1f737a21: Status 404 returned error can't find the container with id 544d84b79aaf33a8b19884d6cffb7232777d1de693f078250eece73e1f737a21 Sep 09 21:03:47.447334 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:47.447300 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:47.447334 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:47.447334 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:47.447334 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:47.447838 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:47.447361 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:47.626261 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:47.626218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77bkx" event={"ID":"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac","Type":"ContainerStarted","Data":"544d84b79aaf33a8b19884d6cffb7232777d1de693f078250eece73e1f737a21"} Sep 09 21:03:48.446884 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:48.446847 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:48.446884 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:48.446884 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:48.446884 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:48.447167 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:48.446914 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:49.446824 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:49.446743 2580 patch_prober.go:28] interesting pod/router-default-7848747c5b-jlb55 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 09 21:03:49.446824 ip-10-0-137-243 kubenswrapper[2580]: [-]has-synced failed: reason withheld Sep 09 21:03:49.446824 ip-10-0-137-243 kubenswrapper[2580]: [+]process-running ok Sep 09 21:03:49.446824 ip-10-0-137-243 kubenswrapper[2580]: healthz check failed Sep 09 21:03:49.446824 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:49.446800 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-7848747c5b-jlb55" podUID="a70d1270-3709-4551-8f46-1f9a0fe195e2" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 21:03:49.636059 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:49.636021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77bkx" event={"ID":"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac","Type":"ContainerStarted","Data":"b15626ac021a02435a18347e1bb66a7c70a9019c11077fb8d21d0eb06cd2f38a"} Sep 09 21:03:49.636325 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:49.636086 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77bkx" event={"ID":"3f66cadf-60bf-4889-8aaa-8e7799cfe0ac","Type":"ContainerStarted","Data":"aec25b649bcb2f0126b3f1e0e53e74894adaa12cda7d42c06e7db3f67cd5741e"} Sep 09 21:03:49.668800 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:49.668747 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-77bkx" podStartSLOduration=131.09182599 podStartE2EDuration="2m12.668730605s" totalImagesPullingTime="1.576904615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:49.667273155 +0000 UTC m=+133.087046381" watchObservedRunningTime="2026-09-09 21:03:49.668730605 +0000 UTC m=+133.088503809" Sep 09 21:03:50.447917 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:50.447890 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:50.449241 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:50.449221 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7848747c5b-jlb55" Sep 09 21:03:52.143773 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.143738 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:03:52.161936 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.161914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.162581 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.162555 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:03:52.164654 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.164636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 21:03:52.164912 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.164898 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 21:03:52.164912 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.164903 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 21:03:52.165826 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.165807 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fc6fm\"" Sep 09 21:03:52.165931 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.165828 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 21:03:52.165931 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.165807 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 21:03:52.249475 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.249644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.249644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.249644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.249644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.249644 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.249634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ltr\" (UniqueName: \"kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.350807 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.350775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.350955 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.350821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.350955 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.350862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.350955 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.350898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.351124 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.351102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8ltr\" (UniqueName: \"kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.351191 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.351174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.351551 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.351531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.351634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.351561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.351634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.351561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.353363 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.353345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.353649 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.353633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.360283 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.360254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8ltr\" (UniqueName: \"kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr\") pod \"console-6776d95999-z5hkk\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.471777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.471710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:03:52.770681 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:52.770582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:03:52.773343 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:52.773308 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6eadf9d_9136_4615_8a44_bdce00cd995b.slice/crio-491e51a76a0302087f63c899d471d2278c1eab2d63cf1738e59b62b287008052 WatchSource:0}: Error finding container 491e51a76a0302087f63c899d471d2278c1eab2d63cf1738e59b62b287008052: Status 404 returned error can't find the container with id 491e51a76a0302087f63c899d471d2278c1eab2d63cf1738e59b62b287008052 Sep 09 21:03:53.145452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.145420 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:03:53.173037 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.173009 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:03:53.173207 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.173115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.181552 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.181534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 21:03:53.257976 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.257939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.257994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.258028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqfw8\" (UniqueName: \"kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.258059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.258086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.258124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.258162 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.258152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359276 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqfw8\" (UniqueName: \"kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359436 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.359763 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.359480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.360128 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.360104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.360246 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.360171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.360381 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.360361 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.360647 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.360627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.362121 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.362097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.362202 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.362163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.369261 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.369238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqfw8\" (UniqueName: \"kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8\") pod \"console-dd7d5988d-4f5vh\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.482866 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.482772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:03:53.653224 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.653180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776d95999-z5hkk" event={"ID":"a6eadf9d-9136-4615-8a44-bdce00cd995b","Type":"ContainerStarted","Data":"491e51a76a0302087f63c899d471d2278c1eab2d63cf1738e59b62b287008052"} Sep 09 21:03:53.797615 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:53.797589 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:03:53.800226 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:03:53.800194 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6602faf0_408d_4832_9040_8a69d240cb26.slice/crio-1becef4842d4a3776aea3075e95e52a1b1a95cf2db563dde61390c4e820fcbc1 WatchSource:0}: Error finding container 1becef4842d4a3776aea3075e95e52a1b1a95cf2db563dde61390c4e820fcbc1: Status 404 returned error can't find the container with id 1becef4842d4a3776aea3075e95e52a1b1a95cf2db563dde61390c4e820fcbc1 Sep 09 21:03:54.659507 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:54.659469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd7d5988d-4f5vh" event={"ID":"6602faf0-408d-4832-9040-8a69d240cb26","Type":"ContainerStarted","Data":"1becef4842d4a3776aea3075e95e52a1b1a95cf2db563dde61390c4e820fcbc1"} Sep 09 21:03:55.005126 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:55.005038 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:55.005126 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:55.005120 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:03:57.674976 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:57.674943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd7d5988d-4f5vh" event={"ID":"6602faf0-408d-4832-9040-8a69d240cb26","Type":"ContainerStarted","Data":"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65"} Sep 09 21:03:57.676549 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:57.676526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776d95999-z5hkk" event={"ID":"a6eadf9d-9136-4615-8a44-bdce00cd995b","Type":"ContainerStarted","Data":"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e"} Sep 09 21:03:57.700014 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:57.699958 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd7d5988d-4f5vh" podStartSLOduration=1.6596458570000001 podStartE2EDuration="4.699940597s" totalImagesPullingTime="3.04029474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:57.699057373 +0000 UTC m=+141.118830571" watchObservedRunningTime="2026-09-09 21:03:57.699940597 +0000 UTC m=+141.119713797" Sep 09 21:03:57.739212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:57.736861 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6776d95999-z5hkk" podStartSLOduration=1.773801791 podStartE2EDuration="5.736841658s" totalImagesPullingTime="3.963039867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:03:57.735121212 +0000 UTC m=+141.154894412" watchObservedRunningTime="2026-09-09 21:03:57.736841658 +0000 UTC m=+141.156614858" Sep 09 21:03:58.681878 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:58.681843 2580 generic.go:356] "Generic (PLEG): container finished" podID="13bfe6a6-4bf2-423a-a68a-b41019d1f2cc" containerID="b254f1b5570d2c24fd6cb09c9cd44d04933528c90296240da2fa17956722212e" exitCode=0 Sep 09 21:03:58.682273 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:58.681924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" event={"ID":"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc","Type":"ContainerDied","Data":"b254f1b5570d2c24fd6cb09c9cd44d04933528c90296240da2fa17956722212e"} Sep 09 21:03:58.682394 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:58.682369 2580 scope.go:117] "RemoveContainer" containerID="b254f1b5570d2c24fd6cb09c9cd44d04933528c90296240da2fa17956722212e" Sep 09 21:03:59.687586 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:03:59.687554 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l97gq" event={"ID":"13bfe6a6-4bf2-423a-a68a-b41019d1f2cc","Type":"ContainerStarted","Data":"f58e119aa7d7647fdd276c3792f9dab419fb17f1a98b5c3e0a21e13c58ffe306"} Sep 09 21:04:02.472057 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:02.472013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:02.472462 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:02.472088 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:02.476953 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:02.476924 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:02.702166 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:02.702136 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:03.483166 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:03.483128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:04:03.483597 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:03.483190 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:04:03.488107 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:03.488085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:04:03.704836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:03.704807 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:04:03.768496 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:03.768421 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:04:05.139121 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:05.139085 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7848747c5b-jlb55_a70d1270-3709-4551-8f46-1f9a0fe195e2/router/0.log" Sep 09 21:04:05.148839 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:05.148821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjwpr_a25c125c-6323-4dc6-a41b-11407e40e6e8/serve-healthcheck-canary/0.log" Sep 09 21:04:15.010767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:15.010736 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:04:15.014456 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:15.014435 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-574d646cfd-jb8fx" Sep 09 21:04:29.723990 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:29.723887 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6776d95999-z5hkk" podUID="a6eadf9d-9136-4615-8a44-bdce00cd995b" containerName="console" containerID="cri-o://89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e" gracePeriod=15 Sep 09 21:04:30.037408 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.037377 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:30.180503 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180465 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180503 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180507 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180779 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180528 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180779 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180558 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8ltr\" (UniqueName: \"kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180779 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180717 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180935 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180778 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert\") pod \"a6eadf9d-9136-4615-8a44-bdce00cd995b\" (UID: \"a6eadf9d-9136-4615-8a44-bdce00cd995b\") " Sep 09 21:04:30.180998 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.180950 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:04:30.181080 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.181053 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config" (OuterVolumeSpecName: "console-config") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:04:30.181137 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.181070 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-service-ca\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.181288 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.181242 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:04:30.182935 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.182907 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr" (OuterVolumeSpecName: "kube-api-access-q8ltr") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "kube-api-access-q8ltr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:04:30.183040 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.182928 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:04:30.183040 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.182960 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6eadf9d-9136-4615-8a44-bdce00cd995b" (UID: "a6eadf9d-9136-4615-8a44-bdce00cd995b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:04:30.286751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.282737 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8ltr\" (UniqueName: \"kubernetes.io/projected/a6eadf9d-9136-4615-8a44-bdce00cd995b-kube-api-access-q8ltr\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.286751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.282786 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.286751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.282802 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6eadf9d-9136-4615-8a44-bdce00cd995b-oauth-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.286751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.282827 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-oauth-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.286751 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.282840 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6eadf9d-9136-4615-8a44-bdce00cd995b-console-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:04:30.804546 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.804513 2580 generic.go:356] "Generic (PLEG): container finished" podID="a6eadf9d-9136-4615-8a44-bdce00cd995b" containerID="89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e" exitCode=0 Sep 09 21:04:30.804961 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.804562 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776d95999-z5hkk" event={"ID":"a6eadf9d-9136-4615-8a44-bdce00cd995b","Type":"ContainerDied","Data":"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e"} Sep 09 21:04:30.804961 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.804573 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776d95999-z5hkk" Sep 09 21:04:30.804961 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.804630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776d95999-z5hkk" event={"ID":"a6eadf9d-9136-4615-8a44-bdce00cd995b","Type":"ContainerDied","Data":"491e51a76a0302087f63c899d471d2278c1eab2d63cf1738e59b62b287008052"} Sep 09 21:04:30.804961 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.804658 2580 scope.go:117] "RemoveContainer" containerID="89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e" Sep 09 21:04:30.813268 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.813252 2580 scope.go:117] "RemoveContainer" containerID="89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e" Sep 09 21:04:30.813530 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:04:30.813509 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e\": container with ID starting with 89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e not found: ID does not exist" containerID="89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e" Sep 09 21:04:30.813595 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.813543 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e"} err="failed to get container status \"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e\": rpc error: code = NotFound desc = could not find container \"89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e\": container with ID starting with 89bae0578dc3088501d805af1572eb6d2b2d8488c5f80bf799f36ed7d05fc53e not found: ID does not exist" Sep 09 21:04:30.828160 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.828137 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:04:30.830535 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:30.830513 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6776d95999-z5hkk"] Sep 09 21:04:31.087158 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:04:31.087083 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6eadf9d-9136-4615-8a44-bdce00cd995b" path="/var/lib/kubelet/pods/a6eadf9d-9136-4615-8a44-bdce00cd995b/volumes" Sep 09 21:06:37.002571 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:06:37.002548 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 21:08:35.672254 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.672222 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b56754769-5nnxg"] Sep 09 21:08:35.672713 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.672490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6eadf9d-9136-4615-8a44-bdce00cd995b" containerName="console" Sep 09 21:08:35.672713 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.672501 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6eadf9d-9136-4615-8a44-bdce00cd995b" containerName="console" Sep 09 21:08:35.672713 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.672562 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6eadf9d-9136-4615-8a44-bdce00cd995b" containerName="console" Sep 09 21:08:35.674817 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.674801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.679062 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679042 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 21:08:35.679246 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679231 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6f6p1m12v20hu\"" Sep 09 21:08:35.679634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 21:08:35.679634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679487 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 21:08:35.679634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679508 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 21:08:35.679634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679518 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-plstc\"" Sep 09 21:08:35.679634 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.679531 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 21:08:35.688979 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.688953 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b56754769-5nnxg"] Sep 09 21:08:35.825470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnb5\" (UniqueName: \"kubernetes.io/projected/a7bfda70-a537-42ae-890e-05e3dde8af55-kube-api-access-9mnb5\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-grpc-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bfda70-a537-42ae-890e-05e3dde8af55-metrics-client-ca\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.825885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.825750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926775 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926775 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnb5\" (UniqueName: \"kubernetes.io/projected/a7bfda70-a537-42ae-890e-05e3dde8af55-kube-api-access-9mnb5\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-grpc-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.926988 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.926952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bfda70-a537-42ae-890e-05e3dde8af55-metrics-client-ca\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.927927 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.927900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bfda70-a537-42ae-890e-05e3dde8af55-metrics-client-ca\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.929635 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.929615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.929816 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.929788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-grpc-tls\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.929971 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.929952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.930174 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.930157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.930295 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.930270 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.930354 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.930343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bfda70-a537-42ae-890e-05e3dde8af55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.936803 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.936779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnb5\" (UniqueName: \"kubernetes.io/projected/a7bfda70-a537-42ae-890e-05e3dde8af55-kube-api-access-9mnb5\") pod \"thanos-querier-b56754769-5nnxg\" (UID: \"a7bfda70-a537-42ae-890e-05e3dde8af55\") " pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:35.984511 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:35.984470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:36.268192 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:36.268100 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b56754769-5nnxg"] Sep 09 21:08:36.271352 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:08:36.271323 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bfda70_a537_42ae_890e_05e3dde8af55.slice/crio-4fdc571b46fce3f344d9c0afbc705fe249097155bd004c35b62d90092c842ae6 WatchSource:0}: Error finding container 4fdc571b46fce3f344d9c0afbc705fe249097155bd004c35b62d90092c842ae6: Status 404 returned error can't find the container with id 4fdc571b46fce3f344d9c0afbc705fe249097155bd004c35b62d90092c842ae6 Sep 09 21:08:36.273488 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:36.273473 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:08:36.687333 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:36.687298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"4fdc571b46fce3f344d9c0afbc705fe249097155bd004c35b62d90092c842ae6"} Sep 09 21:08:39.703949 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:39.703906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"19dd8f63c24a397ec3d84f1e11332caaf4f76bf0d122933ec6a9493ff9c89419"} Sep 09 21:08:39.704445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:39.704001 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"f4da0980f2e49f300365fc96b4e193834abdad4e598e4cf30d7ad371ee8e5c9b"} Sep 09 21:08:39.704445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:39.704042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"537e8547613abd4a296f2171022d4df1a765c17e100d06bbf4cbb1d6cbeea3d1"} Sep 09 21:08:40.712982 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:40.712942 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"29c9bc58f4534a8bc9f606777b923ad76ce0c8161d0b0ac6a2281dddf2eadae9"} Sep 09 21:08:40.713481 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:40.713022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"3e75f3cdb4b2f2a327280625e3f5e537a8940ad09f432214103b165587544e57"} Sep 09 21:08:40.713481 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:40.713067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:08:40.713481 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:40.713107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" event={"ID":"a7bfda70-a537-42ae-890e-05e3dde8af55","Type":"ContainerStarted","Data":"07114ce5f0222f093ed35ddf032e2f7004eb30239aaab829ff207690d8806903"} Sep 09 21:08:40.745505 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:40.745449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" podStartSLOduration=2.201547197 podStartE2EDuration="5.745430428s" totalImagesPullingTime="3.543883231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:40.743504346 +0000 UTC m=+424.163277565" watchObservedRunningTime="2026-09-09 21:08:40.745430428 +0000 UTC m=+424.165203628" Sep 09 21:08:46.722535 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:08:46.722503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b56754769-5nnxg" Sep 09 21:09:56.806684 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.806637 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:09:56.809996 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.809981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.834923 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.834889 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:09:56.964200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964399 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964399 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964399 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964399 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d6m4\" (UniqueName: \"kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:56.964525 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:56.964401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d6m4\" (UniqueName: \"kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065898 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065898 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065898 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.065898 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.065713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.066350 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.066319 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.066619 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.066378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.066619 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.066377 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.066619 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.066492 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.068269 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.068241 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.068430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.068279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.076324 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.076306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d6m4\" (UniqueName: \"kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4\") pod \"console-56ff758864-5x5hg\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.119097 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.119070 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:09:57.426057 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:57.425981 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:09:57.429229 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:09:57.429204 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14d766b_96f0_4f77_babb_ce3df86da632.slice/crio-de8fc23759f7b6be3ca716e5ae1b442a3810845d358ef7be3c36c47a8e86d451 WatchSource:0}: Error finding container de8fc23759f7b6be3ca716e5ae1b442a3810845d358ef7be3c36c47a8e86d451: Status 404 returned error can't find the container with id de8fc23759f7b6be3ca716e5ae1b442a3810845d358ef7be3c36c47a8e86d451 Sep 09 21:09:58.005225 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:58.005191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ff758864-5x5hg" event={"ID":"a14d766b-96f0-4f77-babb-ce3df86da632","Type":"ContainerStarted","Data":"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0"} Sep 09 21:09:58.005609 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:58.005239 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ff758864-5x5hg" event={"ID":"a14d766b-96f0-4f77-babb-ce3df86da632","Type":"ContainerStarted","Data":"de8fc23759f7b6be3ca716e5ae1b442a3810845d358ef7be3c36c47a8e86d451"} Sep 09 21:09:58.033714 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:09:58.033635 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56ff758864-5x5hg" podStartSLOduration=2.033619582 podStartE2EDuration="2.033619582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:58.033029655 +0000 UTC m=+501.452802853" watchObservedRunningTime="2026-09-09 21:09:58.033619582 +0000 UTC m=+501.453392781" Sep 09 21:10:07.119911 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:07.119867 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:10:07.120360 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:07.119931 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:10:07.124866 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:07.124839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:10:08.047011 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:08.046980 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:10:08.105485 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:08.105453 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:10:33.128338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.128269 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dd7d5988d-4f5vh" podUID="6602faf0-408d-4832-9040-8a69d240cb26" containerName="console" containerID="cri-o://6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65" gracePeriod=15 Sep 09 21:10:33.371069 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.371048 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:10:33.457493 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457399 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqfw8\" (UniqueName: \"kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457493 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457465 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457548 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457564 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457581 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457598 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.457764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.457618 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config\") pod \"6602faf0-408d-4832-9040-8a69d240cb26\" (UID: \"6602faf0-408d-4832-9040-8a69d240cb26\") " Sep 09 21:10:33.458110 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.458077 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:10:33.458110 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.458092 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca" (OuterVolumeSpecName: "service-ca") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:10:33.458424 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.458105 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:10:33.458424 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.458321 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config" (OuterVolumeSpecName: "console-config") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:10:33.459894 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.459869 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8" (OuterVolumeSpecName: "kube-api-access-nqfw8") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "kube-api-access-nqfw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:10:33.459991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.459893 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:10:33.459991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.459936 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6602faf0-408d-4832-9040-8a69d240cb26" (UID: "6602faf0-408d-4832-9040-8a69d240cb26"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:10:33.558177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558144 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-oauth-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558171 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-trusted-ca-bundle\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558181 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6602faf0-408d-4832-9040-8a69d240cb26-console-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558190 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-service-ca\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558447 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558200 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-oauth-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558447 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558208 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6602faf0-408d-4832-9040-8a69d240cb26-console-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:33.558447 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:33.558216 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqfw8\" (UniqueName: \"kubernetes.io/projected/6602faf0-408d-4832-9040-8a69d240cb26-kube-api-access-nqfw8\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:10:34.142123 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.142087 2580 generic.go:356] "Generic (PLEG): container finished" podID="6602faf0-408d-4832-9040-8a69d240cb26" containerID="6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65" exitCode=0 Sep 09 21:10:34.142123 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.142128 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd7d5988d-4f5vh" Sep 09 21:10:34.142651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.142172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd7d5988d-4f5vh" event={"ID":"6602faf0-408d-4832-9040-8a69d240cb26","Type":"ContainerDied","Data":"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65"} Sep 09 21:10:34.142651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.142219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd7d5988d-4f5vh" event={"ID":"6602faf0-408d-4832-9040-8a69d240cb26","Type":"ContainerDied","Data":"1becef4842d4a3776aea3075e95e52a1b1a95cf2db563dde61390c4e820fcbc1"} Sep 09 21:10:34.142651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.142242 2580 scope.go:117] "RemoveContainer" containerID="6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65" Sep 09 21:10:34.151163 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.151148 2580 scope.go:117] "RemoveContainer" containerID="6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65" Sep 09 21:10:34.151415 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:10:34.151393 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65\": container with ID starting with 6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65 not found: ID does not exist" containerID="6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65" Sep 09 21:10:34.151465 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.151423 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65"} err="failed to get container status \"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65\": rpc error: code = NotFound desc = could not find container \"6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65\": container with ID starting with 6bfd2a173e430ebb3bec0b9ebd0860a133ec940314e5ecdd82c9db28d40f3d65 not found: ID does not exist" Sep 09 21:10:34.165233 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.165208 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:10:34.172606 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:34.172587 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd7d5988d-4f5vh"] Sep 09 21:10:35.087485 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:10:35.087448 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6602faf0-408d-4832-9040-8a69d240cb26" path="/var/lib/kubelet/pods/6602faf0-408d-4832-9040-8a69d240cb26/volumes" Sep 09 21:12:14.817441 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.817404 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qpkcp"] Sep 09 21:12:14.817990 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.817714 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6602faf0-408d-4832-9040-8a69d240cb26" containerName="console" Sep 09 21:12:14.817990 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.817725 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6602faf0-408d-4832-9040-8a69d240cb26" containerName="console" Sep 09 21:12:14.817990 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.817775 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6602faf0-408d-4832-9040-8a69d240cb26" containerName="console" Sep 09 21:12:14.820553 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.820538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.831927 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.831909 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 21:12:14.833217 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.833196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sc28p\"" Sep 09 21:12:14.833279 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.833255 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 21:12:14.844643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.844618 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qpkcp"] Sep 09 21:12:14.849593 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.849559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.849593 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.849589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrhc\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-kube-api-access-xwrhc\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.950169 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.950138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.950169 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.950167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrhc\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-kube-api-access-xwrhc\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.964354 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.964320 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrhc\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-kube-api-access-xwrhc\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:14.966490 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:14.966468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce61ce0f-2b63-490c-bddc-faf1af000384-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qpkcp\" (UID: \"ce61ce0f-2b63-490c-bddc-faf1af000384\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:15.138579 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:15.138486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:15.416367 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:15.416167 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qpkcp"] Sep 09 21:12:15.419159 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:12:15.419121 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce61ce0f_2b63_490c_bddc_faf1af000384.slice/crio-ad4df0bcb2b4c6b8174277b2eb307bd6e207a4bc3c88e3af69616be53deee257 WatchSource:0}: Error finding container ad4df0bcb2b4c6b8174277b2eb307bd6e207a4bc3c88e3af69616be53deee257: Status 404 returned error can't find the container with id ad4df0bcb2b4c6b8174277b2eb307bd6e207a4bc3c88e3af69616be53deee257 Sep 09 21:12:15.508342 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:15.508306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" event={"ID":"ce61ce0f-2b63-490c-bddc-faf1af000384","Type":"ContainerStarted","Data":"ad4df0bcb2b4c6b8174277b2eb307bd6e207a4bc3c88e3af69616be53deee257"} Sep 09 21:12:19.525957 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:19.525922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" event={"ID":"ce61ce0f-2b63-490c-bddc-faf1af000384","Type":"ContainerStarted","Data":"ffb5ed152381b8f22097d20b3541503f32865f7bc5d1eaaa8e2295c2ab2d9d59"} Sep 09 21:12:19.526359 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:19.526036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:19.548556 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:19.548507 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" podStartSLOduration=2.234475644 podStartE2EDuration="5.548492089s" totalImagesPullingTime="3.314016445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:19.548405195 +0000 UTC m=+642.968178405" watchObservedRunningTime="2026-09-09 21:12:19.548492089 +0000 UTC m=+642.968265287" Sep 09 21:12:23.226581 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.226549 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z"] Sep 09 21:12:23.229820 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.229805 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.233057 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.233033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 21:12:23.234050 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.234034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 21:12:23.234050 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.234042 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-28247\"" Sep 09 21:12:23.240919 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.240895 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z"] Sep 09 21:12:23.319737 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.319696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d63bf97d-5864-4c80-9cd3-38856bf8c44f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.319919 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.319760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kbch\" (UniqueName: \"kubernetes.io/projected/d63bf97d-5864-4c80-9cd3-38856bf8c44f-kube-api-access-8kbch\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.420814 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.420772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d63bf97d-5864-4c80-9cd3-38856bf8c44f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.420979 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.420828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kbch\" (UniqueName: \"kubernetes.io/projected/d63bf97d-5864-4c80-9cd3-38856bf8c44f-kube-api-access-8kbch\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.421212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.421194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d63bf97d-5864-4c80-9cd3-38856bf8c44f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.431237 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.431204 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kbch\" (UniqueName: \"kubernetes.io/projected/d63bf97d-5864-4c80-9cd3-38856bf8c44f-kube-api-access-8kbch\") pod \"openshift-lws-operator-fd8ccff4c-4hf5z\" (UID: \"d63bf97d-5864-4c80-9cd3-38856bf8c44f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.538485 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.538457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" Sep 09 21:12:23.820879 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:23.820850 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z"] Sep 09 21:12:23.822928 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:12:23.822901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd63bf97d_5864_4c80_9cd3_38856bf8c44f.slice/crio-a5733d0999a958bb389fa312bd1a0da1d9631af49d8cc147efc97111c60afcc7 WatchSource:0}: Error finding container a5733d0999a958bb389fa312bd1a0da1d9631af49d8cc147efc97111c60afcc7: Status 404 returned error can't find the container with id a5733d0999a958bb389fa312bd1a0da1d9631af49d8cc147efc97111c60afcc7 Sep 09 21:12:24.548296 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:24.548249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" event={"ID":"d63bf97d-5864-4c80-9cd3-38856bf8c44f","Type":"ContainerStarted","Data":"a5733d0999a958bb389fa312bd1a0da1d9631af49d8cc147efc97111c60afcc7"} Sep 09 21:12:25.532632 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:25.532598 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qpkcp" Sep 09 21:12:26.558232 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:26.558193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" event={"ID":"d63bf97d-5864-4c80-9cd3-38856bf8c44f","Type":"ContainerStarted","Data":"5fd426ba2b3d833a7199cbac4b363201988a203fd1250903691d0c4339442df5"} Sep 09 21:12:26.580628 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:26.580514 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hf5z" podStartSLOduration=1.091760238 podStartE2EDuration="3.580499047s" totalImagesPullingTime="2.488738809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:26.578761163 +0000 UTC m=+649.998534358" watchObservedRunningTime="2026-09-09 21:12:26.580499047 +0000 UTC m=+650.000272246" Sep 09 21:12:42.009905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.009870 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l"] Sep 09 21:12:42.013172 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.013155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.015801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.015775 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 21:12:42.016192 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.016175 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c4wl6\"" Sep 09 21:12:42.016290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.016173 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 21:12:42.016290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.016175 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 21:12:42.016290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.016207 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 21:12:42.032345 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.032313 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l"] Sep 09 21:12:42.082504 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.082470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.082504 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.082505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zkr\" (UniqueName: \"kubernetes.io/projected/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-kube-api-access-42zkr\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.082793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.082524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.082793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.082568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-manifests\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.082793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.082583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-tmp\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.183981 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.183948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.184189 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.183992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zkr\" (UniqueName: \"kubernetes.io/projected/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-kube-api-access-42zkr\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.184189 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.184177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.184348 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.184326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-manifests\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.184417 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.184368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-tmp\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.184774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.184749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-manifests\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.186578 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.186556 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-tmp\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.186662 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.186631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.186748 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.186733 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.195861 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.195837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zkr\" (UniqueName: \"kubernetes.io/projected/9bbe79e3-8e0a-4ab6-8ad6-258d041e047e-kube-api-access-42zkr\") pod \"opendatahub-operator-controller-manager-59685ff6b-hwp2l\" (UID: \"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e\") " pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.323563 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.323527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:42.625794 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:42.625716 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l"] Sep 09 21:12:42.629066 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:12:42.629039 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbe79e3_8e0a_4ab6_8ad6_258d041e047e.slice/crio-de3de2fd6a57fea5063458dbb56587fa9904bfaed9425f2bb859be320be311b9 WatchSource:0}: Error finding container de3de2fd6a57fea5063458dbb56587fa9904bfaed9425f2bb859be320be311b9: Status 404 returned error can't find the container with id de3de2fd6a57fea5063458dbb56587fa9904bfaed9425f2bb859be320be311b9 Sep 09 21:12:43.627861 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:43.627783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" event={"ID":"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e","Type":"ContainerStarted","Data":"de3de2fd6a57fea5063458dbb56587fa9904bfaed9425f2bb859be320be311b9"} Sep 09 21:12:46.644633 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:46.644601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" event={"ID":"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e","Type":"ContainerStarted","Data":"165b9fa0c92c2205cbc619dd6ee1d2da43aff864134cbd1f921a496d0bb63394"} Sep 09 21:12:47.650225 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:47.650189 2580 generic.go:356] "Generic (PLEG): container finished" podID="9bbe79e3-8e0a-4ab6-8ad6-258d041e047e" containerID="165b9fa0c92c2205cbc619dd6ee1d2da43aff864134cbd1f921a496d0bb63394" exitCode=0 Sep 09 21:12:47.650631 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:47.650279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" event={"ID":"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e","Type":"ContainerDied","Data":"165b9fa0c92c2205cbc619dd6ee1d2da43aff864134cbd1f921a496d0bb63394"} Sep 09 21:12:48.656732 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:48.656692 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" event={"ID":"9bbe79e3-8e0a-4ab6-8ad6-258d041e047e","Type":"ContainerStarted","Data":"c072b7bf018a63ef52e24b25bd0e558e6aafc96a13975c6ba12d1e2b6e94c0f0"} Sep 09 21:12:48.657132 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:48.656797 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:12:48.683138 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:48.683089 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" podStartSLOduration=3.139700635 podStartE2EDuration="7.683071931s" totalImagesPullingTime="3.501781885s" totalInitContainerRuntime="1.041589411s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:48.681092944 +0000 UTC m=+672.100866134" watchObservedRunningTime="2026-09-09 21:12:48.683071931 +0000 UTC m=+672.102845129" Sep 09 21:12:59.663946 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:12:59.663915 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59685ff6b-hwp2l" Sep 09 21:13:01.983008 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:01.982975 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67"] Sep 09 21:13:01.986406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:01.986391 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:01.989200 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:01.989180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 21:13:01.989310 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:01.989188 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 21:13:02.005474 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.005444 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67"] Sep 09 21:13:02.057544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.057514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.057739 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.057563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5ml\" (UniqueName: \"kubernetes.io/projected/d99c240a-8494-4475-bf22-c4a34474e061-kube-api-access-vh5ml\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.057739 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.057590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d99c240a-8494-4475-bf22-c4a34474e061-tmp\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.158207 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.158169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5ml\" (UniqueName: \"kubernetes.io/projected/d99c240a-8494-4475-bf22-c4a34474e061-kube-api-access-vh5ml\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.158207 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.158205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d99c240a-8494-4475-bf22-c4a34474e061-tmp\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.158465 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.158274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.158465 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:13:02.158393 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 09 21:13:02.158582 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:13:02.158477 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs podName:d99c240a-8494-4475-bf22-c4a34474e061 nodeName:}" failed. No retries permitted until 2026-09-09 21:13:02.658455148 +0000 UTC m=+686.078228536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs") pod "kube-auth-proxy-55f7b6bff6-btn67" (UID: "d99c240a-8494-4475-bf22-c4a34474e061") : secret "kube-auth-proxy-tls" not found Sep 09 21:13:02.160740 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.160719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d99c240a-8494-4475-bf22-c4a34474e061-tmp\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.171097 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.171072 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5ml\" (UniqueName: \"kubernetes.io/projected/d99c240a-8494-4475-bf22-c4a34474e061-kube-api-access-vh5ml\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.662662 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:02.662608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:02.662872 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:13:02.662785 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 09 21:13:02.662872 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:13:02.662849 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs podName:d99c240a-8494-4475-bf22-c4a34474e061 nodeName:}" failed. No retries permitted until 2026-09-09 21:13:03.662832625 +0000 UTC m=+687.082605804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs") pod "kube-auth-proxy-55f7b6bff6-btn67" (UID: "d99c240a-8494-4475-bf22-c4a34474e061") : secret "kube-auth-proxy-tls" not found Sep 09 21:13:03.672745 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:03.672701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:03.675787 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:03.675767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99c240a-8494-4475-bf22-c4a34474e061-tls-certs\") pod \"kube-auth-proxy-55f7b6bff6-btn67\" (UID: \"d99c240a-8494-4475-bf22-c4a34474e061\") " pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:03.795595 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:03.795558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" Sep 09 21:13:04.083299 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.083263 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67"] Sep 09 21:13:04.087146 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:13:04.087109 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99c240a_8494_4475_bf22_c4a34474e061.slice/crio-3ee68c7327e06a2e6a153b1b6ccfa337c4992580073abeadd673ce3f4f2bc901 WatchSource:0}: Error finding container 3ee68c7327e06a2e6a153b1b6ccfa337c4992580073abeadd673ce3f4f2bc901: Status 404 returned error can't find the container with id 3ee68c7327e06a2e6a153b1b6ccfa337c4992580073abeadd673ce3f4f2bc901 Sep 09 21:13:04.195506 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.195471 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt"] Sep 09 21:13:04.199963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.199941 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.203931 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.203909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dfg2x\"" Sep 09 21:13:04.205147 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.205130 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 21:13:04.205147 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.205140 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 21:13:04.205252 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.205196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 21:13:04.214682 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.214635 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt"] Sep 09 21:13:04.277394 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.277361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-metrics-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.277394 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.277403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggbtn\" (UniqueName: \"kubernetes.io/projected/4be008a9-3513-4446-a54e-6de248bd1911-kube-api-access-ggbtn\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.277618 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.277432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4be008a9-3513-4446-a54e-6de248bd1911-manager-config\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.277618 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.277555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.378819 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.378722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4be008a9-3513-4446-a54e-6de248bd1911-manager-config\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.378819 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.378808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.379009 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.378857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-metrics-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.379009 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.378903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggbtn\" (UniqueName: \"kubernetes.io/projected/4be008a9-3513-4446-a54e-6de248bd1911-kube-api-access-ggbtn\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.379588 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.379476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4be008a9-3513-4446-a54e-6de248bd1911-manager-config\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.381430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.381407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-metrics-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.381537 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.381463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be008a9-3513-4446-a54e-6de248bd1911-cert\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.406102 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.406071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggbtn\" (UniqueName: \"kubernetes.io/projected/4be008a9-3513-4446-a54e-6de248bd1911-kube-api-access-ggbtn\") pod \"lws-controller-manager-57b847cbcb-5rnwt\" (UID: \"4be008a9-3513-4446-a54e-6de248bd1911\") " pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.509394 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.509350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:04.730845 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.730762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" event={"ID":"d99c240a-8494-4475-bf22-c4a34474e061","Type":"ContainerStarted","Data":"3ee68c7327e06a2e6a153b1b6ccfa337c4992580073abeadd673ce3f4f2bc901"} Sep 09 21:13:04.793156 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:04.793127 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt"] Sep 09 21:13:04.796384 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:13:04.796350 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be008a9_3513_4446_a54e_6de248bd1911.slice/crio-551af7d4bef62496832e0b533e555e0a987e8455c34c4150d8e02c480412f0e9 WatchSource:0}: Error finding container 551af7d4bef62496832e0b533e555e0a987e8455c34c4150d8e02c480412f0e9: Status 404 returned error can't find the container with id 551af7d4bef62496832e0b533e555e0a987e8455c34c4150d8e02c480412f0e9 Sep 09 21:13:05.737782 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:05.737746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" event={"ID":"4be008a9-3513-4446-a54e-6de248bd1911","Type":"ContainerStarted","Data":"551af7d4bef62496832e0b533e555e0a987e8455c34c4150d8e02c480412f0e9"} Sep 09 21:13:07.749934 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:07.749905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" event={"ID":"d99c240a-8494-4475-bf22-c4a34474e061","Type":"ContainerStarted","Data":"8fecfd930a5d64d7b21e7b823cc29463fe5aecba8f75f925e47c550b034d7796"} Sep 09 21:13:07.770537 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:07.770479 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55f7b6bff6-btn67" podStartSLOduration=4.038229265 podStartE2EDuration="6.770462349s" totalImagesPullingTime="2.732233084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:07.769165196 +0000 UTC m=+691.188938396" watchObservedRunningTime="2026-09-09 21:13:07.770462349 +0000 UTC m=+691.190235547" Sep 09 21:13:08.756338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:08.756301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" event={"ID":"4be008a9-3513-4446-a54e-6de248bd1911","Type":"ContainerStarted","Data":"16e63fec163f47fe8df32d59be9450ed3d79e0da2702bd705dbbd7752bbcb892"} Sep 09 21:13:08.777829 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:08.777758 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" podStartSLOduration=1.906264369 podStartE2EDuration="4.777738417s" totalImagesPullingTime="2.871474048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:08.777372906 +0000 UTC m=+692.197146105" watchObservedRunningTime="2026-09-09 21:13:08.777738417 +0000 UTC m=+692.197511617" Sep 09 21:13:09.760318 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:09.760289 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:13:20.766745 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:13:20.766712 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57b847cbcb-5rnwt" Sep 09 21:14:01.506767 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.506729 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7456b7cd-444pm"] Sep 09 21:14:01.509909 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.509888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.525542 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.525507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7456b7cd-444pm"] Sep 09 21:14:01.574470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfn5\" (UniqueName: \"kubernetes.io/projected/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-kube-api-access-cnfn5\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-service-ca\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-oauth-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-oauth-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.574741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.574717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-trusted-ca-bundle\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675663 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-oauth-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675663 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-trusted-ca-bundle\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfn5\" (UniqueName: \"kubernetes.io/projected/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-kube-api-access-cnfn5\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-service-ca\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.675962 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.675895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-oauth-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.676641 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.676615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-oauth-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.676777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.676627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-trusted-ca-bundle\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.676777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.676626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.676964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.676937 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-service-ca\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.678407 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.678383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-serving-cert\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.678407 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.678393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-console-oauth-config\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.690394 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.690365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfn5\" (UniqueName: \"kubernetes.io/projected/e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de-kube-api-access-cnfn5\") pod \"console-7c7456b7cd-444pm\" (UID: \"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de\") " pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:01.822324 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:01.822281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:02.102717 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:02.102688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7456b7cd-444pm"] Sep 09 21:14:02.108013 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:14:02.107984 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c0bfab_7c41_4485_a5d7_2fe7f0bc46de.slice/crio-44acd70c6c3cd3cfc6915f95aece68658cd6d42d6b8a5d5b84e84ff97b8656dd WatchSource:0}: Error finding container 44acd70c6c3cd3cfc6915f95aece68658cd6d42d6b8a5d5b84e84ff97b8656dd: Status 404 returned error can't find the container with id 44acd70c6c3cd3cfc6915f95aece68658cd6d42d6b8a5d5b84e84ff97b8656dd Sep 09 21:14:02.987571 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:02.987538 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7456b7cd-444pm" event={"ID":"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de","Type":"ContainerStarted","Data":"dc2b521b9b3d69ec15e734d75f0b2139151380b62cde14474b7f82ccd56374ca"} Sep 09 21:14:02.988019 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:02.987597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7456b7cd-444pm" event={"ID":"e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de","Type":"ContainerStarted","Data":"44acd70c6c3cd3cfc6915f95aece68658cd6d42d6b8a5d5b84e84ff97b8656dd"} Sep 09 21:14:03.016506 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:03.016449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7456b7cd-444pm" podStartSLOduration=2.01643136 podStartE2EDuration="2.01643136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:14:03.014020638 +0000 UTC m=+746.433793965" watchObservedRunningTime="2026-09-09 21:14:03.01643136 +0000 UTC m=+746.436204559" Sep 09 21:14:11.823265 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:11.823212 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:11.823740 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:11.823305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:11.828170 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:11.828140 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:12.034470 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:12.034438 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7456b7cd-444pm" Sep 09 21:14:12.095520 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:12.095438 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:14:37.118014 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.117979 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56ff758864-5x5hg" podUID="a14d766b-96f0-4f77-babb-ce3df86da632" containerName="console" containerID="cri-o://86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0" gracePeriod=15 Sep 09 21:14:37.374411 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.374347 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:14:37.389341 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389316 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389352 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389379 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389397 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d6m4\" (UniqueName: \"kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389412 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389452 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389442 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389726 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle\") pod \"a14d766b-96f0-4f77-babb-ce3df86da632\" (UID: \"a14d766b-96f0-4f77-babb-ce3df86da632\") " Sep 09 21:14:37.389726 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389701 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:14:37.389836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389781 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca" (OuterVolumeSpecName: "service-ca") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:14:37.389836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.389804 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-oauth-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.390109 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.390072 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:14:37.390212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.390104 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config" (OuterVolumeSpecName: "console-config") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:14:37.391881 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.391856 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:14:37.392263 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.392244 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:14:37.392340 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.392260 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4" (OuterVolumeSpecName: "kube-api-access-5d6m4") pod "a14d766b-96f0-4f77-babb-ce3df86da632" (UID: "a14d766b-96f0-4f77-babb-ce3df86da632"). InnerVolumeSpecName "kube-api-access-5d6m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:14:37.490559 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490528 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-service-ca\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.490559 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490556 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-oauth-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.490559 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490566 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d6m4\" (UniqueName: \"kubernetes.io/projected/a14d766b-96f0-4f77-babb-ce3df86da632-kube-api-access-5d6m4\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.490822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490575 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a14d766b-96f0-4f77-babb-ce3df86da632-console-serving-cert\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.490822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490583 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-console-config\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:37.490822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:37.490591 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14d766b-96f0-4f77-babb-ce3df86da632-trusted-ca-bundle\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:14:38.143541 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.143511 2580 generic.go:356] "Generic (PLEG): container finished" podID="a14d766b-96f0-4f77-babb-ce3df86da632" containerID="86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0" exitCode=0 Sep 09 21:14:38.143964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.143557 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ff758864-5x5hg" Sep 09 21:14:38.143964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.143605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ff758864-5x5hg" event={"ID":"a14d766b-96f0-4f77-babb-ce3df86da632","Type":"ContainerDied","Data":"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0"} Sep 09 21:14:38.143964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.143649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ff758864-5x5hg" event={"ID":"a14d766b-96f0-4f77-babb-ce3df86da632","Type":"ContainerDied","Data":"de8fc23759f7b6be3ca716e5ae1b442a3810845d358ef7be3c36c47a8e86d451"} Sep 09 21:14:38.143964 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.143686 2580 scope.go:117] "RemoveContainer" containerID="86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0" Sep 09 21:14:38.152774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.152749 2580 scope.go:117] "RemoveContainer" containerID="86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0" Sep 09 21:14:38.153034 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:14:38.153016 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0\": container with ID starting with 86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0 not found: ID does not exist" containerID="86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0" Sep 09 21:14:38.153089 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.153042 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0"} err="failed to get container status \"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0\": rpc error: code = NotFound desc = could not find container \"86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0\": container with ID starting with 86a76c19550ad82e79db4310f63b1663759a8ce88659c139de75c436ec2b14c0 not found: ID does not exist" Sep 09 21:14:38.172499 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.172475 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:14:38.178314 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:38.178293 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56ff758864-5x5hg"] Sep 09 21:14:39.087937 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:14:39.087906 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a14d766b-96f0-4f77-babb-ce3df86da632" path="/var/lib/kubelet/pods/a14d766b-96f0-4f77-babb-ce3df86da632/volumes" Sep 09 21:15:39.505375 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.505330 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:15:39.505814 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.505692 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14d766b-96f0-4f77-babb-ce3df86da632" containerName="console" Sep 09 21:15:39.505814 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.505708 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14d766b-96f0-4f77-babb-ce3df86da632" containerName="console" Sep 09 21:15:39.505814 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.505764 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a14d766b-96f0-4f77-babb-ce3df86da632" containerName="console" Sep 09 21:15:39.509683 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.509655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.512919 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.512896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 21:15:39.513049 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.513007 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgh6p\"" Sep 09 21:15:39.513237 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.513222 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 21:15:39.513317 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.513243 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 21:15:39.518198 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.518177 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:15:39.555455 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.555426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:15:39.610598 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.610565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/491c967c-ccaa-4ede-b2d7-2103ed88c25e-config-file\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.610755 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.610630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqxm\" (UniqueName: \"kubernetes.io/projected/491c967c-ccaa-4ede-b2d7-2103ed88c25e-kube-api-access-5zqxm\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.711654 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.711620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/491c967c-ccaa-4ede-b2d7-2103ed88c25e-config-file\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.711831 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.711699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqxm\" (UniqueName: \"kubernetes.io/projected/491c967c-ccaa-4ede-b2d7-2103ed88c25e-kube-api-access-5zqxm\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.712303 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.712278 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/491c967c-ccaa-4ede-b2d7-2103ed88c25e-config-file\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.720822 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.720794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqxm\" (UniqueName: \"kubernetes.io/projected/491c967c-ccaa-4ede-b2d7-2103ed88c25e-kube-api-access-5zqxm\") pod \"limitador-limitador-84994f7ffc-rl7t7\" (UID: \"491c967c-ccaa-4ede-b2d7-2103ed88c25e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.820635 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.820603 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:39.858203 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.858159 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:39.862085 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.862064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:39.865340 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.865311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nm6dw\"" Sep 09 21:15:39.871469 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.871000 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:39.913044 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:39.913011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9lp\" (UniqueName: \"kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp\") pod \"authorino-7bcfd8f9cd-sc8v9\" (UID: \"917fc2c2-fecf-45a1-a156-2535060f1674\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:40.013788 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.013747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9lp\" (UniqueName: \"kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp\") pod \"authorino-7bcfd8f9cd-sc8v9\" (UID: \"917fc2c2-fecf-45a1-a156-2535060f1674\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:40.030082 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.030051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9lp\" (UniqueName: \"kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp\") pod \"authorino-7bcfd8f9cd-sc8v9\" (UID: \"917fc2c2-fecf-45a1-a156-2535060f1674\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:40.099714 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.099623 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:15:40.102831 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:15:40.102802 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491c967c_ccaa_4ede_b2d7_2103ed88c25e.slice/crio-bf9f017e089975ff28782f27be836781bec6df8ab890e11ef258ba9eac5caa48 WatchSource:0}: Error finding container bf9f017e089975ff28782f27be836781bec6df8ab890e11ef258ba9eac5caa48: Status 404 returned error can't find the container with id bf9f017e089975ff28782f27be836781bec6df8ab890e11ef258ba9eac5caa48 Sep 09 21:15:40.104899 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.104877 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:15:40.175410 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.175380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:40.424472 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.424388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" event={"ID":"491c967c-ccaa-4ede-b2d7-2103ed88c25e","Type":"ContainerStarted","Data":"bf9f017e089975ff28782f27be836781bec6df8ab890e11ef258ba9eac5caa48"} Sep 09 21:15:40.448212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:40.448170 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:40.453243 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:15:40.453211 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod917fc2c2_fecf_45a1_a156_2535060f1674.slice/crio-52fefbb55630d4d827baeb8535fd528c828be080bc50a044d2283f2732c6a188 WatchSource:0}: Error finding container 52fefbb55630d4d827baeb8535fd528c828be080bc50a044d2283f2732c6a188: Status 404 returned error can't find the container with id 52fefbb55630d4d827baeb8535fd528c828be080bc50a044d2283f2732c6a188 Sep 09 21:15:41.437514 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:41.437458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" event={"ID":"917fc2c2-fecf-45a1-a156-2535060f1674","Type":"ContainerStarted","Data":"52fefbb55630d4d827baeb8535fd528c828be080bc50a044d2283f2732c6a188"} Sep 09 21:15:43.287979 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.287945 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:43.448963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.448925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" event={"ID":"917fc2c2-fecf-45a1-a156-2535060f1674","Type":"ContainerStarted","Data":"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a"} Sep 09 21:15:43.450544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.450518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" event={"ID":"491c967c-ccaa-4ede-b2d7-2103ed88c25e","Type":"ContainerStarted","Data":"b764e940a69792c25f22e99b7e116cb56b4ce21c48b7db538e9688ddfb48835b"} Sep 09 21:15:43.450660 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.450578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:15:43.475520 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.475479 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" podStartSLOduration=1.901247935 podStartE2EDuration="4.475466071s" totalImagesPullingTime="2.574218136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:15:43.473584836 +0000 UTC m=+846.893358036" watchObservedRunningTime="2026-09-09 21:15:43.475466071 +0000 UTC m=+846.895239271" Sep 09 21:15:43.503235 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:43.503189 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" podStartSLOduration=1.585089644 podStartE2EDuration="4.503173768s" totalImagesPullingTime="2.918084124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:15:43.500786677 +0000 UTC m=+846.920559877" watchObservedRunningTime="2026-09-09 21:15:43.503173768 +0000 UTC m=+846.922946968" Sep 09 21:15:44.454430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:44.454387 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" podUID="917fc2c2-fecf-45a1-a156-2535060f1674" containerName="authorino" containerID="cri-o://7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a" gracePeriod=30 Sep 09 21:15:44.706838 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:44.706783 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:44.855548 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:44.855512 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n9lp\" (UniqueName: \"kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp\") pod \"917fc2c2-fecf-45a1-a156-2535060f1674\" (UID: \"917fc2c2-fecf-45a1-a156-2535060f1674\") " Sep 09 21:15:44.857929 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:44.857902 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp" (OuterVolumeSpecName: "kube-api-access-4n9lp") pod "917fc2c2-fecf-45a1-a156-2535060f1674" (UID: "917fc2c2-fecf-45a1-a156-2535060f1674"). InnerVolumeSpecName "kube-api-access-4n9lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:15:44.956623 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:44.956584 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n9lp\" (UniqueName: \"kubernetes.io/projected/917fc2c2-fecf-45a1-a156-2535060f1674-kube-api-access-4n9lp\") on node \"ip-10-0-137-243.ec2.internal\" DevicePath \"\"" Sep 09 21:15:45.459719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.459612 2580 generic.go:356] "Generic (PLEG): container finished" podID="917fc2c2-fecf-45a1-a156-2535060f1674" containerID="7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a" exitCode=0 Sep 09 21:15:45.459719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.459656 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" Sep 09 21:15:45.459719 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.459706 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" event={"ID":"917fc2c2-fecf-45a1-a156-2535060f1674","Type":"ContainerDied","Data":"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a"} Sep 09 21:15:45.460319 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.459752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sc8v9" event={"ID":"917fc2c2-fecf-45a1-a156-2535060f1674","Type":"ContainerDied","Data":"52fefbb55630d4d827baeb8535fd528c828be080bc50a044d2283f2732c6a188"} Sep 09 21:15:45.460319 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.459772 2580 scope.go:117] "RemoveContainer" containerID="7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a" Sep 09 21:15:45.468085 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.468069 2580 scope.go:117] "RemoveContainer" containerID="7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a" Sep 09 21:15:45.468350 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:15:45.468332 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a\": container with ID starting with 7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a not found: ID does not exist" containerID="7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a" Sep 09 21:15:45.468418 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.468358 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a"} err="failed to get container status \"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a\": rpc error: code = NotFound desc = could not find container \"7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a\": container with ID starting with 7e758229dffc10e16add6083bf5ebad96f1b1c19d6630050312edc91fca1831a not found: ID does not exist" Sep 09 21:15:45.480158 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.480137 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:45.482618 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:45.482598 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sc8v9"] Sep 09 21:15:47.087904 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:47.087870 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="917fc2c2-fecf-45a1-a156-2535060f1674" path="/var/lib/kubelet/pods/917fc2c2-fecf-45a1-a156-2535060f1674/volumes" Sep 09 21:15:54.455139 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:15:54.455107 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-rl7t7" Sep 09 21:16:54.536643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:16:54.536607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:13.919391 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.919354 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7"] Sep 09 21:17:13.919801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.919710 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="917fc2c2-fecf-45a1-a156-2535060f1674" containerName="authorino" Sep 09 21:17:13.919801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.919723 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="917fc2c2-fecf-45a1-a156-2535060f1674" containerName="authorino" Sep 09 21:17:13.919801 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.919792 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="917fc2c2-fecf-45a1-a156-2535060f1674" containerName="authorino" Sep 09 21:17:13.922784 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.922757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:13.925723 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.925702 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 21:17:13.925866 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.925728 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 09 21:17:13.926837 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.926814 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 21:17:13.926929 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.926912 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4pf52\"" Sep 09 21:17:13.937536 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:13.937511 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7"] Sep 09 21:17:14.011052 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.011251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpm9j\" (UniqueName: \"kubernetes.io/projected/25ff437b-43b3-480c-9f49-a7d299923985-kube-api-access-fpm9j\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.011251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.011251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.011251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.011251 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.011226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ff437b-43b3-480c-9f49-a7d299923985-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112164 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpm9j\" (UniqueName: \"kubernetes.io/projected/25ff437b-43b3-480c-9f49-a7d299923985-kube-api-access-fpm9j\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112164 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ff437b-43b3-480c-9f49-a7d299923985-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112647 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112752 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.112833 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.112807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.114762 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.114739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25ff437b-43b3-480c-9f49-a7d299923985-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.115120 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.115101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25ff437b-43b3-480c-9f49-a7d299923985-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.123703 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.123657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpm9j\" (UniqueName: \"kubernetes.io/projected/25ff437b-43b3-480c-9f49-a7d299923985-kube-api-access-fpm9j\") pod \"e2e-distinct-2-simulated-kserve-859856b874-9k5j7\" (UID: \"25ff437b-43b3-480c-9f49-a7d299923985\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.233015 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.232918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:14.507524 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.507478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7"] Sep 09 21:17:14.510123 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:17:14.510096 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ff437b_43b3_480c_9f49_a7d299923985.slice/crio-75a667626ecec1b7bdb78304e3d247d7f3bab07015e21d18a36d1e81a7933329 WatchSource:0}: Error finding container 75a667626ecec1b7bdb78304e3d247d7f3bab07015e21d18a36d1e81a7933329: Status 404 returned error can't find the container with id 75a667626ecec1b7bdb78304e3d247d7f3bab07015e21d18a36d1e81a7933329 Sep 09 21:17:14.607837 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.607804 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:14.855503 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:14.855424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerStarted","Data":"75a667626ecec1b7bdb78304e3d247d7f3bab07015e21d18a36d1e81a7933329"} Sep 09 21:17:15.861987 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:15.861945 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="58dcf4cbcf3cfbcfe62cb8ca27f836c6beacf23e63f285963b261b6668e50dc0" exitCode=0 Sep 09 21:17:15.862449 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:15.862035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"58dcf4cbcf3cfbcfe62cb8ca27f836c6beacf23e63f285963b261b6668e50dc0"} Sep 09 21:17:15.862449 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:15.862248 2580 scope.go:117] "RemoveContainer" containerID="58dcf4cbcf3cfbcfe62cb8ca27f836c6beacf23e63f285963b261b6668e50dc0" Sep 09 21:17:16.868825 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:16.868789 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" exitCode=0 Sep 09 21:17:16.869290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:16.868844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c"} Sep 09 21:17:16.869290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:16.868906 2580 scope.go:117] "RemoveContainer" containerID="58dcf4cbcf3cfbcfe62cb8ca27f836c6beacf23e63f285963b261b6668e50dc0" Sep 09 21:17:16.869290 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:16.869184 2580 scope.go:117] "RemoveContainer" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" Sep 09 21:17:16.869462 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:16.869375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:17:17.875632 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:17.875605 2580 scope.go:117] "RemoveContainer" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" Sep 09 21:17:17.876030 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:17.875825 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:17:24.233048 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:24.232996 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:24.233469 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:24.233075 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:24.233469 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:24.233091 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:24.233469 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:24.233106 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:24.233577 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:24.233472 2580 scope.go:117] "RemoveContainer" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" Sep 09 21:17:24.233647 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:24.233629 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:17:28.015942 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:28.015901 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:37.084180 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.084147 2580 scope.go:117] "RemoveContainer" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" Sep 09 21:17:37.512829 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.512796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:37.968827 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.968793 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" exitCode=0 Sep 09 21:17:37.969012 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.968853 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0"} Sep 09 21:17:37.969012 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.968897 2580 scope.go:117] "RemoveContainer" containerID="92b522f91934f0afe52862c5e98d229aadde7fb4f31a7475e9923a6e6a81c11c" Sep 09 21:17:37.969238 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:37.969219 2580 scope.go:117] "RemoveContainer" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" Sep 09 21:17:37.969437 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:37.969418 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:17:44.233766 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:44.233729 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:44.234216 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:44.233793 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:44.234216 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:44.233808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:44.234216 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:44.233821 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:17:44.234216 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:44.234140 2580 scope.go:117] "RemoveContainer" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" Sep 09 21:17:44.234358 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:44.234294 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:17:45.726177 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:45.726134 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:54.405628 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.405588 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz"] Sep 09 21:17:54.411137 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.411100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.414563 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.414539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 21:17:54.423525 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.423499 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz"] Sep 09 21:17:54.454731 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.454885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b90467-eb09-4f38-943b-928a4e92b384-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.454885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhvv9\" (UniqueName: \"kubernetes.io/projected/82b90467-eb09-4f38-943b-928a4e92b384-kube-api-access-jhvv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.454885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.454998 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.454998 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.454909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555441 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555441 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b90467-eb09-4f38-943b-928a4e92b384-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555441 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhvv9\" (UniqueName: \"kubernetes.io/projected/82b90467-eb09-4f38-943b-928a4e92b384-kube-api-access-jhvv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555777 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555944 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555917 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.555998 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.556034 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.555995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.557992 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.557962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b90467-eb09-4f38-943b-928a4e92b384-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.558232 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.558215 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b90467-eb09-4f38-943b-928a4e92b384-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.565764 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.565741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhvv9\" (UniqueName: \"kubernetes.io/projected/82b90467-eb09-4f38-943b-928a4e92b384-kube-api-access-jhvv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz\" (UID: \"82b90467-eb09-4f38-943b-928a4e92b384\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:54.722936 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:54.722850 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:17:55.005107 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:55.005058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz"] Sep 09 21:17:55.007397 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:17:55.007360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b90467_eb09_4f38_943b_928a4e92b384.slice/crio-c78781697aa4b835649a93c8f21063448a202e6de895ed572b8d2873de3780fe WatchSource:0}: Error finding container c78781697aa4b835649a93c8f21063448a202e6de895ed572b8d2873de3780fe: Status 404 returned error can't find the container with id c78781697aa4b835649a93c8f21063448a202e6de895ed572b8d2873de3780fe Sep 09 21:17:55.048461 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:55.048418 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" event={"ID":"82b90467-eb09-4f38-943b-928a4e92b384","Type":"ContainerStarted","Data":"c78781697aa4b835649a93c8f21063448a202e6de895ed572b8d2873de3780fe"} Sep 09 21:17:56.053324 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:56.053289 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:17:56.054991 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:56.054968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" event={"ID":"82b90467-eb09-4f38-943b-928a4e92b384","Type":"ContainerStarted","Data":"ce1431a9e118c9dc5036eed7b4d97c2babae4b90bc6facb06eede1ca816f68b0"} Sep 09 21:17:56.076184 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:56.076074 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" podStartSLOduration=1.874303454 podStartE2EDuration="2.076053721s" totalImagesPullingTime="201.750267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:17:56.075817473 +0000 UTC m=+979.495590671" watchObservedRunningTime="2026-09-09 21:17:56.076053721 +0000 UTC m=+979.495826923" Sep 09 21:17:57.084153 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:17:57.084118 2580 scope.go:117] "RemoveContainer" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" Sep 09 21:17:57.084574 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:17:57.084323 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:18:04.723373 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:04.723276 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:18:04.723373 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:04.723347 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:18:04.735913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:04.735888 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:18:05.106562 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:05.106537 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz" Sep 09 21:18:11.082114 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:11.082083 2580 scope.go:117] "RemoveContainer" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" Sep 09 21:18:12.134416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:12.134384 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" exitCode=0 Sep 09 21:18:12.134867 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:12.134427 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e"} Sep 09 21:18:12.134867 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:12.134472 2580 scope.go:117] "RemoveContainer" containerID="35521c660031419d08e08919e28c463e519e739fcdf0de761f2017d0391c41e0" Sep 09 21:18:12.134867 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:12.134844 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:12.135050 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:12.135027 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:18:14.233573 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:14.233537 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:18:14.233963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:14.233606 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:18:14.233963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:14.233625 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:18:14.233963 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:14.233637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:18:14.234061 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:14.234002 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:14.234182 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:14.234162 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:18:15.113092 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:15.113056 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:18:20.845120 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.845086 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr"] Sep 09 21:18:20.848344 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.848328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.852504 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.852485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 09 21:18:20.866956 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.866931 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr"] Sep 09 21:18:20.981934 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.981888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.982125 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.981958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.982125 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.982020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbx6g\" (UniqueName: \"kubernetes.io/projected/2e53f598-1656-4df0-8516-2dac8031ba2b-kube-api-access-qbx6g\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.982125 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.982043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.982125 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.982073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e53f598-1656-4df0-8516-2dac8031ba2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:20.982284 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:20.982184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083212 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx6g\" (UniqueName: \"kubernetes.io/projected/2e53f598-1656-4df0-8516-2dac8031ba2b-kube-api-access-qbx6g\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083406 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e53f598-1656-4df0-8516-2dac8031ba2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083704 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083598 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.083793 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.083771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.085732 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.085708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e53f598-1656-4df0-8516-2dac8031ba2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.086263 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.086247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e53f598-1656-4df0-8516-2dac8031ba2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.095854 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.095798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbx6g\" (UniqueName: \"kubernetes.io/projected/2e53f598-1656-4df0-8516-2dac8031ba2b-kube-api-access-qbx6g\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-8xchr\" (UID: \"2e53f598-1656-4df0-8516-2dac8031ba2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.156823 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.156783 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:21.437861 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:21.437834 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr"] Sep 09 21:18:21.439686 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:18:21.439645 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e53f598_1656_4df0_8516_2dac8031ba2b.slice/crio-d9b39e9dd7c04a4f09f2a390a0096cc8ee880167a0d7ccee2707ebd2761ba64c WatchSource:0}: Error finding container d9b39e9dd7c04a4f09f2a390a0096cc8ee880167a0d7ccee2707ebd2761ba64c: Status 404 returned error can't find the container with id d9b39e9dd7c04a4f09f2a390a0096cc8ee880167a0d7ccee2707ebd2761ba64c Sep 09 21:18:22.181299 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:22.181267 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="6c0cef18c62bae74c83b6361ddcf400ddbe8134817df647d50175f505272f9ac" exitCode=0 Sep 09 21:18:22.181709 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:22.181310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"6c0cef18c62bae74c83b6361ddcf400ddbe8134817df647d50175f505272f9ac"} Sep 09 21:18:22.181709 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:22.181347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerStarted","Data":"d9b39e9dd7c04a4f09f2a390a0096cc8ee880167a0d7ccee2707ebd2761ba64c"} Sep 09 21:18:22.181709 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:22.181591 2580 scope.go:117] "RemoveContainer" containerID="6c0cef18c62bae74c83b6361ddcf400ddbe8134817df647d50175f505272f9ac" Sep 09 21:18:23.187366 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:23.187333 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" exitCode=0 Sep 09 21:18:23.187836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:23.187426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac"} Sep 09 21:18:23.187836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:23.187483 2580 scope.go:117] "RemoveContainer" containerID="6c0cef18c62bae74c83b6361ddcf400ddbe8134817df647d50175f505272f9ac" Sep 09 21:18:23.187836 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:23.187758 2580 scope.go:117] "RemoveContainer" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" Sep 09 21:18:23.187986 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:23.187964 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:18:23.225501 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:23.225467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rl7t7"] Sep 09 21:18:24.193223 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:24.193193 2580 scope.go:117] "RemoveContainer" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" Sep 09 21:18:24.193612 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:24.193357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:18:28.081975 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:28.081943 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:28.082386 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:28.082131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:18:31.157058 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:31.157023 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:31.157432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:31.157069 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:31.157432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:31.157080 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:31.157432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:31.157088 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:31.157432 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:31.157417 2580 scope.go:117] "RemoveContainer" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" Sep 09 21:18:31.157595 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:31.157577 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:18:42.081967 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:42.081929 2580 scope.go:117] "RemoveContainer" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" Sep 09 21:18:43.083075 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:43.083040 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:43.083451 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:43.083266 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:18:43.285913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:43.285876 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d" exitCode=0 Sep 09 21:18:43.286102 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:43.285958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d"} Sep 09 21:18:43.286102 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:43.286017 2580 scope.go:117] "RemoveContainer" containerID="33dcb4872e1a8419b9e14d5c57003333d7df698816d0dd5801ed363e1f25e6ac" Sep 09 21:18:43.286385 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:43.286371 2580 scope.go:117] "RemoveContainer" containerID="842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d" Sep 09 21:18:43.286543 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:43.286526 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:18:51.157899 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:51.157860 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:51.157899 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:51.157911 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:51.158372 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:51.157922 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:51.158372 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:51.157931 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:18:51.158372 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:51.158280 2580 scope.go:117] "RemoveContainer" containerID="842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d" Sep 09 21:18:51.158470 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:51.158436 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:18:57.084331 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:57.084302 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:58.358898 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:58.358866 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" exitCode=0 Sep 09 21:18:58.359338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:58.358934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a"} Sep 09 21:18:58.359338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:58.359021 2580 scope.go:117] "RemoveContainer" containerID="46fee6c22483e91f09288b3f19ad384d18f4eff4493b04acbf11f76e20dfbb3e" Sep 09 21:18:58.359483 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:18:58.359365 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:18:58.359596 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:18:58.359568 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:19:04.233096 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:04.233055 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:19:04.233529 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:04.233132 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:19:04.233529 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:04.233153 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:19:04.233529 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:04.233172 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:19:04.233632 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:04.233561 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:19:04.233779 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:04.233759 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:19:06.082184 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:06.082155 2580 scope.go:117] "RemoveContainer" containerID="842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d" Sep 09 21:19:06.401924 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:06.401898 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerStarted","Data":"177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa"} Sep 09 21:19:06.435097 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:06.435049 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podStartSLOduration=45.625254284 podStartE2EDuration="46.435032392s" totalImagesPullingTime="809.778108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:18:20 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:06.433837982 +0000 UTC m=+1049.853611192" watchObservedRunningTime="2026-09-09 21:19:06.435032392 +0000 UTC m=+1049.854805590" Sep 09 21:19:07.408281 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:07.408250 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" exitCode=0 Sep 09 21:19:07.408733 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:07.408298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa"} Sep 09 21:19:07.408733 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:07.408336 2580 scope.go:117] "RemoveContainer" containerID="842679155f64949528fc6799b2f5de2a6e26be642fa7e494fbd1fc7db7b0156d" Sep 09 21:19:07.408733 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:07.408686 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:07.408918 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:07.408898 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:19:11.157362 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:11.157310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:19:11.157885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:11.157380 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:19:11.157885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:11.157395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:19:11.157885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:11.157408 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:19:11.157885 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:11.157875 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:11.158117 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:11.158095 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:19:18.082135 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:18.082101 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:19:18.082505 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:18.082283 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:19:23.087850 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:23.087821 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:23.088354 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:23.088009 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:19:32.082543 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:32.082473 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:19:32.083058 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:32.082648 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:19:38.082100 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:38.082066 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:38.082498 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:38.082237 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:19:47.084340 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:47.084309 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:19:47.084751 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:47.084483 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:19:52.082516 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:52.082478 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:52.612817 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:52.612732 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" exitCode=0 Sep 09 21:19:52.612817 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:52.612809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f"} Sep 09 21:19:52.613040 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:52.612859 2580 scope.go:117] "RemoveContainer" containerID="177eefa71771466b17a5c756a9ba034c114c5be432cd2d506edd4dd37a6c6dfa" Sep 09 21:19:52.613228 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:19:52.613205 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:19:52.613415 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:19:52.613397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:20:00.082285 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:00.082251 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:20:00.082742 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:00.082442 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:01.156913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:01.156863 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:20:01.156913 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:01.156929 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:20:01.157377 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:01.156941 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:20:01.157377 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:01.156965 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:20:01.157377 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:01.157324 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:20:01.157516 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:01.157486 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:20:12.082926 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:12.082896 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:20:12.083469 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:12.083005 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:20:12.083469 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:12.083067 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:20:12.083469 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:12.083208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:25.082616 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.082581 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:20:25.083144 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.082780 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:20:25.083144 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:25.082976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:20:25.765643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.765551 2580 generic.go:356] "Generic (PLEG): container finished" podID="25ff437b-43b3-480c-9f49-a7d299923985" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" exitCode=0 Sep 09 21:20:25.765643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.765595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" event={"ID":"25ff437b-43b3-480c-9f49-a7d299923985","Type":"ContainerDied","Data":"11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a"} Sep 09 21:20:25.765643 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.765642 2580 scope.go:117] "RemoveContainer" containerID="e5ef8e0c164627224093778ecb3a0fc51f81524709a3d2229238802fc3953d0a" Sep 09 21:20:25.766063 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:25.766044 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:20:25.766297 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:25.766276 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:34.233082 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.233043 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:20:34.233518 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.233134 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:20:34.233518 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.233169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:20:34.233518 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.233186 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" Sep 09 21:20:34.233518 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.233507 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:20:34.233715 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:34.233696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:34.808624 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:34.808596 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:20:34.808834 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:34.808818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:37.084053 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:37.084021 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:20:37.084506 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:37.084196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:20:46.082066 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:46.082032 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:20:46.082546 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:46.082209 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:20:50.082257 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:20:50.082219 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:20:50.082704 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:20:50.082395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:00.082421 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:00.082348 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:21:00.082785 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:00.082513 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:21:02.082242 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:02.082206 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:21:02.082637 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:02.082378 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:11.082890 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:11.082858 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:21:11.083340 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:11.083033 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:21:13.082430 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:13.082394 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:21:13.082839 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:13.082807 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:21:14.002009 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:14.001976 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e53f598-1656-4df0-8516-2dac8031ba2b" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" exitCode=0 Sep 09 21:21:14.002189 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:14.002047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" event={"ID":"2e53f598-1656-4df0-8516-2dac8031ba2b","Type":"ContainerDied","Data":"b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354"} Sep 09 21:21:14.002189 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:14.002100 2580 scope.go:117] "RemoveContainer" containerID="0d6231a3f54cfb2f992dea7cc284cd460fb043f4169405add8ef6e4e37b4720f" Sep 09 21:21:14.002500 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:14.002484 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:21:14.002737 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:14.002719 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:21.156957 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:21.156916 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:21:21.157435 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:21.156981 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:21:21.157435 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:21.156996 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:21:21.157435 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:21.157010 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" Sep 09 21:21:21.157540 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:21.157460 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:21:21.157728 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:21.157665 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:26.082684 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:26.082651 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:21:26.083068 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:26.082841 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:21:35.082166 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:35.082135 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:21:35.082578 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:35.082302 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:39.082952 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:39.082919 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:21:39.083360 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:39.083102 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:21:49.088277 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:49.088247 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:21:49.088700 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:49.088415 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:21:54.082577 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:21:54.082545 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:21:54.083070 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:21:54.082770 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:01.082828 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:01.082793 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:22:01.083224 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:01.082944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:22:07.090093 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:07.086041 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:22:07.090093 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:07.086354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:15.082005 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:15.081968 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:22:15.082425 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:15.082152 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:22:16.704573 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:16.704541 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59685ff6b-hwp2l_9bbe79e3-8e0a-4ab6-8ad6-258d041e047e/copy-manifests/0.log" Sep 09 21:22:16.715419 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:16.715398 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59685ff6b-hwp2l_9bbe79e3-8e0a-4ab6-8ad6-258d041e047e/manager/0.log" Sep 09 21:22:18.834056 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:18.834018 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-rl7t7_491c967c-ccaa-4ede-b2d7-2103ed88c25e/limitador/0.log" Sep 09 21:22:19.698936 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:19.698904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f7b6bff6-btn67_d99c240a-8494-4475-bf22-c4a34474e061/kube-auth-proxy/0.log" Sep 09 21:22:20.082306 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:20.082273 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:22:20.082726 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:20.082450 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:20.182347 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:20.182309 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7848747c5b-jlb55_a70d1270-3709-4551-8f46-1f9a0fe195e2/router/0.log" Sep 09 21:22:20.545338 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:20.545312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-9k5j7_25ff437b-43b3-480c-9f49-a7d299923985/main/5.log" Sep 09 21:22:21.042704 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:21.042656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8dz_82b90467-eb09-4f38-943b-928a4e92b384/main/0.log" Sep 09 21:22:21.304373 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:21.304295 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_2e53f598-1656-4df0-8516-2dac8031ba2b/main/5.log" Sep 09 21:22:27.084023 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.083984 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:22:27.084735 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:27.084212 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:22:27.097623 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.097590 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dvsfq/must-gather-bwsp9"] Sep 09 21:22:27.100905 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.100888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.104044 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.104023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvsfq\"/\"kube-root-ca.crt\"" Sep 09 21:22:27.104382 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.104363 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvsfq\"/\"openshift-service-ca.crt\"" Sep 09 21:22:27.105223 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.105204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dvsfq\"/\"default-dockercfg-rmncw\"" Sep 09 21:22:27.110384 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.110359 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvsfq/must-gather-bwsp9"] Sep 09 21:22:27.275688 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.275640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-must-gather-output\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.275862 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.275786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2chb\" (UniqueName: \"kubernetes.io/projected/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-kube-api-access-g2chb\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.376480 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.376388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2chb\" (UniqueName: \"kubernetes.io/projected/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-kube-api-access-g2chb\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.376480 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.376436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-must-gather-output\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.376882 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.376742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-must-gather-output\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.390869 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.390842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2chb\" (UniqueName: \"kubernetes.io/projected/40c6a5b0-2ef8-4e54-91ac-ade341c6c966-kube-api-access-g2chb\") pod \"must-gather-bwsp9\" (UID: \"40c6a5b0-2ef8-4e54-91ac-ade341c6c966\") " pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.410774 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.410736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" Sep 09 21:22:27.690563 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:27.690481 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvsfq/must-gather-bwsp9"] Sep 09 21:22:27.694335 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:22:27.694306 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40c6a5b0_2ef8_4e54_91ac_ade341c6c966.slice/crio-c8cfd8701a9ac73a8cac252e03d1f76f508af05fd6414d93c55ae9603edc7266 WatchSource:0}: Error finding container c8cfd8701a9ac73a8cac252e03d1f76f508af05fd6414d93c55ae9603edc7266: Status 404 returned error can't find the container with id c8cfd8701a9ac73a8cac252e03d1f76f508af05fd6414d93c55ae9603edc7266 Sep 09 21:22:28.349983 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:28.349944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" event={"ID":"40c6a5b0-2ef8-4e54-91ac-ade341c6c966","Type":"ContainerStarted","Data":"c8cfd8701a9ac73a8cac252e03d1f76f508af05fd6414d93c55ae9603edc7266"} Sep 09 21:22:30.369268 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:30.369226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" event={"ID":"40c6a5b0-2ef8-4e54-91ac-ade341c6c966","Type":"ContainerStarted","Data":"aa956ea8a024717b46baf688fb4ac4cd87159dda251ab589e376ba17b3d13590"} Sep 09 21:22:30.369786 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:30.369284 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" event={"ID":"40c6a5b0-2ef8-4e54-91ac-ade341c6c966","Type":"ContainerStarted","Data":"1bdb9888ef93429210178ef615c73a24cc51ca9ff3b9c93f14202086a38faee6"} Sep 09 21:22:30.393146 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:30.393090 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dvsfq/must-gather-bwsp9" podStartSLOduration=1.755393014 podStartE2EDuration="3.393071032s" totalImagesPullingTime="1.637678018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:30.391076321 +0000 UTC m=+1253.810849522" watchObservedRunningTime="2026-09-09 21:22:30.393071032 +0000 UTC m=+1253.812844230" Sep 09 21:22:31.082982 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:31.082947 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:22:31.083237 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:31.083202 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:31.210894 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:31.210838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-smz62_0fb84b9e-af4d-46eb-804c-1ebc3a68f8f4/global-pull-secret-syncer/0.log" Sep 09 21:22:31.498479 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:31.498404 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rgr7z_2e25e491-7653-49b7-bf57-b0123eb7a7fc/konnectivity-agent/0.log" Sep 09 21:22:31.555211 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:31.555183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-243.ec2.internal_796a00e702ae2d3b69b1ebe3e73739bc/haproxy/0.log" Sep 09 21:22:35.447579 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:35.447459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-rl7t7_491c967c-ccaa-4ede-b2d7-2103ed88c25e/limitador/0.log" Sep 09 21:22:37.426416 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.426364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-jckqs_c85e21d0-edbd-4339-90ce-804a99e119f8/cluster-monitoring-operator/0.log" Sep 09 21:22:37.552169 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.552125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-574d646cfd-jb8fx_09860b7e-9be9-4371-8d56-aaaee9045ea7/metrics-server/0.log" Sep 09 21:22:37.842114 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.842088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdr42_5ab3f3da-5674-44e3-8409-25d17cc722b7/node-exporter/0.log" Sep 09 21:22:37.872449 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.872406 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdr42_5ab3f3da-5674-44e3-8409-25d17cc722b7/kube-rbac-proxy/0.log" Sep 09 21:22:37.904940 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.904906 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdr42_5ab3f3da-5674-44e3-8409-25d17cc722b7/init-textfile/0.log" Sep 09 21:22:37.950741 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.950710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nc954_f672dd4f-1aa2-4b8b-813e-048a38d720b8/kube-rbac-proxy-main/0.log" Sep 09 21:22:37.988718 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:37.988690 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nc954_f672dd4f-1aa2-4b8b-813e-048a38d720b8/kube-rbac-proxy-self/0.log" Sep 09 21:22:38.051595 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.051568 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nc954_f672dd4f-1aa2-4b8b-813e-048a38d720b8/openshift-state-metrics/0.log" Sep 09 21:22:38.393058 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.393019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-bb5nt_fb864a4b-7667-4171-a426-641b35976341/prometheus-operator/0.log" Sep 09 21:22:38.424934 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.424894 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-bb5nt_fb864a4b-7667-4171-a426-641b35976341/kube-rbac-proxy/0.log" Sep 09 21:22:38.650043 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.650014 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/thanos-query/0.log" Sep 09 21:22:38.687070 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.687041 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/kube-rbac-proxy-web/0.log" Sep 09 21:22:38.717916 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.717037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/kube-rbac-proxy/0.log" Sep 09 21:22:38.762880 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.762854 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/prom-label-proxy/0.log" Sep 09 21:22:38.796660 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.796627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/kube-rbac-proxy-rules/0.log" Sep 09 21:22:38.832840 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:38.832804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b56754769-5nnxg_a7bfda70-a537-42ae-890e-05e3dde8af55/kube-rbac-proxy-metrics/0.log" Sep 09 21:22:41.084637 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.084595 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:22:41.085251 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:41.084867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:22:41.382780 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.382653 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth"] Sep 09 21:22:41.386903 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.386876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.399967 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.399930 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth"] Sep 09 21:22:41.418951 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.418703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-sys\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.418951 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.418758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-lib-modules\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.418951 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.418790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-podres\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.418951 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.418820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-proc\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.418951 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.418847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshqm\" (UniqueName: \"kubernetes.io/projected/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-kube-api-access-hshqm\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.519912 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.519873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-lib-modules\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520187 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-podres\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520339 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-proc\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520456 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hshqm\" (UniqueName: \"kubernetes.io/projected/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-kube-api-access-hshqm\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520684 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-sys\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520816 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-proc\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.520928 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-podres\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.521024 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-lib-modules\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.521116 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.520862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-sys\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.532589 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.532560 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshqm\" (UniqueName: \"kubernetes.io/projected/81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e-kube-api-access-hshqm\") pod \"perf-node-gather-daemonset-hdfth\" (UID: \"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e\") " pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.701279 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.701189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:41.784544 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.784357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c7456b7cd-444pm_e6c0bfab-7c41-4485-a5d7-2fe7f0bc46de/console/0.log" Sep 09 21:22:41.826023 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:41.825996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-mvf8z_b9ee2757-68dc-4640-af0c-e97babbfa080/download-server/0.log" Sep 09 21:22:42.003445 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.003417 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth"] Sep 09 21:22:42.005968 ip-10-0-137-243 kubenswrapper[2580]: W0909 21:22:42.005939 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81ebe07a_6707_43dd_abd7_3f2d4aa7fc4e.slice/crio-cd478d214cedf6e6925cdc0bb81fea869602f4ff1a7ff66edc321d43be356a69 WatchSource:0}: Error finding container cd478d214cedf6e6925cdc0bb81fea869602f4ff1a7ff66edc321d43be356a69: Status 404 returned error can't find the container with id cd478d214cedf6e6925cdc0bb81fea869602f4ff1a7ff66edc321d43be356a69 Sep 09 21:22:42.082613 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.082588 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:22:42.082830 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:42.082810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:42.453366 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.452433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" event={"ID":"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e","Type":"ContainerStarted","Data":"0201ff4140389ef28db14555a61064c3e5652baca2a3e64119dc01284f1a7350"} Sep 09 21:22:42.453366 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.452502 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" event={"ID":"81ebe07a-6707-43dd-abd7-3f2d4aa7fc4e","Type":"ContainerStarted","Data":"cd478d214cedf6e6925cdc0bb81fea869602f4ff1a7ff66edc321d43be356a69"} Sep 09 21:22:42.453366 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.453304 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:42.482164 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:42.482096 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" podStartSLOduration=1.482074161 podStartE2EDuration="1.482074161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:42.479687986 +0000 UTC m=+1265.899461177" watchObservedRunningTime="2026-09-09 21:22:42.482074161 +0000 UTC m=+1265.901847362" Sep 09 21:22:43.747651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:43.747623 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95lwl_c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9/dns/0.log" Sep 09 21:22:43.777651 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:43.777554 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95lwl_c4c9c8b8-8b0b-4278-ba0c-8e2acff39ff9/kube-rbac-proxy/0.log" Sep 09 21:22:43.900803 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:43.900777 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnkd6_f21e77d2-2b45-4b8a-93d7-9fc4d59aec23/dns-node-resolver/0.log" Sep 09 21:22:44.620133 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:44.620104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bvmr_abdb95d3-dfee-40c7-9f55-79764bd356ee/node-ca/0.log" Sep 09 21:22:45.910629 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:45.910597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f7b6bff6-btn67_d99c240a-8494-4475-bf22-c4a34474e061/kube-auth-proxy/0.log" Sep 09 21:22:46.041606 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:46.041570 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7848747c5b-jlb55_a70d1270-3709-4551-8f46-1f9a0fe195e2/router/0.log" Sep 09 21:22:46.696153 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:46.696110 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjwpr_a25c125c-6323-4dc6-a41b-11407e40e6e8/serve-healthcheck-canary/0.log" Sep 09 21:22:47.452521 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:47.452493 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjzmj_73b87e2f-9452-49ad-9e98-7cdf32040b8b/kube-rbac-proxy/0.log" Sep 09 21:22:47.493042 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:47.493016 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjzmj_73b87e2f-9452-49ad-9e98-7cdf32040b8b/exporter/0.log" Sep 09 21:22:47.529194 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:47.529157 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjzmj_73b87e2f-9452-49ad-9e98-7cdf32040b8b/extractor/0.log" Sep 09 21:22:49.479076 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:49.479049 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dvsfq/perf-node-gather-daemonset-hdfth" Sep 09 21:22:50.411569 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:50.411541 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59685ff6b-hwp2l_9bbe79e3-8e0a-4ab6-8ad6-258d041e047e/manager/0.log" Sep 09 21:22:50.447186 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:50.447155 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59685ff6b-hwp2l_9bbe79e3-8e0a-4ab6-8ad6-258d041e047e/copy-manifests/0.log" Sep 09 21:22:51.604034 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:51.604005 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f7b6bff6-btn67_d99c240a-8494-4475-bf22-c4a34474e061/kube-auth-proxy/0.log" Sep 09 21:22:51.710960 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:51.710925 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7848747c5b-jlb55_a70d1270-3709-4551-8f46-1f9a0fe195e2/router/0.log" Sep 09 21:22:51.969149 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:51.969121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57b847cbcb-5rnwt_4be008a9-3513-4446-a54e-6de248bd1911/manager/0.log" Sep 09 21:22:52.064442 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:52.064350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4hf5z_d63bf97d-5864-4c80-9cd3-38856bf8c44f/openshift-lws-operator/0.log" Sep 09 21:22:53.082219 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:53.082185 2580 scope.go:117] "RemoveContainer" containerID="11f546d94932fe0755165c5503257d2fc9169d3dee4b0c3e32e1f86766aa1d3a" Sep 09 21:22:53.082717 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:53.082257 2580 scope.go:117] "RemoveContainer" containerID="b0e803381f0995427441d42e67d094589361e2af51796c62f5d8ec3f2fd36354" Sep 09 21:22:53.082717 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:53.082440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-9k5j7_llm(25ff437b-43b3-480c-9f49-a7d299923985)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-9k5j7" podUID="25ff437b-43b3-480c-9f49-a7d299923985" Sep 09 21:22:53.082717 ip-10-0-137-243 kubenswrapper[2580]: E0909 21:22:53.082461 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-8xchr_llm(2e53f598-1656-4df0-8516-2dac8031ba2b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-8xchr" podUID="2e53f598-1656-4df0-8516-2dac8031ba2b" Sep 09 21:22:53.160025 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:53.159933 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f7b6bff6-btn67_d99c240a-8494-4475-bf22-c4a34474e061/kube-auth-proxy/0.log" Sep 09 21:22:53.258589 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:53.258557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7848747c5b-jlb55_a70d1270-3709-4551-8f46-1f9a0fe195e2/router/0.log" Sep 09 21:22:58.644720 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:58.644656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l97gq_13bfe6a6-4bf2-423a-a68a-b41019d1f2cc/kube-storage-version-migrator-operator/1.log" Sep 09 21:22:58.645603 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:58.645584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l97gq_13bfe6a6-4bf2-423a-a68a-b41019d1f2cc/kube-storage-version-migrator-operator/0.log" Sep 09 21:22:59.840231 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:59.840146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/kube-multus-additional-cni-plugins/0.log" Sep 09 21:22:59.871592 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:59.871565 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/egress-router-binary-copy/0.log" Sep 09 21:22:59.901300 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:59.901255 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/cni-plugins/0.log" Sep 09 21:22:59.935120 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:59.935064 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/bond-cni-plugin/0.log" Sep 09 21:22:59.981582 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:22:59.981552 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/routeoverride-cni/0.log" Sep 09 21:23:00.008897 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:23:00.008867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/whereabouts-cni-bincopy/0.log" Sep 09 21:23:00.040629 ip-10-0-137-243 kubenswrapper[2580]: I0909 21:23:00.040599 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7szbv_16400934-09ae-4dae-a47c-3d021a55b445/whereabouts-cni/0.log"